python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 849492 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4123656'] with mtr_portfolio_ids : ['28934472'] and first list_photo_ids : [] new path : /proc/849492/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 11 ; length of list_pids : 11 ; length of list_args : 11 time to download the photos : 1.4579460620880127 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Nov 26 21:50:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-11-26 21:50:31.700849: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-11-26 21:50:31.726517: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-11-26 21:50:31.728222: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f78f4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-11-26 21:50:31.728268: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-11-26 21:50:31.731949: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-11-26 21:50:32.045970: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3b3b5b50 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-11-26 21:50:32.046018: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-11-26 21:50:32.047446: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-26 21:50:32.047827: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-26 21:50:32.054321: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-26 21:50:32.056592: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-26 21:50:32.056948: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-26 21:50:32.059568: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-26 21:50:32.060807: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-26 21:50:32.065746: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-26 21:50:32.067577: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-26 21:50:32.067641: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-26 21:50:32.068439: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-26 21:50:32.068454: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-26 21:50:32.068463: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-26 21:50:32.069901: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-11-26 21:50:32.318049: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-26 21:50:32.318127: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-26 21:50:32.318149: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-26 21:50:32.318168: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-26 21:50:32.318186: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-26 21:50:32.318204: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-26 21:50:32.318222: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-26 21:50:32.318240: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-26 21:50:32.319856: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-26 21:50:32.321182: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-26 21:50:32.321216: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-26 21:50:32.321235: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-26 21:50:32.321253: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-26 21:50:32.321271: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-26 21:50:32.321288: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-26 21:50:32.321306: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-26 21:50:32.321323: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-26 21:50:32.322913: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-26 21:50:32.322945: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-26 21:50:32.322956: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-26 21:50:32.322965: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-26 21:50:32.324590: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-11-26 21:50:40.014561: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-26 21:50:40.196801: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 41.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 9 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 3 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 Detection mask done ! Trying to reset tf kernel 850025 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4907 tf kernel not reseted sub process len(results) : 11 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 11 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10196 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [747, 894, 1053, 1224] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0011708736419677734 nb_pixel_total : 52559 time to create 1 rle with old method : 0.05903983116149902 length of segment : 260 DEBUG bbox = [621, 963, 717, 1089] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00014257431030273438 nb_pixel_total : 7081 time to create 1 rle with old method : 0.008526325225830078 length of segment : 88 DEBUG bbox = [720, 1056, 819, 1221] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00017905235290527344 nb_pixel_total : 10137 time to create 1 rle with old method : 0.011823415756225586 length of segment : 94 DEBUG bbox = [765, 921, 861, 1041] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00013017654418945312 nb_pixel_total : 5274 time to create 1 rle with old method : 0.006258726119995117 length of segment : 92 DEBUG bbox = [531, 843, 624, 1026] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0001857280731201172 nb_pixel_total : 9320 time to create 1 rle with old method : 0.011028766632080078 length of segment : 99 DEBUG bbox = [939, 534, 1050, 630] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00013375282287597656 nb_pixel_total : 6966 time to create 1 rle with old method : 0.008023500442504883 length of segment : 94 DEBUG bbox = [882, 489, 1053, 630] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00022339820861816406 nb_pixel_total : 9373 time to create 1 rle with old method : 0.010953903198242188 length of segment : 159 DEBUG bbox = [867, 249, 1071, 537] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00038886070251464844 nb_pixel_total : 16306 time to create 1 rle with old method : 0.018708229064941406 length of segment : 148 DEBUG bbox = [903, 606, 1080, 915] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00040602684020996094 nb_pixel_total : 25796 time to create 1 rle with old method : 0.0285794734954834 length of segment : 263 DEBUG bbox = [897, 819, 1056, 939] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00016498565673828125 nb_pixel_total : 10427 time to create 1 rle with old method : 0.011513233184814453 length of segment : 135 DEBUG bbox = [51, 1410, 270, 1536] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00023102760314941406 nb_pixel_total : 14235 time to create 1 rle with old method : 0.015475273132324219 length of segment : 216 DEBUG bbox = [267, 1083, 372, 1224] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00018596649169921875 nb_pixel_total : 9261 time to create 1 rle with old method : 0.010622739791870117 length of segment : 102 DEBUG bbox = [984, 642, 1074, 771] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00013065338134765625 nb_pixel_total : 6469 time to create 1 rle with old method : 0.0076372623443603516 length of segment : 76 DEBUG bbox = [39, 1743, 246, 1884] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0002675056457519531 nb_pixel_total : 18017 time to create 1 rle with old method : 0.01998114585876465 length of segment : 209 DEBUG bbox = [372, 1179, 546, 1362] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0002918243408203125 nb_pixel_total : 19190 time to create 1 rle with old method : 0.021815061569213867 length of segment : 168 DEBUG bbox = [942, 912, 1071, 1005] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0001544952392578125 nb_pixel_total : 9280 time to create 1 rle with old method : 0.010915040969848633 length of segment : 127 DEBUG bbox = [753, 885, 906, 1002] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00018286705017089844 nb_pixel_total : 11453 time to create 1 rle with old method : 0.012879371643066406 length of segment : 152 DEBUG bbox = [831, 732, 894, 810] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 7.677078247070312e-05 nb_pixel_total : 2676 time to create 1 rle with old method : 0.0031969547271728516 length of segment : 54 DEBUG bbox = [930, 999, 1014, 1056] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 2913 time to create 1 rle with old method : 0.0035622119903564453 length of segment : 77 DEBUG bbox = [141, 1278, 234, 1386] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00011277198791503906 nb_pixel_total : 5724 time to create 1 rle with old method : 0.00681614875793457 length of segment : 92 DEBUG bbox = [807, 723, 888, 837] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00011467933654785156 nb_pixel_total : 5334 time to create 1 rle with old method : 0.0061092376708984375 length of segment : 72 DEBUG bbox = [1014, 1209, 1077, 1344] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00010776519775390625 nb_pixel_total : 5744 time to create 1 rle with old method : 0.006998538970947266 length of segment : 62 DEBUG bbox = [6, 1257, 60, 1323] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 2750 time to create 1 rle with old method : 0.0033750534057617188 length of segment : 54 DEBUG bbox = [651, 864, 780, 1062] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0002257823944091797 nb_pixel_total : 11920 time to create 1 rle with old method : 0.014206886291503906 length of segment : 132 DEBUG bbox = [315, 1110, 486, 1242] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0002906322479248047 nb_pixel_total : 12838 time to create 1 rle with old method : 0.015020370483398438 length of segment : 159 DEBUG bbox = [0, 1485, 57, 1557] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 8.177757263183594e-05 nb_pixel_total : 2941 time to create 1 rle with old method : 0.003566265106201172 length of segment : 54 DEBUG bbox = [711, 672, 801, 780] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00012040138244628906 nb_pixel_total : 5595 time to create 1 rle with old method : 0.006726980209350586 length of segment : 85 DEBUG bbox = [57, 1332, 480, 1470] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0005125999450683594 nb_pixel_total : 32004 time to create 1 rle with old method : 0.03554129600524902 length of segment : 412 DEBUG bbox = [378, 1164, 564, 1266] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00024127960205078125 nb_pixel_total : 11381 time to create 1 rle with old method : 0.014133691787719727 length of segment : 183 DEBUG bbox = [879, 390, 1008, 573] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00035881996154785156 nb_pixel_total : 14271 time to create 1 rle with old method : 0.017951488494873047 length of segment : 125 DEBUG bbox = [702, 510, 846, 675] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00021147727966308594 nb_pixel_total : 13320 time to create 1 rle with old method : 0.01523733139038086 length of segment : 139 DEBUG bbox = [984, 348, 1032, 417] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 1963 time to create 1 rle with old method : 0.0024302005767822266 length of segment : 43 DEBUG bbox = [618, 651, 684, 765] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 9.632110595703125e-05 nb_pixel_total : 5253 time to create 1 rle with old method : 0.006096839904785156 length of segment : 71 DEBUG bbox = [915, 732, 1047, 870] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00018072128295898438 nb_pixel_total : 10729 time to create 1 rle with old method : 0.012173652648925781 length of segment : 130 DEBUG bbox = [843, 123, 1080, 792] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0010349750518798828 nb_pixel_total : 68207 time to create 1 rle with old method : 0.07530856132507324 length of segment : 201 DEBUG bbox = [432, 828, 519, 972] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00014209747314453125 nb_pixel_total : 8011 time to create 1 rle with old method : 0.009041786193847656 length of segment : 86 DEBUG bbox = [783, 948, 852, 1071] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 9.775161743164062e-05 nb_pixel_total : 5001 time to create 1 rle with old method : 0.005656003952026367 length of segment : 63 DEBUG bbox = [1014, 312, 1074, 552] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00014591217041015625 nb_pixel_total : 10893 time to create 1 rle with old method : 0.012250185012817383 length of segment : 65 DEBUG bbox = [858, 897, 936, 1011] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 9.799003601074219e-05 nb_pixel_total : 4859 time to create 1 rle with old method : 0.005342006683349609 length of segment : 69 DEBUG bbox = [939, 534, 1053, 618] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00010657310485839844 nb_pixel_total : 6550 time to create 1 rle with old method : 0.007001399993896484 length of segment : 116 DEBUG bbox = [831, 297, 1044, 570] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0003948211669921875 nb_pixel_total : 23673 time to create 1 rle with old method : 0.025084257125854492 length of segment : 175 DEBUG bbox = [834, 963, 888, 1071] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 7.62939453125e-05 nb_pixel_total : 2841 time to create 1 rle with old method : 0.0033502578735351562 length of segment : 60 DEBUG bbox = [48, 948, 354, 1113] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.000476837158203125 nb_pixel_total : 38723 time to create 1 rle with old method : 0.045233726501464844 length of segment : 320 DEBUG bbox = [834, 1032, 909, 1203] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00021338462829589844 nb_pixel_total : 6250 time to create 1 rle with old method : 0.006995201110839844 length of segment : 64 DEBUG bbox = [813, 738, 930, 879] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00026798248291015625 nb_pixel_total : 9377 time to create 1 rle with old method : 0.011262655258178711 length of segment : 115 DEBUG bbox = [516, 1584, 1041, 1893] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0024743080139160156 nb_pixel_total : 102673 time to create 1 rle with old method : 0.11428070068359375 length of segment : 521 time spent for convertir_results : 1.9355063438415527 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 46 chid ids of type : 3594 Number RLEs to save : 6281 save missing photos in datou_result : time spend for datou_step_exec : 23.323232650756836 time spend to save output : 0.4819986820220947 total time spend for step 1 : 23.80523133277893 step2:crop_condition Wed Nov 26 21:50:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 11 ! batch 1 Loaded 46 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 38 About to insert : list_path_to_insert length 38 new photo from crops ! About to upload 38 photos upload in portfolio : 3736932 init cache_photo without model_param we have 38 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764190255_849492 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284995_8e66e73cd5eec5ea27cc2c0f0eb3be28_rle_crop_4046465413_0.png', 0, 160, 88, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284995_8e66e73cd5eec5ea27cc2c0f0eb3be28_rle_crop_4046465409_0.png', 0, 324, 260, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284995_8e66e73cd5eec5ea27cc2c0f0eb3be28_rle_crop_4046465412_0.png', 0, 116, 92, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284995_8e66e73cd5eec5ea27cc2c0f0eb3be28_rle_crop_4046465410_0.png', 0, 115, 88, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284995_8e66e73cd5eec5ea27cc2c0f0eb3be28_rle_crop_4046465411_0.png', 0, 165, 89, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284992_e3d4d49bf6502c098e0928a254fe7816_rle_crop_4046465416_0.png', 0, 249, 129, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284992_e3d4d49bf6502c098e0928a254fe7816_rle_crop_4046465415_0.png', 0, 130, 155, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284992_e3d4d49bf6502c098e0928a254fe7816_rle_crop_4046465418_0.png', 0, 109, 133, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284989_194bfedbda6a2b613e407283af64d07e_rle_crop_4046465421_0.png', 0, 107, 76, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284989_194bfedbda6a2b613e407283af64d07e_rle_crop_4046465420_0.png', 0, 139, 102, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284989_194bfedbda6a2b613e407283af64d07e_rle_crop_4046465419_0.png', 0, 105, 216, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284989_194bfedbda6a2b613e407283af64d07e_rle_crop_4046465422_0.png', 0, 134, 203, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284986_68588b968e29f23685732ea16fc9681e_rle_crop_4046465423_0.png', 0, 163, 157, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284947_2839b3b13b5ef4244d5f16248aba21e8_rle_crop_4046465426_0.png', 0, 69, 52, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284947_2839b3b13b5ef4244d5f16248aba21e8_rle_crop_4046465425_0.png', 0, 117, 150, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284947_2839b3b13b5ef4244d5f16248aba21e8_rle_crop_4046465424_0.png', 0, 88, 127, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284947_2839b3b13b5ef4244d5f16248aba21e8_rle_crop_4046465427_0.png', 0, 52, 76, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284947_2839b3b13b5ef4244d5f16248aba21e8_rle_crop_4046465428_0.png', 0, 104, 86, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284945_574e46d5ac6e9b6b2fadc649db40b2f7_rle_crop_4046465435_0.png', 0, 99, 85, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284945_574e46d5ac6e9b6b2fadc649db40b2f7_rle_crop_4046465429_0.png', 0, 104, 72, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284945_574e46d5ac6e9b6b2fadc649db40b2f7_rle_crop_4046465432_0.png', 0, 183, 117, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284945_574e46d5ac6e9b6b2fadc649db40b2f7_rle_crop_4046465433_0.png', 0, 126, 159, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284945_574e46d5ac6e9b6b2fadc649db40b2f7_rle_crop_4046465430_0.png', 0, 132, 61, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284945_574e46d5ac6e9b6b2fadc649db40b2f7_rle_crop_4046465436_0.png', 0, 136, 412, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284942_299752343365c43d71eb71fffb0befe5_rle_crop_4046465437_0.png', 0, 98, 183, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284939_c5bf5b2ec141285b1a61fea5d0040870_rle_crop_4046465440_0.png', 0, 69, 42, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284939_c5bf5b2ec141285b1a61fea5d0040870_rle_crop_4046465438_0.png', 0, 181, 121, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284939_c5bf5b2ec141285b1a61fea5d0040870_rle_crop_4046465441_0.png', 0, 112, 66, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284936_490825e91ff4a641ba1b22b8a5f9c586_rle_crop_4046465443_0.png', 0, 545, 188, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284936_490825e91ff4a641ba1b22b8a5f9c586_rle_crop_4046465442_0.png', 0, 131, 125, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284933_802ea107f4b2967486ea4769b9a67cb8_rle_crop_4046465449_0.png', 0, 220, 168, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284933_802ea107f4b2967486ea4769b9a67cb8_rle_crop_4046465446_0.png', 0, 237, 55, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284933_802ea107f4b2967486ea4769b9a67cb8_rle_crop_4046465444_0.png', 0, 126, 86, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284933_802ea107f4b2967486ea4769b9a67cb8_rle_crop_4046465447_0.png', 0, 110, 68, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284933_802ea107f4b2967486ea4769b9a67cb8_rle_crop_4046465445_0.png', 0, 115, 63, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284933_802ea107f4b2967486ea4769b9a67cb8_rle_crop_4046465450_0.png', 0, 99, 47, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284915_04063de9d5f5dfbffdb9b8ae977d21f8_rle_crop_4046465453_0.png', 0, 130, 107, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190263), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284915_04063de9d5f5dfbffdb9b8ae977d21f8_rle_crop_4046465452_0.png', 0, 142, 63, 0, 1764190263,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 38 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.694918632507324 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764190266_849492 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190267), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284995_8e66e73cd5eec5ea27cc2c0f0eb3be28_rle_crop_4046465414_0.png', 0, 95, 91, 0, 1764190267,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190267), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284992_e3d4d49bf6502c098e0928a254fe7816_rle_crop_4046465417_0.png', 0, 305, 149, 0, 1764190267,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190267), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284945_574e46d5ac6e9b6b2fadc649db40b2f7_rle_crop_4046465431_0.png', 0, 63, 52, 0, 1764190267,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190267), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284945_574e46d5ac6e9b6b2fadc649db40b2f7_rle_crop_4046465434_0.png', 0, 71, 54, 0, 1764190267,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190267), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284939_c5bf5b2ec141285b1a61fea5d0040870_rle_crop_4046465439_0.png', 0, 142, 138, 0, 1764190267,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190267), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284933_802ea107f4b2967486ea4769b9a67cb8_rle_crop_4046465448_0.png', 0, 83, 112, 0, 1764190267,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190267), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284915_04063de9d5f5dfbffdb9b8ae977d21f8_rle_crop_4046465454_0.png', 0, 307, 521, 0, 1764190267,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.6101932525634766 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764190268_849492 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764190268), 0.0, 0.0, 14, '', 0, 0, '1764190227_849492_1396284915_04063de9d5f5dfbffdb9b8ae977d21f8_rle_crop_4046465451_0.png', 0, 158, 303, 0, 1764190268,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5939123630523682 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1396284995, 1396284992, 1396284989, 1396284986, 1396284947, 1396284945, 1396284942, 1396284939, 1396284936, 1396284933, 1396284915] Looping around the photos to save general results len do output : 46 /1396297076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297084Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297088Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297092Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297096Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297100Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297102Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297104Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297106Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297108Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396297130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284995', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284992', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284989', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284986', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284947', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284945', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284942', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284939', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284936', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284933', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284915', None, None, None, None, None, '4123656') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 149 time used for this insertion : 0.03113412857055664 save_final save missing photos in datou_result : time spend for datou_step_exec : 15.899632692337036 time spend to save output : 0.03316020965576172 total time spend for step 2 : 15.932792901992798 step3:rle_unique_nms_with_priority Wed Nov 26 21:51:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 46 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.5593962669372559 time for calcul the mask position with numpy : 0.17512249946594238 nb_pixel_total : 1982491 time to create 1 rle with new method : 0.0891571044921875 time for calcul the mask position with numpy : 0.006033658981323242 nb_pixel_total : 6966 time to create 1 rle with old method : 0.007269859313964844 time for calcul the mask position with numpy : 0.006201982498168945 nb_pixel_total : 9320 time to create 1 rle with old method : 0.009761810302734375 time for calcul the mask position with numpy : 0.005856513977050781 nb_pixel_total : 5046 time to create 1 rle with old method : 0.005252838134765625 time for calcul the mask position with numpy : 0.00612950325012207 nb_pixel_total : 10137 time to create 1 rle with old method : 0.010793924331665039 time for calcul the mask position with numpy : 0.006058454513549805 nb_pixel_total : 7081 time to create 1 rle with old method : 0.007932901382446289 time for calcul the mask position with numpy : 0.006400346755981445 nb_pixel_total : 52559 time to create 1 rle with old method : 0.05602669715881348 create new chi : 0.40777087211608887 time to delete rle : 0.036647796630859375 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 2492 TO DO : save crop sub photo not yet done ! save time : 0.21605396270751953 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.1989154815673828 time for calcul the mask position with numpy : 0.14724326133728027 nb_pixel_total : 2019172 time to create 1 rle with new method : 0.08127641677856445 time for calcul the mask position with numpy : 0.006036281585693359 nb_pixel_total : 2953 time to create 1 rle with old method : 0.003123044967651367 time for calcul the mask position with numpy : 0.006064414978027344 nb_pixel_total : 25796 time to create 1 rle with old method : 0.027855873107910156 time for calcul the mask position with numpy : 0.006036281585693359 nb_pixel_total : 16306 time to create 1 rle with old method : 0.01744222640991211 time for calcul the mask position with numpy : 0.006092548370361328 nb_pixel_total : 9373 time to create 1 rle with old method : 0.010133743286132812 create new chi : 0.31796693801879883 time to delete rle : 0.00032901763916015625 batch 1 Loaded 9 chid ids of type : 3594 +++++Number RLEs to save : 2373 TO DO : save crop sub photo not yet done ! save time : 0.20378661155700684 nb_obj : 4 nb_hashtags : 1 time to prepare the origin masks : 0.06705093383789062 time for calcul the mask position with numpy : 0.023133277893066406 nb_pixel_total : 2025618 time to create 1 rle with new method : 0.10204935073852539 time for calcul the mask position with numpy : 0.006033897399902344 nb_pixel_total : 18017 time to create 1 rle with old method : 0.019689321517944336 time for calcul the mask position with numpy : 0.005906105041503906 nb_pixel_total : 6469 time to create 1 rle with old method : 0.007111549377441406 time for calcul the mask position with numpy : 0.005948066711425781 nb_pixel_total : 9261 time to create 1 rle with old method : 0.010289192199707031 time for calcul the mask position with numpy : 0.005904436111450195 nb_pixel_total : 14235 time to create 1 rle with old method : 0.015558481216430664 create new chi : 0.20845794677734375 time to delete rle : 0.0003323554992675781 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 2286 TO DO : save crop sub photo not yet done ! save time : 0.20147943496704102 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03259587287902832 time for calcul the mask position with numpy : 0.01854848861694336 nb_pixel_total : 2054410 time to create 1 rle with new method : 0.19182753562927246 time for calcul the mask position with numpy : 0.0069658756256103516 nb_pixel_total : 19190 time to create 1 rle with old method : 0.021665573120117188 create new chi : 0.2460479736328125 time to delete rle : 0.0002579689025878906 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1416 TO DO : save crop sub photo not yet done ! save time : 0.14355993270874023 nb_obj : 5 nb_hashtags : 1 time to prepare the origin masks : 0.17974424362182617 time for calcul the mask position with numpy : 0.2797739505767822 nb_pixel_total : 2041554 time to create 1 rle with new method : 0.08697867393493652 time for calcul the mask position with numpy : 0.010274171829223633 nb_pixel_total : 5724 time to create 1 rle with old method : 0.0062732696533203125 time for calcul the mask position with numpy : 0.00605010986328125 nb_pixel_total : 2913 time to create 1 rle with old method : 0.003148794174194336 time for calcul the mask position with numpy : 0.005978107452392578 nb_pixel_total : 2676 time to create 1 rle with old method : 0.003086566925048828 time for calcul the mask position with numpy : 0.005991458892822266 nb_pixel_total : 11453 time to create 1 rle with old method : 0.012510299682617188 time for calcul the mask position with numpy : 0.0058710575103759766 nb_pixel_total : 9280 time to create 1 rle with old method : 0.00992727279663086 create new chi : 0.4468555450439453 time to delete rle : 0.00036072731018066406 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 2084 TO DO : save crop sub photo not yet done ! save time : 0.1927943229675293 nb_obj : 8 nb_hashtags : 2 time to prepare the origin masks : 0.4029831886291504 time for calcul the mask position with numpy : 0.18896055221557617 nb_pixel_total : 1994474 time to create 1 rle with new method : 0.0808572769165039 time for calcul the mask position with numpy : 0.006359577178955078 nb_pixel_total : 32004 time to create 1 rle with old method : 0.034981727600097656 time for calcul the mask position with numpy : 0.006167411804199219 nb_pixel_total : 5595 time to create 1 rle with old method : 0.006267547607421875 time for calcul the mask position with numpy : 0.0064029693603515625 nb_pixel_total : 2941 time to create 1 rle with old method : 0.0033159255981445312 time for calcul the mask position with numpy : 0.00616145133972168 nb_pixel_total : 12838 time to create 1 rle with old method : 0.0142822265625 time for calcul the mask position with numpy : 0.006044626235961914 nb_pixel_total : 11920 time to create 1 rle with old method : 0.012768268585205078 time for calcul the mask position with numpy : 0.006011009216308594 nb_pixel_total : 2750 time to create 1 rle with old method : 0.003111600875854492 time for calcul the mask position with numpy : 0.005873203277587891 nb_pixel_total : 5744 time to create 1 rle with old method : 0.006374359130859375 time for calcul the mask position with numpy : 0.006024599075317383 nb_pixel_total : 5334 time to create 1 rle with old method : 0.005663871765136719 create new chi : 0.4159219264984131 time to delete rle : 0.0004241466522216797 batch 1 Loaded 17 chid ids of type : 3594 +++++++++Number RLEs to save : 3140 TO DO : save crop sub photo not yet done ! save time : 0.25949835777282715 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.035176992416381836 time for calcul the mask position with numpy : 0.022701025009155273 nb_pixel_total : 2062219 time to create 1 rle with new method : 0.03275656700134277 time for calcul the mask position with numpy : 0.007094383239746094 nb_pixel_total : 11381 time to create 1 rle with old method : 0.012857198715209961 create new chi : 0.0833899974822998 time to delete rle : 0.00024008750915527344 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1446 TO DO : save crop sub photo not yet done ! save time : 0.14470386505126953 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.06309056282043457 time for calcul the mask position with numpy : 0.10389065742492676 nb_pixel_total : 2038793 time to create 1 rle with new method : 0.17280840873718262 time for calcul the mask position with numpy : 0.0061228275299072266 nb_pixel_total : 5253 time to create 1 rle with old method : 0.005755186080932617 time for calcul the mask position with numpy : 0.0057790279388427734 nb_pixel_total : 1963 time to create 1 rle with old method : 0.002118825912475586 time for calcul the mask position with numpy : 0.0059185028076171875 nb_pixel_total : 13320 time to create 1 rle with old method : 0.014902591705322266 time for calcul the mask position with numpy : 0.005902528762817383 nb_pixel_total : 14271 time to create 1 rle with old method : 0.015806913375854492 create new chi : 0.3504793643951416 time to delete rle : 0.0003192424774169922 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 1836 TO DO : save crop sub photo not yet done ! save time : 0.17420744895935059 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04205322265625 time for calcul the mask position with numpy : 0.020034074783325195 nb_pixel_total : 1994664 time to create 1 rle with new method : 0.12693023681640625 time for calcul the mask position with numpy : 0.006702899932861328 nb_pixel_total : 68207 time to create 1 rle with old method : 0.07271957397460938 time for calcul the mask position with numpy : 0.005961418151855469 nb_pixel_total : 10729 time to create 1 rle with old method : 0.01143789291381836 create new chi : 0.25113511085510254 time to delete rle : 0.0002548694610595703 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1742 TO DO : save crop sub photo not yet done ! save time : 0.16068482398986816 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 0.24614477157592773 time for calcul the mask position with numpy : 0.13979721069335938 nb_pixel_total : 2011773 time to create 1 rle with new method : 0.10777449607849121 time for calcul the mask position with numpy : 0.005828857421875 nb_pixel_total : 2840 time to create 1 rle with old method : 0.0030853748321533203 time for calcul the mask position with numpy : 0.006304740905761719 nb_pixel_total : 23673 time to create 1 rle with old method : 0.025860071182250977 time for calcul the mask position with numpy : 0.005974531173706055 nb_pixel_total : 6550 time to create 1 rle with old method : 0.006972074508666992 time for calcul the mask position with numpy : 0.0058972835540771484 nb_pixel_total : 4859 time to create 1 rle with old method : 0.007966756820678711 time for calcul the mask position with numpy : 0.0067980289459228516 nb_pixel_total : 10893 time to create 1 rle with old method : 0.011992216110229492 time for calcul the mask position with numpy : 0.0065004825592041016 nb_pixel_total : 5001 time to create 1 rle with old method : 0.005672454833984375 time for calcul the mask position with numpy : 0.0063974857330322266 nb_pixel_total : 8011 time to create 1 rle with old method : 0.00877523422241211 create new chi : 0.37120985984802246 time to delete rle : 0.0004317760467529297 batch 1 Loaded 15 chid ids of type : 3594 ++++++++++Number RLEs to save : 2345 TO DO : save crop sub photo not yet done ! save time : 0.2149677276611328 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.06908535957336426 time for calcul the mask position with numpy : 0.02324509620666504 nb_pixel_total : 1916577 time to create 1 rle with new method : 0.12526607513427734 time for calcul the mask position with numpy : 0.006447792053222656 nb_pixel_total : 102673 time to create 1 rle with old method : 0.11220002174377441 time for calcul the mask position with numpy : 0.005998849868774414 nb_pixel_total : 9377 time to create 1 rle with old method : 0.010508298873901367 time for calcul the mask position with numpy : 0.006026506423950195 nb_pixel_total : 6250 time to create 1 rle with old method : 0.0070726871490478516 time for calcul the mask position with numpy : 0.006162166595458984 nb_pixel_total : 38723 time to create 1 rle with old method : 0.04220318794250488 create new chi : 0.35268068313598633 time to delete rle : 0.00040912628173828125 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3120 TO DO : save crop sub photo not yet done ! save time : 0.24817490577697754 map_output_result : {1396284995: (0.0, 'Should be the crop_list due to order', 0), 1396284992: (0.0, 'Should be the crop_list due to order', 0), 1396284989: (0.0, 'Should be the crop_list due to order', 0), 1396284986: (0.0, 'Should be the crop_list due to order', 0), 1396284947: (0.0, 'Should be the crop_list due to order', 0), 1396284945: (0.0, 'Should be the crop_list due to order', 0), 1396284942: (0.0, 'Should be the crop_list due to order', 0), 1396284939: (0.0, 'Should be the crop_list due to order', 0), 1396284936: (0.0, 'Should be the crop_list due to order', 0), 1396284933: (0.0, 'Should be the crop_list due to order', 0), 1396284915: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1396284995, 1396284992, 1396284989, 1396284986, 1396284947, 1396284945, 1396284942, 1396284939, 1396284936, 1396284933, 1396284915] Looping around the photos to save general results len do output : 11 /1396284995.Didn't retrieve data . /1396284992.Didn't retrieve data . /1396284989.Didn't retrieve data . /1396284986.Didn't retrieve data . /1396284947.Didn't retrieve data . /1396284945.Didn't retrieve data . /1396284942.Didn't retrieve data . /1396284939.Didn't retrieve data . /1396284936.Didn't retrieve data . /1396284933.Didn't retrieve data . /1396284915.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284995', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284992', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284989', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284986', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284947', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284945', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284942', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284939', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284936', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284933', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284915', None, None, None, None, None, '4123656') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.017499208450317383 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.960773229598999 time spend to save output : 0.01794743537902832 total time spend for step 3 : 7.978720664978027 step4:ventilate_hashtags_in_portfolio Wed Nov 26 21:51:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 28934472 get user id for portfolio 28934472 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28934472 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','flou','pehd','pet_clair','autre','metal','pet_fonce','background','environnement','papier','carton')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28934472 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','flou','pehd','pet_clair','autre','metal','pet_fonce','background','environnement','papier','carton')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28934472 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','flou','pehd','pet_clair','autre','metal','pet_fonce','background','environnement','papier','carton')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/28936839,28936840,28936841,28936842,28936843,28936844,28936845,28936846,28936847,28936848,28936849?tags=mal_croppe,flou,pehd,pet_clair,autre,metal,pet_fonce,background,environnement,papier,carton Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1396284995, 1396284992, 1396284989, 1396284986, 1396284947, 1396284945, 1396284942, 1396284939, 1396284936, 1396284933, 1396284915] Looping around the photos to save general results len do output : 1 /28934472. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284995', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284992', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284989', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284986', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284947', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284945', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284942', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284939', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284936', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284933', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284915', None, None, None, None, None, '4123656') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.019303083419799805 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.9785535335540771 time spend to save output : 0.01957845687866211 total time spend for step 4 : 1.9981319904327393 step5:final Wed Nov 26 21:51:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1396284995: ('0.02927955773007856',), 1396284992: ('0.02927955773007856',), 1396284989: ('0.02927955773007856',), 1396284986: ('0.02927955773007856',), 1396284947: ('0.02927955773007856',), 1396284945: ('0.02927955773007856',), 1396284942: ('0.02927955773007856',), 1396284939: ('0.02927955773007856',), 1396284936: ('0.02927955773007856',), 1396284933: ('0.02927955773007856',), 1396284915: ('0.02927955773007856',)} new output for save of step final : {1396284995: ('0.02927955773007856',), 1396284992: ('0.02927955773007856',), 1396284989: ('0.02927955773007856',), 1396284986: ('0.02927955773007856',), 1396284947: ('0.02927955773007856',), 1396284945: ('0.02927955773007856',), 1396284942: ('0.02927955773007856',), 1396284939: ('0.02927955773007856',), 1396284936: ('0.02927955773007856',), 1396284933: ('0.02927955773007856',), 1396284915: ('0.02927955773007856',)} [1396284995, 1396284992, 1396284989, 1396284986, 1396284947, 1396284945, 1396284942, 1396284939, 1396284936, 1396284933, 1396284915] Looping around the photos to save general results len do output : 11 /1396284995.Didn't retrieve data . /1396284992.Didn't retrieve data . /1396284989.Didn't retrieve data . /1396284986.Didn't retrieve data . /1396284947.Didn't retrieve data . /1396284945.Didn't retrieve data . /1396284942.Didn't retrieve data . /1396284939.Didn't retrieve data . /1396284936.Didn't retrieve data . /1396284933.Didn't retrieve data . /1396284915.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284995', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284992', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284989', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284986', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284947', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284945', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284942', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284939', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284936', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284933', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284915', None, None, None, None, None, '4123656') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.019518375396728516 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.14102411270141602 time spend to save output : 0.02012348175048828 total time spend for step 5 : 0.1611475944519043 step6:blur_detection Wed Nov 26 21:51:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1764190227_849492_1396284995_8e66e73cd5eec5ea27cc2c0f0eb3be28.jpg resize: (1080, 1920) 1396284995 -2.8750081086508996 treat image : temp/1764190227_849492_1396284992_e3d4d49bf6502c098e0928a254fe7816.jpg resize: (1080, 1920) 1396284992 2.0663318656019065 treat image : temp/1764190227_849492_1396284989_194bfedbda6a2b613e407283af64d07e.jpg resize: (1080, 1920) 1396284989 -3.9636443628545717 treat image : temp/1764190227_849492_1396284986_68588b968e29f23685732ea16fc9681e.jpg resize: (1080, 1920) 1396284986 1.2068327628756637 treat image : temp/1764190227_849492_1396284947_2839b3b13b5ef4244d5f16248aba21e8.jpg resize: (1080, 1920) 1396284947 -0.9591557279114789 treat image : temp/1764190227_849492_1396284945_574e46d5ac6e9b6b2fadc649db40b2f7.jpg resize: (1080, 1920) 1396284945 -0.30054736589124786 treat image : temp/1764190227_849492_1396284942_299752343365c43d71eb71fffb0befe5.jpg resize: (1080, 1920) 1396284942 0.8129389683518335 treat image : temp/1764190227_849492_1396284939_c5bf5b2ec141285b1a61fea5d0040870.jpg resize: (1080, 1920) 1396284939 -3.5129588000648706 treat image : temp/1764190227_849492_1396284936_490825e91ff4a641ba1b22b8a5f9c586.jpg resize: (1080, 1920) 1396284936 -0.14871073416732766 treat image : temp/1764190227_849492_1396284933_802ea107f4b2967486ea4769b9a67cb8.jpg resize: (1080, 1920) 1396284933 -2.0909732432240378 treat image : temp/1764190227_849492_1396284915_04063de9d5f5dfbffdb9b8ae977d21f8.jpg resize: (1080, 1920) 1396284915 -3.887906927881363 treat image : temp/1764190227_849492_1396284995_8e66e73cd5eec5ea27cc2c0f0eb3be28_rle_crop_4046465413_0.png resize: (88, 160) 1396297076 -3.9215413238057697 treat image : temp/1764190227_849492_1396284995_8e66e73cd5eec5ea27cc2c0f0eb3be28_rle_crop_4046465409_0.png resize: (260, 324) 1396297077 -1.304441159428053 treat image : temp/1764190227_849492_1396284995_8e66e73cd5eec5ea27cc2c0f0eb3be28_rle_crop_4046465412_0.png resize: (92, 116) 1396297078 -3.7767135624085237 treat image : temp/1764190227_849492_1396284995_8e66e73cd5eec5ea27cc2c0f0eb3be28_rle_crop_4046465410_0.png resize: (88, 115) 1396297079 -2.0324796382439647 treat image : temp/1764190227_849492_1396284995_8e66e73cd5eec5ea27cc2c0f0eb3be28_rle_crop_4046465411_0.png resize: (89, 165) 1396297080 -3.3450391233310555 treat image : temp/1764190227_849492_1396284992_e3d4d49bf6502c098e0928a254fe7816_rle_crop_4046465416_0.png resize: (129, 249) 1396297081 -1.1209883451717495 treat image : temp/1764190227_849492_1396284992_e3d4d49bf6502c098e0928a254fe7816_rle_crop_4046465415_0.png resize: (155, 130) 1396297082 -0.40896565921924544 treat image : temp/1764190227_849492_1396284992_e3d4d49bf6502c098e0928a254fe7816_rle_crop_4046465418_0.png resize: (133, 109) 1396297083 -0.7229029935406301 treat image : temp/1764190227_849492_1396284989_194bfedbda6a2b613e407283af64d07e_rle_crop_4046465421_0.png resize: (76, 107) 1396297084 -4.694284155372143 treat image : temp/1764190227_849492_1396284989_194bfedbda6a2b613e407283af64d07e_rle_crop_4046465420_0.png resize: (102, 139) 1396297085 -1.288764852451015 treat image : temp/1764190227_849492_1396284989_194bfedbda6a2b613e407283af64d07e_rle_crop_4046465419_0.png resize: (216, 105) 1396297086 -1.5092650182747949 treat image : temp/1764190227_849492_1396284989_194bfedbda6a2b613e407283af64d07e_rle_crop_4046465422_0.png resize: (203, 134) 1396297087 -1.6823788982979075 treat image : temp/1764190227_849492_1396284986_68588b968e29f23685732ea16fc9681e_rle_crop_4046465423_0.png resize: (157, 163) 1396297088 -1.4332042971393921 treat image : temp/1764190227_849492_1396284947_2839b3b13b5ef4244d5f16248aba21e8_rle_crop_4046465426_0.png resize: (52, 69) 1396297089 -2.60982016056964 treat image : temp/1764190227_849492_1396284947_2839b3b13b5ef4244d5f16248aba21e8_rle_crop_4046465425_0.png resize: (150, 117) 1396297090 -1.8863712436480942 treat image : temp/1764190227_849492_1396284947_2839b3b13b5ef4244d5f16248aba21e8_rle_crop_4046465424_0.png resize: (127, 88) 1396297091 -2.3264014956565733 treat image : temp/1764190227_849492_1396284947_2839b3b13b5ef4244d5f16248aba21e8_rle_crop_4046465427_0.png resize: (76, 52) 1396297092 -1.8157780970102242 treat image : temp/1764190227_849492_1396284947_2839b3b13b5ef4244d5f16248aba21e8_rle_crop_4046465428_0.png resize: (86, 104) 1396297094 -1.4161974168183817 treat image : temp/1764190227_849492_1396284945_574e46d5ac6e9b6b2fadc649db40b2f7_rle_crop_4046465435_0.png resize: (85, 99) 1396297095 1.6634398838460278 treat image : temp/1764190227_849492_1396284945_574e46d5ac6e9b6b2fadc649db40b2f7_rle_crop_4046465429_0.png resize: (72, 104) 1396297096 0.3092509230401314 treat image : temp/1764190227_849492_1396284945_574e46d5ac6e9b6b2fadc649db40b2f7_rle_crop_4046465432_0.png resize: (117, 183) 1396297097 -4.44355941551481 treat image : temp/1764190227_849492_1396284945_574e46d5ac6e9b6b2fadc649db40b2f7_rle_crop_4046465433_0.png resize: (159, 126) 1396297098 -1.5957734108850241 treat image : temp/1764190227_849492_1396284945_574e46d5ac6e9b6b2fadc649db40b2f7_rle_crop_4046465430_0.png resize: (61, 132) 1396297100 0.2719292402821021 treat image : temp/1764190227_849492_1396284945_574e46d5ac6e9b6b2fadc649db40b2f7_rle_crop_4046465436_0.png resize: (412, 136) 1396297101 -1.7984681919843775 treat image : temp/1764190227_849492_1396284942_299752343365c43d71eb71fffb0befe5_rle_crop_4046465437_0.png resize: (183, 98) 1396297102 -1.5822256629843205 treat image : temp/1764190227_849492_1396284939_c5bf5b2ec141285b1a61fea5d0040870_rle_crop_4046465440_0.png resize: (42, 69) 1396297104 0.4186085165464341 treat image : temp/1764190227_849492_1396284939_c5bf5b2ec141285b1a61fea5d0040870_rle_crop_4046465438_0.png resize: (121, 181) 1396297105 -2.532166437796996 treat image : temp/1764190227_849492_1396284939_c5bf5b2ec141285b1a61fea5d0040870_rle_crop_4046465441_0.png resize: (66, 112) 1396297106 -2.510844285455805 treat image : temp/1764190227_849492_1396284936_490825e91ff4a641ba1b22b8a5f9c586_rle_crop_4046465443_0.png resize: (188, 545) 1396297108 -1.7968109415641123 treat image : temp/1764190227_849492_1396284936_490825e91ff4a641ba1b22b8a5f9c586_rle_crop_4046465442_0.png resize: (125, 131) 1396297109 -1.8149911043474252 treat image : temp/1764190227_849492_1396284933_802ea107f4b2967486ea4769b9a67cb8_rle_crop_4046465449_0.png resize: (168, 220) 1396297111 -3.4213771875253585 treat image : temp/1764190227_849492_1396284933_802ea107f4b2967486ea4769b9a67cb8_rle_crop_4046465446_0.png resize: (55, 237) 1396297112 -1.0226326428642114 treat image : temp/1764190227_849492_1396284933_802ea107f4b2967486ea4769b9a67cb8_rle_crop_4046465444_0.png resize: (86, 126) 1396297113 0.0001987847734556726 treat image : temp/1764190227_849492_1396284933_802ea107f4b2967486ea4769b9a67cb8_rle_crop_4046465447_0.png resize: (68, 110) 1396297115 -2.6400669229733507 treat image : temp/1764190227_849492_1396284933_802ea107f4b2967486ea4769b9a67cb8_rle_crop_4046465445_0.png resize: (63, 115) 1396297116 -3.0985776015106943 treat image : temp/1764190227_849492_1396284933_802ea107f4b2967486ea4769b9a67cb8_rle_crop_4046465450_0.png resize: (47, 99) 1396297117 -1.8313472830655257 treat image : temp/1764190227_849492_1396284915_04063de9d5f5dfbffdb9b8ae977d21f8_rle_crop_4046465453_0.png resize: (107, 130) 1396297119 -4.4669339482526915 treat image : temp/1764190227_849492_1396284915_04063de9d5f5dfbffdb9b8ae977d21f8_rle_crop_4046465452_0.png resize: (63, 142) 1396297120 -3.523316094194155 treat image : temp/1764190227_849492_1396284995_8e66e73cd5eec5ea27cc2c0f0eb3be28_rle_crop_4046465414_0.png resize: (91, 95) 1396297122 -0.8553044216845154 treat image : temp/1764190227_849492_1396284992_e3d4d49bf6502c098e0928a254fe7816_rle_crop_4046465417_0.png resize: (149, 305) 1396297123 -2.332434043630973 treat image : temp/1764190227_849492_1396284945_574e46d5ac6e9b6b2fadc649db40b2f7_rle_crop_4046465431_0.png resize: (52, 63) 1396297124 1.828045484059568 treat image : temp/1764190227_849492_1396284945_574e46d5ac6e9b6b2fadc649db40b2f7_rle_crop_4046465434_0.png resize: (54, 71) 1396297125 -0.5714745077959809 treat image : temp/1764190227_849492_1396284939_c5bf5b2ec141285b1a61fea5d0040870_rle_crop_4046465439_0.png resize: (138, 142) 1396297126 -3.174521975678979 treat image : temp/1764190227_849492_1396284933_802ea107f4b2967486ea4769b9a67cb8_rle_crop_4046465448_0.png resize: (112, 83) 1396297127 -1.9491884615193924 treat image : temp/1764190227_849492_1396284915_04063de9d5f5dfbffdb9b8ae977d21f8_rle_crop_4046465454_0.png resize: (521, 307) 1396297128 0.2575622782581019 treat image : temp/1764190227_849492_1396284915_04063de9d5f5dfbffdb9b8ae977d21f8_rle_crop_4046465451_0.png resize: (303, 158) 1396297130 -0.7040606731691593 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 57 time used for this insertion : 0.017657995223999023 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 57 time used for this insertion : 0.018841266632080078 save missing photos in datou_result : time spend for datou_step_exec : 8.963669061660767 time spend to save output : 0.042745351791381836 total time spend for step 6 : 9.006414413452148 step7:brightness Wed Nov 26 21:51:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1764190227_849492_1396284995_8e66e73cd5eec5ea27cc2c0f0eb3be28.jpg treat image : temp/1764190227_849492_1396284992_e3d4d49bf6502c098e0928a254fe7816.jpg treat image : temp/1764190227_849492_1396284989_194bfedbda6a2b613e407283af64d07e.jpg treat image : temp/1764190227_849492_1396284986_68588b968e29f23685732ea16fc9681e.jpg treat image : temp/1764190227_849492_1396284947_2839b3b13b5ef4244d5f16248aba21e8.jpg treat image : temp/1764190227_849492_1396284945_574e46d5ac6e9b6b2fadc649db40b2f7.jpg treat image : temp/1764190227_849492_1396284942_299752343365c43d71eb71fffb0befe5.jpg treat image : temp/1764190227_849492_1396284939_c5bf5b2ec141285b1a61fea5d0040870.jpg treat image : temp/1764190227_849492_1396284936_490825e91ff4a641ba1b22b8a5f9c586.jpg treat image : temp/1764190227_849492_1396284933_802ea107f4b2967486ea4769b9a67cb8.jpg treat image : temp/1764190227_849492_1396284915_04063de9d5f5dfbffdb9b8ae977d21f8.jpg treat image : temp/1764190227_849492_1396284995_8e66e73cd5eec5ea27cc2c0f0eb3be28_rle_crop_4046465413_0.png treat image : temp/1764190227_849492_1396284995_8e66e73cd5eec5ea27cc2c0f0eb3be28_rle_crop_4046465409_0.png treat image : temp/1764190227_849492_1396284995_8e66e73cd5eec5ea27cc2c0f0eb3be28_rle_crop_4046465412_0.png treat image : temp/1764190227_849492_1396284995_8e66e73cd5eec5ea27cc2c0f0eb3be28_rle_crop_4046465410_0.png treat image : temp/1764190227_849492_1396284995_8e66e73cd5eec5ea27cc2c0f0eb3be28_rle_crop_4046465411_0.png treat image : temp/1764190227_849492_1396284992_e3d4d49bf6502c098e0928a254fe7816_rle_crop_4046465416_0.png treat image : temp/1764190227_849492_1396284992_e3d4d49bf6502c098e0928a254fe7816_rle_crop_4046465415_0.png treat image : temp/1764190227_849492_1396284992_e3d4d49bf6502c098e0928a254fe7816_rle_crop_4046465418_0.png treat image : temp/1764190227_849492_1396284989_194bfedbda6a2b613e407283af64d07e_rle_crop_4046465421_0.png treat image : temp/1764190227_849492_1396284989_194bfedbda6a2b613e407283af64d07e_rle_crop_4046465420_0.png treat image : temp/1764190227_849492_1396284989_194bfedbda6a2b613e407283af64d07e_rle_crop_4046465419_0.png treat image : temp/1764190227_849492_1396284989_194bfedbda6a2b613e407283af64d07e_rle_crop_4046465422_0.png treat image : temp/1764190227_849492_1396284986_68588b968e29f23685732ea16fc9681e_rle_crop_4046465423_0.png treat image : temp/1764190227_849492_1396284947_2839b3b13b5ef4244d5f16248aba21e8_rle_crop_4046465426_0.png treat image : temp/1764190227_849492_1396284947_2839b3b13b5ef4244d5f16248aba21e8_rle_crop_4046465425_0.png treat image : temp/1764190227_849492_1396284947_2839b3b13b5ef4244d5f16248aba21e8_rle_crop_4046465424_0.png treat image : temp/1764190227_849492_1396284947_2839b3b13b5ef4244d5f16248aba21e8_rle_crop_4046465427_0.png treat image : temp/1764190227_849492_1396284947_2839b3b13b5ef4244d5f16248aba21e8_rle_crop_4046465428_0.png treat image : temp/1764190227_849492_1396284945_574e46d5ac6e9b6b2fadc649db40b2f7_rle_crop_4046465435_0.png treat image : temp/1764190227_849492_1396284945_574e46d5ac6e9b6b2fadc649db40b2f7_rle_crop_4046465429_0.png treat image : temp/1764190227_849492_1396284945_574e46d5ac6e9b6b2fadc649db40b2f7_rle_crop_4046465432_0.png treat image : temp/1764190227_849492_1396284945_574e46d5ac6e9b6b2fadc649db40b2f7_rle_crop_4046465433_0.png treat image : temp/1764190227_849492_1396284945_574e46d5ac6e9b6b2fadc649db40b2f7_rle_crop_4046465430_0.png treat image : temp/1764190227_849492_1396284945_574e46d5ac6e9b6b2fadc649db40b2f7_rle_crop_4046465436_0.png treat image : temp/1764190227_849492_1396284942_299752343365c43d71eb71fffb0befe5_rle_crop_4046465437_0.png treat image : temp/1764190227_849492_1396284939_c5bf5b2ec141285b1a61fea5d0040870_rle_crop_4046465440_0.png treat image : temp/1764190227_849492_1396284939_c5bf5b2ec141285b1a61fea5d0040870_rle_crop_4046465438_0.png treat image : temp/1764190227_849492_1396284939_c5bf5b2ec141285b1a61fea5d0040870_rle_crop_4046465441_0.png treat image : temp/1764190227_849492_1396284936_490825e91ff4a641ba1b22b8a5f9c586_rle_crop_4046465443_0.png treat image : temp/1764190227_849492_1396284936_490825e91ff4a641ba1b22b8a5f9c586_rle_crop_4046465442_0.png treat image : temp/1764190227_849492_1396284933_802ea107f4b2967486ea4769b9a67cb8_rle_crop_4046465449_0.png treat image : temp/1764190227_849492_1396284933_802ea107f4b2967486ea4769b9a67cb8_rle_crop_4046465446_0.png treat image : temp/1764190227_849492_1396284933_802ea107f4b2967486ea4769b9a67cb8_rle_crop_4046465444_0.png treat image : temp/1764190227_849492_1396284933_802ea107f4b2967486ea4769b9a67cb8_rle_crop_4046465447_0.png treat image : temp/1764190227_849492_1396284933_802ea107f4b2967486ea4769b9a67cb8_rle_crop_4046465445_0.png treat image : temp/1764190227_849492_1396284933_802ea107f4b2967486ea4769b9a67cb8_rle_crop_4046465450_0.png treat image : temp/1764190227_849492_1396284915_04063de9d5f5dfbffdb9b8ae977d21f8_rle_crop_4046465453_0.png treat image : temp/1764190227_849492_1396284915_04063de9d5f5dfbffdb9b8ae977d21f8_rle_crop_4046465452_0.png treat image : temp/1764190227_849492_1396284995_8e66e73cd5eec5ea27cc2c0f0eb3be28_rle_crop_4046465414_0.png treat image : temp/1764190227_849492_1396284992_e3d4d49bf6502c098e0928a254fe7816_rle_crop_4046465417_0.png treat image : temp/1764190227_849492_1396284945_574e46d5ac6e9b6b2fadc649db40b2f7_rle_crop_4046465431_0.png treat image : temp/1764190227_849492_1396284945_574e46d5ac6e9b6b2fadc649db40b2f7_rle_crop_4046465434_0.png treat image : temp/1764190227_849492_1396284939_c5bf5b2ec141285b1a61fea5d0040870_rle_crop_4046465439_0.png treat image : temp/1764190227_849492_1396284933_802ea107f4b2967486ea4769b9a67cb8_rle_crop_4046465448_0.png treat image : temp/1764190227_849492_1396284915_04063de9d5f5dfbffdb9b8ae977d21f8_rle_crop_4046465454_0.png treat image : temp/1764190227_849492_1396284915_04063de9d5f5dfbffdb9b8ae977d21f8_rle_crop_4046465451_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 57 time used for this insertion : 0.017815828323364258 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 57 time used for this insertion : 0.018412113189697266 save missing photos in datou_result : time spend for datou_step_exec : 2.761953830718994 time spend to save output : 0.04260873794555664 total time spend for step 7 : 2.804562568664551 step8:velours_tree Wed Nov 26 21:51:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.13746309280395508 time spend to save output : 3.647804260253906e-05 total time spend for step 8 : 0.13749957084655762 step9:send_mail_cod Wed Nov 26 21:51:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P28934472_26-11-2025_21_51_30.pdf 28936839 imagette289368391764190290 28936840 imagette289368401764190290 28936841 imagette289368411764190290 28936842 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette289368421764190290 28936843 change filename to text .imagette289368431764190291 28936844 imagette289368441764190291 28936845 imagette289368451764190291 28936846 imagette289368461764190291 28936848 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette289368481764190291 28936849 imagette289368491764190292 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=28934472 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/28936839,28936840,28936841,28936842,28936843,28936844,28936845,28936846,28936847,28936848,28936849?tags=mal_croppe,flou,pehd,pet_clair,autre,metal,pet_fonce,background,environnement,papier,carton args[1396284995] : ((1396284995, -2.8750081086508996, 492609224), (1396284995, 0.5169489218799245, 2107752395), '0.02927955773007856') We are sending mail with results at report@fotonower.com args[1396284992] : ((1396284992, 2.0663318656019065, 492688767), (1396284992, 0.4317540060729174, 2107752395), '0.02927955773007856') We are sending mail with results at report@fotonower.com args[1396284989] : ((1396284989, -3.9636443628545717, 492609224), (1396284989, 0.4365847435351676, 2107752395), '0.02927955773007856') We are sending mail with results at report@fotonower.com args[1396284986] : ((1396284986, 1.2068327628756637, 492688767), (1396284986, 0.6180366916366812, 2107752395), '0.02927955773007856') We are sending mail with results at report@fotonower.com args[1396284947] : ((1396284947, -0.9591557279114789, 492688767), (1396284947, 0.6662712427783765, 2107752395), '0.02927955773007856') We are sending mail with results at report@fotonower.com args[1396284945] : ((1396284945, -0.30054736589124786, 492688767), (1396284945, 0.46650621882821786, 2107752395), '0.02927955773007856') We are sending mail with results at report@fotonower.com args[1396284942] : ((1396284942, 0.8129389683518335, 492688767), (1396284942, 0.7756470741497317, 2107752395), '0.02927955773007856') We are sending mail with results at report@fotonower.com args[1396284939] : ((1396284939, -3.5129588000648706, 492609224), (1396284939, 0.5242017400885586, 2107752395), '0.02927955773007856') We are sending mail with results at report@fotonower.com args[1396284936] : ((1396284936, -0.14871073416732766, 492688767), (1396284936, 0.4080893300514741, 2107752395), '0.02927955773007856') We are sending mail with results at report@fotonower.com args[1396284933] : ((1396284933, -2.0909732432240378, 492609224), (1396284933, 0.9342596939642746, 2107752395), '0.02927955773007856') We are sending mail with results at report@fotonower.com args[1396284915] : ((1396284915, -3.887906927881363, 492609224), (1396284915, 0.47714054577960746, 2107752395), '0.02927955773007856') We are sending mail with results at report@fotonower.com refus_total : 0.02927955773007856 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=28934472 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28934472_26-11-2025_21_51_30.pdf results_Auto_P28934472_26-11-2025_21_51_30.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28934472_26-11-2025_21_51_30.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','28934472','results_Auto_P28934472_26-11-2025_21_51_30.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28934472_26-11-2025_21_51_30.pdf','pdf','','0.17','0.02927955773007856') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/28934472

https://www.fotonower.com/image?json=false&list_photos_id=1396284995
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396284992
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.0663318656019065)
https://www.fotonower.com/image?json=false&list_photos_id=1396284989
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396284986
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.2068327628756637)
https://www.fotonower.com/image?json=false&list_photos_id=1396284947
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396284945
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396284942
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396284939
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396284936
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396284933
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396284915
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 2.93%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/28936842?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/28936843?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/28936848?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28934472_26-11-2025_21_51_30.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/28936839,28936840,28936841,28936842,28936843,28936844,28936845,28936846,28936847,28936848,28936849?tags=mal_croppe,flou,pehd,pet_clair,autre,metal,pet_fonce,background,environnement,papier,carton.


L'équipe Fotonower HTTP Error 401: Unauthorized Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1396284995, 1396284992, 1396284989, 1396284986, 1396284947, 1396284945, 1396284942, 1396284939, 1396284936, 1396284933, 1396284915] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284995', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284992', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284989', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284986', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284947', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284945', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284942', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284939', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284936', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284933', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284915', None, None, None, None, None, '4123656') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.01885056495666504 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.5811681747436523 time spend to save output : 0.01913762092590332 total time spend for step 9 : 3.6003057956695557 step10:split_time_score Wed Nov 26 21:51:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('19', 11),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 26112025 28934472 Nombre de photos uploadées : 11 / 23040 (0%) 26112025 28934472 Nombre de photos taguées (types de déchets): 0 / 11 (0%) 26112025 28934472 Nombre de photos taguées (volume) : 0 / 11 (0%) elapsed_time : load_data_split_time_score 3.337860107421875e-06 elapsed_time : order_list_meta_photo_and_scores 9.775161743164062e-06 ??????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005521774291992188 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.25153613090515137 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.18009831934799386 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28921345_26-11-2025_13_11_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28921345 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28921345 AND mptpi.`type`=3594 To do Qualite : 0.06561518270502646 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28913886_26-11-2025_08_41_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28913886 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28913886 AND mptpi.`type`=3594 To do Qualite : 0.14504273967978396 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28915454_26-11-2025_10_01_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28915454 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28915454 AND mptpi.`type`=3594 To do Qualite : 0.10683708285108026 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28915457_26-11-2025_09_51_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28915457 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28915457 AND mptpi.`type`=3594 To do Qualite : 0.057158625096450644 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28915459_26-11-2025_10_42_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28915459 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28915459 AND mptpi.`type`=3594 To do Qualite : 0.04208984375 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28921350_26-11-2025_14_11_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28921350 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28921350 AND mptpi.`type`=3594 To do Qualite : 0.01618742766203704 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28921359_26-11-2025_12_51_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28921359 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28921359 AND mptpi.`type`=3594 To do Qualite : 0.027386911651234573 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28921363_26-11-2025_12_41_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28921363 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28921363 AND mptpi.`type`=3594 To do Qualite : 0.13498797582304528 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28927314_26-11-2025_17_22_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28927314 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28927314 AND mptpi.`type`=3594 To do Qualite : 0.057353766025641024 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28927317_26-11-2025_17_11_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28927317 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28927317 AND mptpi.`type`=3594 To do Qualite : 0.1716116898148148 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28929044_26-11-2025_18_11_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28929044 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28929044 AND mptpi.`type`=3594 To do Qualite : 0.04573701533564814 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28933104_26-11-2025_21_01_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28933104 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28933104 AND mptpi.`type`=3594 To do Qualite : 0.012602857694003527 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28933106_26-11-2025_20_21_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28933106 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28933106 AND mptpi.`type`=3594 To do Qualite : 0.04342084619341564 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28933110_26-11-2025_20_11_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28933110 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28933110 AND mptpi.`type`=3594 To do Qualite : 0.02927955773007856 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28934472_26-11-2025_21_51_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28934472 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28934472 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'26112025': {'nb_upload': 11, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1396284995, 1396284992, 1396284989, 1396284986, 1396284947, 1396284945, 1396284942, 1396284939, 1396284936, 1396284933, 1396284915] Looping around the photos to save general results len do output : 1 /28934472Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284995', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284992', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284989', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284986', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284947', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284945', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284942', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284939', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284936', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284933', None, None, None, None, None, '4123656') ('3318', None, None, None, None, None, None, None, '4123656') ('3318', '28934472', '1396284915', None, None, None, None, None, '4123656') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.019097089767456055 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.550910472869873 time spend to save output : 0.019301652908325195 total time spend for step 10 : 1.5702121257781982 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 11 set_done_treatment 34.49user 17.92system 1:11.53elapsed 73%CPU (0avgtext+0avgdata 2821132maxresident)k 425056inputs+13632outputs (45major+1564031minor)pagefaults 0swaps