python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 401214 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4121970'] with mtr_portfolio_ids : ['28927317'] and first list_photo_ids : [] new path : /proc/401214/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 13 ; length of list_pids : 13 ; length of list_args : 13 time to download the photos : 2.261223554611206 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Nov 26 17:10:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-11-26 17:10:34.471730: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-11-26 17:10:34.498423: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-11-26 17:10:34.500442: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fdf64000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-11-26 17:10:34.500490: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-11-26 17:10:34.504012: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-11-26 17:10:34.821922: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x9be4ec0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-11-26 17:10:34.821957: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-11-26 17:10:34.823237: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-26 17:10:34.823630: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-26 17:10:34.826930: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-26 17:10:34.831356: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-26 17:10:34.831669: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-26 17:10:34.836393: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-26 17:10:34.837844: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-26 17:10:34.848237: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-26 17:10:34.850170: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-26 17:10:34.850248: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-26 17:10:34.851216: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-26 17:10:34.851237: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-26 17:10:34.851247: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-26 17:10:34.853042: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-11-26 17:10:35.118006: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-26 17:10:35.118107: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-26 17:10:35.118129: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-26 17:10:35.118149: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-26 17:10:35.118167: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-26 17:10:35.118186: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-26 17:10:35.118203: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-26 17:10:35.118222: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-26 17:10:35.119741: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-26 17:10:35.120976: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-26 17:10:35.121028: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-26 17:10:35.121045: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-26 17:10:35.121059: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-26 17:10:35.121073: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-26 17:10:35.121087: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-26 17:10:35.121101: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-26 17:10:35.121116: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-26 17:10:35.122377: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-26 17:10:35.122413: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-26 17:10:35.122422: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-26 17:10:35.122430: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-26 17:10:35.123800: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-11-26 17:10:43.080813: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-26 17:10:43.257858: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 13 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 12.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 35.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 Detection mask done ! Trying to reset tf kernel 401864 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5706 tf kernel not reseted sub process len(results) : 13 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 13 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10998 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [876, 600, 1014, 681] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.000209808349609375 nb_pixel_total : 8361 time to create 1 rle with old method : 0.00956273078918457 length of segment : 129 DEBUG bbox = [885, 504, 1002, 579] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0001220703125 nb_pixel_total : 6152 time to create 1 rle with old method : 0.006685495376586914 length of segment : 114 DEBUG bbox = [0, 0, 1080, 1056] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.02597784996032715 nb_pixel_total : 735172 time to create 1 rle with new method : 0.4916555881500244 length of segment : 1004 DEBUG bbox = [1014, 1098, 1074, 1167] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 2450 time to create 1 rle with old method : 0.002977609634399414 length of segment : 54 DEBUG bbox = [840, 729, 1047, 942] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00037598609924316406 nb_pixel_total : 22608 time to create 1 rle with old method : 0.023695707321166992 length of segment : 222 DEBUG bbox = [867, 588, 1011, 663] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00013303756713867188 nb_pixel_total : 7443 time to create 1 rle with old method : 0.007888078689575195 length of segment : 137 DEBUG bbox = [930, 1080, 996, 1155] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 2833 time to create 1 rle with old method : 0.003100872039794922 length of segment : 68 DEBUG bbox = [807, 1533, 942, 1620] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00012969970703125 nb_pixel_total : 7273 time to create 1 rle with old method : 0.007926702499389648 length of segment : 125 DEBUG bbox = [816, 1125, 990, 1260] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0002067089080810547 nb_pixel_total : 13319 time to create 1 rle with old method : 0.014855623245239258 length of segment : 167 DEBUG bbox = [852, 738, 1014, 915] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00027060508728027344 nb_pixel_total : 19524 time to create 1 rle with old method : 0.021674156188964844 length of segment : 180 DEBUG bbox = [918, 654, 993, 732] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 7.987022399902344e-05 nb_pixel_total : 3533 time to create 1 rle with old method : 0.003900289535522461 length of segment : 63 DEBUG bbox = [717, 756, 822, 852] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00012159347534179688 nb_pixel_total : 5550 time to create 1 rle with old method : 0.006161928176879883 length of segment : 90 DEBUG bbox = [1008, 1098, 1074, 1266] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00011968612670898438 nb_pixel_total : 7166 time to create 1 rle with old method : 0.008097171783447266 length of segment : 66 DEBUG bbox = [204, 1014, 354, 1128] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00016450881958007812 nb_pixel_total : 10932 time to create 1 rle with old method : 0.011672496795654297 length of segment : 149 DEBUG bbox = [972, 975, 1071, 1101] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0001342296600341797 nb_pixel_total : 9274 time to create 1 rle with old method : 0.009961843490600586 length of segment : 113 DEBUG bbox = [0, 1287, 69, 1347] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 2945 time to create 1 rle with old method : 0.00319671630859375 length of segment : 62 DEBUG bbox = [1032, 225, 1077, 318] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 2616 time to create 1 rle with old method : 0.004481077194213867 length of segment : 45 DEBUG bbox = [714, 1056, 849, 1236] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00032639503479003906 nb_pixel_total : 21090 time to create 1 rle with old method : 0.03449392318725586 length of segment : 131 DEBUG bbox = [987, 891, 1074, 1080] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00019025802612304688 nb_pixel_total : 8285 time to create 1 rle with old method : 0.013358592987060547 length of segment : 77 DEBUG bbox = [909, 369, 1065, 474] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00015306472778320312 nb_pixel_total : 7651 time to create 1 rle with old method : 0.00817108154296875 length of segment : 125 DEBUG bbox = [816, 468, 981, 732] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0002968311309814453 nb_pixel_total : 19419 time to create 1 rle with old method : 0.023866653442382812 length of segment : 149 DEBUG bbox = [792, 774, 957, 1020] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0003199577331542969 nb_pixel_total : 22613 time to create 1 rle with old method : 0.02459263801574707 length of segment : 164 DEBUG bbox = [975, 540, 1071, 648] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00010824203491210938 nb_pixel_total : 5713 time to create 1 rle with old method : 0.006635427474975586 length of segment : 83 DEBUG bbox = [924, 1245, 1077, 1464] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00022101402282714844 nb_pixel_total : 9053 time to create 1 rle with old method : 0.010241508483886719 length of segment : 140 DEBUG bbox = [438, 1800, 543, 1902] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00010919570922851562 nb_pixel_total : 4658 time to create 1 rle with old method : 0.005166769027709961 length of segment : 110 DEBUG bbox = [768, 1008, 939, 1386] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0004763603210449219 nb_pixel_total : 23452 time to create 1 rle with old method : 0.025246620178222656 length of segment : 130 DEBUG bbox = [801, 555, 936, 732] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00021457672119140625 nb_pixel_total : 15455 time to create 1 rle with old method : 0.01723647117614746 length of segment : 128 DEBUG bbox = [939, 795, 1074, 1080] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0003609657287597656 nb_pixel_total : 26880 time to create 1 rle with old method : 0.03026127815246582 length of segment : 151 DEBUG bbox = [954, 297, 1071, 453] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00028777122497558594 nb_pixel_total : 12074 time to create 1 rle with old method : 0.013627290725708008 length of segment : 167 DEBUG bbox = [579, 1545, 1080, 1899] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0017480850219726562 nb_pixel_total : 78788 time to create 1 rle with old method : 0.08320283889770508 length of segment : 431 DEBUG bbox = [69, 975, 183, 1074] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00027632713317871094 nb_pixel_total : 9067 time to create 1 rle with old method : 0.009864091873168945 length of segment : 114 DEBUG bbox = [945, 294, 1080, 615] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0004894733428955078 nb_pixel_total : 22264 time to create 1 rle with old method : 0.024759769439697266 length of segment : 134 DEBUG bbox = [861, 1533, 1014, 1665] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00035643577575683594 nb_pixel_total : 6618 time to create 1 rle with old method : 0.007401227951049805 length of segment : 117 DEBUG bbox = [537, 1602, 1059, 1896] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0017590522766113281 nb_pixel_total : 103360 time to create 1 rle with old method : 0.11086320877075195 length of segment : 518 DEBUG bbox = [651, 945, 708, 1119] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00011491775512695312 nb_pixel_total : 5044 time to create 1 rle with old method : 0.005961894989013672 length of segment : 45 DEBUG bbox = [456, 891, 534, 1038] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00012683868408203125 nb_pixel_total : 6486 time to create 1 rle with old method : 0.007796049118041992 length of segment : 73 DEBUG bbox = [462, 1542, 1062, 1884] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0014791488647460938 nb_pixel_total : 103216 time to create 1 rle with old method : 0.11313629150390625 length of segment : 523 DEBUG bbox = [816, 1245, 870, 1365] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 9.179115295410156e-05 nb_pixel_total : 2883 time to create 1 rle with old method : 0.0035653114318847656 length of segment : 46 DEBUG bbox = [975, 903, 1068, 1080] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00016021728515625 nb_pixel_total : 8549 time to create 1 rle with old method : 0.009829044342041016 length of segment : 125 DEBUG bbox = [933, 237, 1074, 351] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0001747608184814453 nb_pixel_total : 9310 time to create 1 rle with old method : 0.010451316833496094 length of segment : 128 DEBUG bbox = [210, 1251, 414, 1404] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0002167224884033203 nb_pixel_total : 2852 time to create 1 rle with old method : 0.003369569778442383 length of segment : 93 DEBUG bbox = [957, 363, 1071, 597] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00022983551025390625 nb_pixel_total : 18662 time to create 1 rle with old method : 0.020678043365478516 length of segment : 108 DEBUG bbox = [282, 1080, 405, 1191] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00015807151794433594 nb_pixel_total : 7842 time to create 1 rle with old method : 0.008849143981933594 length of segment : 101 DEBUG bbox = [537, 1494, 642, 1629] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0003247261047363281 nb_pixel_total : 9650 time to create 1 rle with old method : 0.011127710342407227 length of segment : 95 DEBUG bbox = [708, 543, 813, 759] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0003898143768310547 nb_pixel_total : 11660 time to create 1 rle with old method : 0.013856887817382812 length of segment : 119 DEBUG bbox = [861, 504, 1050, 828] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0008552074432373047 nb_pixel_total : 26757 time to create 1 rle with old method : 0.030589818954467773 length of segment : 188 DEBUG bbox = [981, 546, 1077, 789] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0002281665802001953 nb_pixel_total : 8297 time to create 1 rle with old method : 0.009677410125732422 length of segment : 84 DEBUG bbox = [861, 255, 1059, 504] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0005743503570556641 nb_pixel_total : 28774 time to create 1 rle with old method : 0.03153395652770996 length of segment : 243 DEBUG bbox = [1008, 726, 1080, 837] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00011205673217773438 nb_pixel_total : 5437 time to create 1 rle with old method : 0.006207704544067383 length of segment : 68 DEBUG bbox = [969, 951, 1071, 1080] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0002601146697998047 nb_pixel_total : 10203 time to create 1 rle with old method : 0.011559724807739258 length of segment : 102 DEBUG bbox = [663, 1164, 825, 1272] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0003490447998046875 nb_pixel_total : 10228 time to create 1 rle with old method : 0.011292457580566406 length of segment : 153 DEBUG bbox = [369, 1089, 453, 1236] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00022172927856445312 nb_pixel_total : 7127 time to create 1 rle with old method : 0.008367300033569336 length of segment : 74 time spent for convertir_results : 2.794890880584717 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 52 chid ids of type : 3594 Number RLEs to save : 8025 save missing photos in datou_result : time spend for datou_step_exec : 27.828861951828003 time spend to save output : 0.5913252830505371 total time spend for step 1 : 28.42018723487854 step2:crop_condition Wed Nov 26 17:11:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 13 ! batch 1 Loaded 52 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 32 About to insert : list_path_to_insert length 32 new photo from crops ! About to upload 32 photos upload in portfolio : 3736932 init cache_photo without model_param we have 32 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764173462_401214 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262332_2bd7b4a5a6fccbae84cb417c72f4fbdc_rle_crop_4046253641_0.png', 0, 76, 126, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262332_2bd7b4a5a6fccbae84cb417c72f4fbdc_rle_crop_4046253642_0.png', 0, 67, 114, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262332_2bd7b4a5a6fccbae84cb417c72f4fbdc_rle_crop_4046253644_0.png', 0, 65, 54, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262324_690087f83f79c6e0296df51904c02260_rle_crop_4046253646_0.png', 0, 72, 136, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262324_690087f83f79c6e0296df51904c02260_rle_crop_4046253647_0.png', 0, 65, 66, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262324_690087f83f79c6e0296df51904c02260_rle_crop_4046253649_0.png', 0, 116, 167, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262324_690087f83f79c6e0296df51904c02260_rle_crop_4046253651_0.png', 0, 74, 60, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262324_690087f83f79c6e0296df51904c02260_rle_crop_4046253652_0.png', 0, 92, 90, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262324_690087f83f79c6e0296df51904c02260_rle_crop_4046253653_0.png', 0, 161, 60, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262321_afdb6fc8723adb363df70c93e1a69938_rle_crop_4046253654_0.png', 0, 110, 149, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262321_afdb6fc8723adb363df70c93e1a69938_rle_crop_4046253655_0.png', 0, 124, 98, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262318_973ca8646c872fedd0eff6f284909276_rle_crop_4046253659_0.png', 0, 156, 77, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262317_cb6ebeab3636e815e399e6ed1875300e_rle_crop_4046253660_0.png', 0, 80, 124, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262317_cb6ebeab3636e815e399e6ed1875300e_rle_crop_4046253661_0.png', 0, 246, 141, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262300_3a1bad2304f0d9919d8edfeca6ba5718_rle_crop_4046253662_0.png', 0, 231, 136, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262300_3a1bad2304f0d9919d8edfeca6ba5718_rle_crop_4046253663_0.png', 0, 99, 83, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262300_3a1bad2304f0d9919d8edfeca6ba5718_rle_crop_4046253664_0.png', 0, 205, 140, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262300_3a1bad2304f0d9919d8edfeca6ba5718_rle_crop_4046253667_0.png', 0, 171, 120, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262298_d9be73caa378a61d7b80f3607c835273_rle_crop_4046253669_0.png', 0, 151, 112, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262296_821fab1eb17c28690d7bbd626ea05dce_rle_crop_4046253673_0.png', 0, 113, 117, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262290_894814c1d8e0e69f6c4d42bc225ea82c_rle_crop_4046253675_0.png', 0, 139, 45, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262290_894814c1d8e0e69f6c4d42bc225ea82c_rle_crop_4046253676_0.png', 0, 137, 71, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262290_894814c1d8e0e69f6c4d42bc225ea82c_rle_crop_4046253678_0.png', 0, 99, 46, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262290_894814c1d8e0e69f6c4d42bc225ea82c_rle_crop_4046253679_0.png', 0, 173, 88, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262290_894814c1d8e0e69f6c4d42bc225ea82c_rle_crop_4046253681_0.png', 0, 98, 151, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262287_a5a0ba7f9ee11b0042bb037c9ddb0f56_rle_crop_4046253685_0.png', 0, 213, 94, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262287_a5a0ba7f9ee11b0042bb037c9ddb0f56_rle_crop_4046253686_0.png', 0, 292, 168, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262287_a5a0ba7f9ee11b0042bb037c9ddb0f56_rle_crop_4046253687_0.png', 0, 165, 84, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262287_a5a0ba7f9ee11b0042bb037c9ddb0f56_rle_crop_4046253688_0.png', 0, 232, 190, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262287_a5a0ba7f9ee11b0042bb037c9ddb0f56_rle_crop_4046253689_0.png', 0, 105, 68, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262265_fdcce414a103b38f3931deeb8857fe16_rle_crop_4046253690_0.png', 0, 127, 102, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173469), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262262_46f068a07f537242bcd03ebe0ec6c6e2_rle_crop_4046253692_0.png', 0, 141, 74, 0, 1764173469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 32 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.950661420822144 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764173471_401214 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173472), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262300_3a1bad2304f0d9919d8edfeca6ba5718_rle_crop_4046253665_0.png', 0, 100, 79, 0, 1764173472,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173472), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262287_a5a0ba7f9ee11b0042bb037c9ddb0f56_rle_crop_4046253683_0.png', 0, 99, 95, 0, 1764173472,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173472), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262287_a5a0ba7f9ee11b0042bb037c9ddb0f56_rle_crop_4046253684_0.png', 0, 121, 95, 0, 1764173472,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8803422451019287 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764173472_401214 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173473), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262321_afdb6fc8723adb363df70c93e1a69938_rle_crop_4046253657_0.png', 0, 81, 44, 0, 1764173473,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6886322498321533 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 3736932 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764173478_401214 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173480), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262332_2bd7b4a5a6fccbae84cb417c72f4fbdc_rle_crop_4046253643_0.png', 0, 996, 1002, 0, 1764173480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173480), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262332_2bd7b4a5a6fccbae84cb417c72f4fbdc_rle_crop_4046253645_0.png', 0, 204, 184, 0, 1764173480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173480), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262324_690087f83f79c6e0296df51904c02260_rle_crop_4046253648_0.png', 0, 83, 121, 0, 1764173480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173480), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262324_690087f83f79c6e0296df51904c02260_rle_crop_4046253650_0.png', 0, 176, 160, 0, 1764173480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173480), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262321_afdb6fc8723adb363df70c93e1a69938_rle_crop_4046253656_0.png', 0, 57, 62, 0, 1764173480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173480), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262300_3a1bad2304f0d9919d8edfeca6ba5718_rle_crop_4046253666_0.png', 0, 330, 129, 0, 1764173480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173480), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262300_3a1bad2304f0d9919d8edfeca6ba5718_rle_crop_4046253668_0.png', 0, 277, 130, 0, 1764173480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173480), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262298_d9be73caa378a61d7b80f3607c835273_rle_crop_4046253670_0.png', 0, 329, 425, 0, 1764173480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173480), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262296_821fab1eb17c28690d7bbd626ea05dce_rle_crop_4046253672_0.png', 0, 314, 129, 0, 1764173480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173480), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262296_821fab1eb17c28690d7bbd626ea05dce_rle_crop_4046253674_0.png', 0, 278, 517, 0, 1764173480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173480), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262290_894814c1d8e0e69f6c4d42bc225ea82c_rle_crop_4046253677_0.png', 0, 322, 521, 0, 1764173480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173480), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262290_894814c1d8e0e69f6c4d42bc225ea82c_rle_crop_4046253680_0.png', 0, 90, 126, 0, 1764173480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173480), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262290_894814c1d8e0e69f6c4d42bc225ea82c_rle_crop_4046253682_0.png', 0, 216, 104, 0, 1764173480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173480), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262265_fdcce414a103b38f3931deeb8857fe16_rle_crop_4046253691_0.png', 0, 85, 153, 0, 1764173480,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 14 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.4508283138275146 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1764173482_401214 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173482), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262321_afdb6fc8723adb363df70c93e1a69938_rle_crop_4046253658_0.png', 0, 178, 131, 0, 1764173482,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1764173482), 0.0, 0.0, 14, '', 0, 0, '1764173429_401214_1396262298_d9be73caa378a61d7b80f3607c835273_rle_crop_4046253671_0.png', 0, 97, 114, 0, 1764173482,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8048129081726074 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1396262332, 1396262324, 1396262321, 1396262318, 1396262317, 1396262300, 1396262298, 1396262296, 1396262294, 1396262290, 1396262287, 1396262265, 1396262262] Looping around the photos to save general results len do output : 52 /1396267250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1396267305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262332', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262324', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262321', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262318', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262317', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262300', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262298', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262296', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262294', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262290', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262287', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262265', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262262', None, None, None, None, None, '4121970') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 169 time used for this insertion : 0.03844571113586426 save_final save missing photos in datou_result : time spend for datou_step_exec : 22.67815375328064 time spend to save output : 0.040650129318237305 total time spend for step 2 : 22.718803882598877 step3:rle_unique_nms_with_priority Wed Nov 26 17:11:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 52 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 5 nb_hashtags : 2 time to prepare the origin masks : 1.31876802444458 time for calcul the mask position with numpy : 0.10075116157531738 nb_pixel_total : 1298857 time to create 1 rle with new method : 0.07883930206298828 time for calcul the mask position with numpy : 0.00657343864440918 nb_pixel_total : 22608 time to create 1 rle with old method : 0.026692628860473633 time for calcul the mask position with numpy : 0.0072290897369384766 nb_pixel_total : 2450 time to create 1 rle with old method : 0.004015207290649414 time for calcul the mask position with numpy : 0.2802450656890869 nb_pixel_total : 735172 time to create 1 rle with new method : 0.29468750953674316 time for calcul the mask position with numpy : 0.006618499755859375 nb_pixel_total : 6152 time to create 1 rle with old method : 0.006582498550415039 time for calcul the mask position with numpy : 0.006199359893798828 nb_pixel_total : 8361 time to create 1 rle with old method : 0.009276390075683594 create new chi : 0.8451929092407227 time to delete rle : 0.027312517166137695 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 4126 TO DO : save crop sub photo not yet done ! save time : 0.3200407028198242 nb_obj : 8 nb_hashtags : 2 time to prepare the origin masks : 0.5356366634368896 time for calcul the mask position with numpy : 0.05864715576171875 nb_pixel_total : 2006959 time to create 1 rle with new method : 0.2694730758666992 time for calcul the mask position with numpy : 0.006104707717895508 nb_pixel_total : 7166 time to create 1 rle with old method : 0.007723569869995117 time for calcul the mask position with numpy : 0.005948781967163086 nb_pixel_total : 5550 time to create 1 rle with old method : 0.0058591365814208984 time for calcul the mask position with numpy : 0.0057489871978759766 nb_pixel_total : 3533 time to create 1 rle with old method : 0.004002571105957031 time for calcul the mask position with numpy : 0.005904674530029297 nb_pixel_total : 19524 time to create 1 rle with old method : 0.02086806297302246 time for calcul the mask position with numpy : 0.005770683288574219 nb_pixel_total : 13319 time to create 1 rle with old method : 0.01429295539855957 time for calcul the mask position with numpy : 0.006292819976806641 nb_pixel_total : 7273 time to create 1 rle with old method : 0.00801706314086914 time for calcul the mask position with numpy : 0.00635218620300293 nb_pixel_total : 2833 time to create 1 rle with old method : 0.0033919811248779297 time for calcul the mask position with numpy : 0.006330966949462891 nb_pixel_total : 7443 time to create 1 rle with old method : 0.007775068283081055 create new chi : 0.4580118656158447 time to delete rle : 0.0004417896270751953 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 2872 TO DO : save crop sub photo not yet done ! save time : 0.2408144474029541 nb_obj : 5 nb_hashtags : 4 time to prepare the origin masks : 0.06992387771606445 time for calcul the mask position with numpy : 0.16456341743469238 nb_pixel_total : 2026743 time to create 1 rle with new method : 0.07864642143249512 time for calcul the mask position with numpy : 0.006063938140869141 nb_pixel_total : 21090 time to create 1 rle with old method : 0.02316451072692871 time for calcul the mask position with numpy : 0.007523536682128906 nb_pixel_total : 2616 time to create 1 rle with old method : 0.004446506500244141 time for calcul the mask position with numpy : 0.006943941116333008 nb_pixel_total : 2945 time to create 1 rle with old method : 0.003437519073486328 time for calcul the mask position with numpy : 0.006414651870727539 nb_pixel_total : 9274 time to create 1 rle with old method : 0.01076054573059082 time for calcul the mask position with numpy : 0.006112575531005859 nb_pixel_total : 10932 time to create 1 rle with old method : 0.012369394302368164 create new chi : 0.34116196632385254 time to delete rle : 0.00031304359436035156 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 2080 TO DO : save crop sub photo not yet done ! save time : 0.1990830898284912 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.04129838943481445 time for calcul the mask position with numpy : 0.04812264442443848 nb_pixel_total : 2065315 time to create 1 rle with new method : 0.0359041690826416 time for calcul the mask position with numpy : 0.006212472915649414 nb_pixel_total : 8285 time to create 1 rle with old method : 0.009443283081054688 create new chi : 0.09993505477905273 time to delete rle : 0.00023317337036132812 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1234 TO DO : save crop sub photo not yet done ! save time : 0.13191938400268555 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.05517840385437012 time for calcul the mask position with numpy : 0.021648406982421875 nb_pixel_total : 2046530 time to create 1 rle with new method : 0.17496967315673828 time for calcul the mask position with numpy : 0.006028890609741211 nb_pixel_total : 19419 time to create 1 rle with old method : 0.021204471588134766 time for calcul the mask position with numpy : 0.006216287612915039 nb_pixel_total : 7651 time to create 1 rle with old method : 0.008500814437866211 create new chi : 0.24867868423461914 time to delete rle : 0.0002799034118652344 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1628 TO DO : save crop sub photo not yet done ! save time : 0.16835451126098633 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 0.38088083267211914 time for calcul the mask position with numpy : 0.15719866752624512 nb_pixel_total : 1965776 time to create 1 rle with new method : 0.08813333511352539 time for calcul the mask position with numpy : 0.006487846374511719 nb_pixel_total : 26880 time to create 1 rle with old method : 0.029674291610717773 time for calcul the mask position with numpy : 0.006125926971435547 nb_pixel_total : 15455 time to create 1 rle with old method : 0.017676115036010742 time for calcul the mask position with numpy : 0.006215095520019531 nb_pixel_total : 23452 time to create 1 rle with old method : 0.025676488876342773 time for calcul the mask position with numpy : 0.006218910217285156 nb_pixel_total : 4658 time to create 1 rle with old method : 0.0052945613861083984 time for calcul the mask position with numpy : 0.006310701370239258 nb_pixel_total : 9053 time to create 1 rle with old method : 0.009953498840332031 time for calcul the mask position with numpy : 0.005914449691772461 nb_pixel_total : 5713 time to create 1 rle with old method : 0.006488323211669922 time for calcul the mask position with numpy : 0.006264209747314453 nb_pixel_total : 22613 time to create 1 rle with old method : 0.02914142608642578 create new chi : 0.42285847663879395 time to delete rle : 0.00048732757568359375 batch 1 Loaded 15 chid ids of type : 3594 +++++++++++Number RLEs to save : 2892 TO DO : save crop sub photo not yet done ! save time : 0.24181509017944336 nb_obj : 3 nb_hashtags : 3 time to prepare the origin masks : 0.04929327964782715 time for calcul the mask position with numpy : 0.018262147903442383 nb_pixel_total : 1973671 time to create 1 rle with new method : 0.2274494171142578 time for calcul the mask position with numpy : 0.0065517425537109375 nb_pixel_total : 9067 time to create 1 rle with old method : 0.01057577133178711 time for calcul the mask position with numpy : 0.0075435638427734375 nb_pixel_total : 78788 time to create 1 rle with old method : 0.08771562576293945 time for calcul the mask position with numpy : 0.006117820739746094 nb_pixel_total : 12074 time to create 1 rle with old method : 0.01302480697631836 create new chi : 0.377704381942749 time to delete rle : 0.00038433074951171875 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 2504 TO DO : save crop sub photo not yet done ! save time : 0.2228999137878418 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.0620265007019043 time for calcul the mask position with numpy : 0.019138097763061523 nb_pixel_total : 1941790 time to create 1 rle with new method : 0.0836479663848877 time for calcul the mask position with numpy : 0.00690913200378418 nb_pixel_total : 102928 time to create 1 rle with old method : 0.11514520645141602 time for calcul the mask position with numpy : 0.0061872005462646484 nb_pixel_total : 6618 time to create 1 rle with old method : 0.0074923038482666016 time for calcul the mask position with numpy : 0.006722927093505859 nb_pixel_total : 22264 time to create 1 rle with old method : 0.02515244483947754 create new chi : 0.2708759307861328 time to delete rle : 0.0004911422729492188 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2566 TO DO : save crop sub photo not yet done ! save time : 0.23270845413208008 No data in photo_id : 1396262294 nb_obj : 8 nb_hashtags : 2 time to prepare the origin masks : 0.3566560745239258 time for calcul the mask position with numpy : 0.13673830032348633 nb_pixel_total : 1916598 time to create 1 rle with new method : 0.10065650939941406 time for calcul the mask position with numpy : 0.006699800491333008 nb_pixel_total : 18662 time to create 1 rle with old method : 0.029845237731933594 time for calcul the mask position with numpy : 0.006685495376586914 nb_pixel_total : 2852 time to create 1 rle with old method : 0.004692792892456055 time for calcul the mask position with numpy : 0.006480216979980469 nb_pixel_total : 9310 time to create 1 rle with old method : 0.015115737915039062 time for calcul the mask position with numpy : 0.006844282150268555 nb_pixel_total : 8549 time to create 1 rle with old method : 0.01017451286315918 time for calcul the mask position with numpy : 0.006024360656738281 nb_pixel_total : 2883 time to create 1 rle with old method : 0.003375530242919922 time for calcul the mask position with numpy : 0.00630497932434082 nb_pixel_total : 103216 time to create 1 rle with old method : 0.11043000221252441 time for calcul the mask position with numpy : 0.00615692138671875 nb_pixel_total : 6486 time to create 1 rle with old method : 0.006975889205932617 time for calcul the mask position with numpy : 0.00594329833984375 nb_pixel_total : 5044 time to create 1 rle with old method : 0.005376100540161133 create new chi : 0.4862821102142334 time to delete rle : 0.0005009174346923828 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++Number RLEs to save : 3362 TO DO : save crop sub photo not yet done ! save time : 0.27490663528442383 nb_obj : 7 nb_hashtags : 2 time to prepare the origin masks : 0.09265303611755371 time for calcul the mask position with numpy : 0.15311050415039062 nb_pixel_total : 1975245 time to create 1 rle with new method : 0.07457423210144043 time for calcul the mask position with numpy : 0.005931377410888672 nb_pixel_total : 5389 time to create 1 rle with old method : 0.005875825881958008 time for calcul the mask position with numpy : 0.005846738815307617 nb_pixel_total : 28774 time to create 1 rle with old method : 0.03142499923706055 time for calcul the mask position with numpy : 0.006435394287109375 nb_pixel_total : 8283 time to create 1 rle with old method : 0.008976936340332031 time for calcul the mask position with numpy : 0.00631260871887207 nb_pixel_total : 26757 time to create 1 rle with old method : 0.028630733489990234 time for calcul the mask position with numpy : 0.006145954132080078 nb_pixel_total : 11660 time to create 1 rle with old method : 0.013203859329223633 time for calcul the mask position with numpy : 0.0064296722412109375 nb_pixel_total : 9650 time to create 1 rle with old method : 0.010984659194946289 time for calcul the mask position with numpy : 0.0059413909912109375 nb_pixel_total : 7842 time to create 1 rle with old method : 0.008840084075927734 create new chi : 0.38797998428344727 time to delete rle : 0.00045871734619140625 batch 1 Loaded 15 chid ids of type : 3594 ++++++++++++Number RLEs to save : 2841 TO DO : save crop sub photo not yet done ! save time : 0.24520587921142578 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.04097175598144531 time for calcul the mask position with numpy : 0.022261619567871094 nb_pixel_total : 2053169 time to create 1 rle with new method : 0.029508113861083984 time for calcul the mask position with numpy : 0.006653308868408203 nb_pixel_total : 10228 time to create 1 rle with old method : 0.011718273162841797 time for calcul the mask position with numpy : 0.007269382476806641 nb_pixel_total : 10203 time to create 1 rle with old method : 0.01208043098449707 create new chi : 0.0897986888885498 time to delete rle : 0.00028967857360839844 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1590 TO DO : save crop sub photo not yet done ! save time : 0.1539289951324463 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03241539001464844 time for calcul the mask position with numpy : 0.019345521926879883 nb_pixel_total : 2066473 time to create 1 rle with new method : 0.028960466384887695 time for calcul the mask position with numpy : 0.006618022918701172 nb_pixel_total : 7127 time to create 1 rle with old method : 0.01181936264038086 create new chi : 0.0669713020324707 time to delete rle : 0.00026869773864746094 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1228 TO DO : save crop sub photo not yet done ! save time : 0.13514208793640137 map_output_result : {1396262332: (0.0, 'Should be the crop_list due to order', 0), 1396262324: (0.0, 'Should be the crop_list due to order', 0), 1396262321: (0.0, 'Should be the crop_list due to order', 0), 1396262318: (0.0, 'Should be the crop_list due to order', 0), 1396262317: (0.0, 'Should be the crop_list due to order', 0), 1396262300: (0.0, 'Should be the crop_list due to order', 0), 1396262298: (0.0, 'Should be the crop_list due to order', 0), 1396262296: (0.0, 'Should be the crop_list due to order', 0), 1396262294: (0.0, 'Should be the crop_list due to order', 0.0), 1396262290: (0.0, 'Should be the crop_list due to order', 0), 1396262287: (0.0, 'Should be the crop_list due to order', 0), 1396262265: (0.0, 'Should be the crop_list due to order', 0), 1396262262: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1396262332, 1396262324, 1396262321, 1396262318, 1396262317, 1396262300, 1396262298, 1396262296, 1396262294, 1396262290, 1396262287, 1396262265, 1396262262] Looping around the photos to save general results len do output : 13 /1396262332.Didn't retrieve data . /1396262324.Didn't retrieve data . /1396262321.Didn't retrieve data . /1396262318.Didn't retrieve data . /1396262317.Didn't retrieve data . /1396262300.Didn't retrieve data . /1396262298.Didn't retrieve data . /1396262296.Didn't retrieve data . /1396262294.Didn't retrieve data . /1396262290.Didn't retrieve data . /1396262287.Didn't retrieve data . /1396262265.Didn't retrieve data . /1396262262.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262332', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262324', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262321', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262318', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262317', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262300', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262298', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262296', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262294', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262290', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262287', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262265', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262262', None, None, None, None, None, '4121970') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 39 time used for this insertion : 0.017726898193359375 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.181242942810059 time spend to save output : 0.018278121948242188 total time spend for step 3 : 10.1995210647583 step4:ventilate_hashtags_in_portfolio Wed Nov 26 17:11:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 28927317 get user id for portfolio 28927317 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28927317 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','environnement','autre','pet_clair','carton','flou','papier','background','mal_croppe','pehd','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28927317 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','environnement','autre','pet_clair','carton','flou','papier','background','mal_croppe','pehd','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28927317 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','environnement','autre','pet_clair','carton','flou','papier','background','mal_croppe','pehd','pet_fonce')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/28927569,28927570,28927571,28927572,28927573,28927574,28927575,28927576,28927577,28927578,28927579?tags=metal,environnement,autre,pet_clair,carton,flou,papier,background,mal_croppe,pehd,pet_fonce Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1396262332, 1396262324, 1396262321, 1396262318, 1396262317, 1396262300, 1396262298, 1396262296, 1396262294, 1396262290, 1396262287, 1396262265, 1396262262] Looping around the photos to save general results len do output : 1 /28927317. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262332', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262324', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262321', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262318', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262317', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262300', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262298', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262296', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262294', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262290', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262287', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262265', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262262', None, None, None, None, None, '4121970') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.019759178161621094 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.9061923027038574 time spend to save output : 0.020083189010620117 total time spend for step 4 : 0.9262754917144775 step5:final Wed Nov 26 17:11:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! apple 13.0 [('28927317', '3594', '492668766', '0.0114220159662868'), ('28927317', '3594', '492774966', '0.0008216850664767331'), ('28927317', '3594', '492628673', '9.704415954415954e-05'), ('28927317', '3594', '2107755846', '0.0438943049620133'), ('28927317', '3594', '494826614', '0.001118715871320038'), ('28927317', '3594', '628944319', '0.0'), ('28927317', '3594', '2107755900', '0.0'), ('28927317', '3594', '538914404', '0.0'), ('28927317', '3594', '493061979', '0.9426462339743591')] list_material_ratio_1 [('28927317', '3594', '492668766', '0.0114220159662868'), ('28927317', '3594', '492774966', '0.0008216850664767331'), ('28927317', '3594', '492628673', '9.704415954415954e-05'), ('28927317', '3594', '2107755846', '0.0438943049620133'), ('28927317', '3594', '494826614', '0.001118715871320038'), ('28927317', '3594', '628944319', '0.0'), ('28927317', '3594', '2107755900', '0.0'), ('28927317', '3594', '538914404', '0.0'), ('28927317', '3594', '493061979', '0.9426462339743591')] 0.9426462339743591 0.0 list_material_ratio_3 [('28927317', '3594', '492668766', '0.0114220159662868'), ('28927317', '3594', '492774966', '0.0008216850664767331'), ('28927317', '3594', '492628673', '9.704415954415954e-05'), ('28927317', '3594', '2107755846', '0.0438943049620133'), ('28927317', '3594', '494826614', '0.001118715871320038'), ('28927317', '3594', '628944319', '0.0'), ('28927317', '3594', '2107755900', '0.0'), ('28927317', '3594', '538914404', '0.9426462339743591')] Inside saveOutput : final : False verbose : 0 original output for save of step final : {1396262332: ('0.057353766025641024',), 1396262324: ('0.057353766025641024',), 1396262321: ('0.057353766025641024',), 1396262318: ('0.057353766025641024',), 1396262317: ('0.057353766025641024',), 1396262300: ('0.057353766025641024',), 1396262298: ('0.057353766025641024',), 1396262296: ('0.057353766025641024',), 1396262294: ('0.057353766025641024',), 1396262290: ('0.057353766025641024',), 1396262287: ('0.057353766025641024',), 1396262265: ('0.057353766025641024',), 1396262262: ('0.057353766025641024',)} new output for save of step final : {1396262332: ('0.057353766025641024',), 1396262324: ('0.057353766025641024',), 1396262321: ('0.057353766025641024',), 1396262318: ('0.057353766025641024',), 1396262317: ('0.057353766025641024',), 1396262300: ('0.057353766025641024',), 1396262298: ('0.057353766025641024',), 1396262296: ('0.057353766025641024',), 1396262294: ('0.057353766025641024',), 1396262290: ('0.057353766025641024',), 1396262287: ('0.057353766025641024',), 1396262265: ('0.057353766025641024',), 1396262262: ('0.057353766025641024',)} [1396262332, 1396262324, 1396262321, 1396262318, 1396262317, 1396262300, 1396262298, 1396262296, 1396262294, 1396262290, 1396262287, 1396262265, 1396262262] Looping around the photos to save general results len do output : 13 /1396262332.Didn't retrieve data . /1396262324.Didn't retrieve data . /1396262321.Didn't retrieve data . /1396262318.Didn't retrieve data . /1396262317.Didn't retrieve data . /1396262300.Didn't retrieve data . /1396262298.Didn't retrieve data . /1396262296.Didn't retrieve data . /1396262294.Didn't retrieve data . /1396262290.Didn't retrieve data . /1396262287.Didn't retrieve data . /1396262265.Didn't retrieve data . /1396262262.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262332', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262324', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262321', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262318', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262317', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262300', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262298', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262296', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262294', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262290', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262287', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262265', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262262', None, None, None, None, None, '4121970') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 39 time used for this insertion : 0.01599431037902832 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.14790821075439453 time spend to save output : 0.016612529754638672 total time spend for step 5 : 0.1645207405090332 step6:blur_detection Wed Nov 26 17:11:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1764173429_401214_1396262332_2bd7b4a5a6fccbae84cb417c72f4fbdc.jpg resize: (1080, 1920) 1396262332 -1.3478128676011518 treat image : temp/1764173429_401214_1396262324_690087f83f79c6e0296df51904c02260.jpg resize: (1080, 1920) 1396262324 -1.8797552479934623 treat image : temp/1764173429_401214_1396262321_afdb6fc8723adb363df70c93e1a69938.jpg resize: (1080, 1920) 1396262321 1.2068763266297198 treat image : temp/1764173429_401214_1396262318_973ca8646c872fedd0eff6f284909276.jpg resize: (1080, 1920) 1396262318 2.023837531835325 treat image : temp/1764173429_401214_1396262317_cb6ebeab3636e815e399e6ed1875300e.jpg resize: (1080, 1920) 1396262317 -1.9445831280898316 treat image : temp/1764173429_401214_1396262300_3a1bad2304f0d9919d8edfeca6ba5718.jpg resize: (1080, 1920) 1396262300 -3.9509708058626445 treat image : temp/1764173429_401214_1396262298_d9be73caa378a61d7b80f3607c835273.jpg resize: (1080, 1920) 1396262298 -0.8381798285719638 treat image : temp/1764173429_401214_1396262296_821fab1eb17c28690d7bbd626ea05dce.jpg resize: (1080, 1920) 1396262296 -3.7207775683932978 treat image : temp/1764173429_401214_1396262294_a989585cfec29a80648ed0b36bda1976.jpg resize: (1080, 1920) 1396262294 0.08038538710479434 treat image : temp/1764173429_401214_1396262290_894814c1d8e0e69f6c4d42bc225ea82c.jpg resize: (1080, 1920) 1396262290 -2.6512505447531183 treat image : temp/1764173429_401214_1396262287_a5a0ba7f9ee11b0042bb037c9ddb0f56.jpg resize: (1080, 1920) 1396262287 1.0216815975228501 treat image : temp/1764173429_401214_1396262265_fdcce414a103b38f3931deeb8857fe16.jpg resize: (1080, 1920) 1396262265 0.6521462167303343 treat image : temp/1764173429_401214_1396262262_46f068a07f537242bcd03ebe0ec6c6e2.jpg resize: (1080, 1920) 1396262262 1.5465191180101308 treat image : temp/1764173429_401214_1396262332_2bd7b4a5a6fccbae84cb417c72f4fbdc_rle_crop_4046253641_0.png resize: (126, 76) 1396267250 2.9138398275574486 treat image : temp/1764173429_401214_1396262332_2bd7b4a5a6fccbae84cb417c72f4fbdc_rle_crop_4046253642_0.png resize: (114, 67) 1396267251 -0.19248091904749476 treat image : temp/1764173429_401214_1396262332_2bd7b4a5a6fccbae84cb417c72f4fbdc_rle_crop_4046253644_0.png resize: (54, 65) 1396267252 -2.0648381852061446 treat image : temp/1764173429_401214_1396262324_690087f83f79c6e0296df51904c02260_rle_crop_4046253646_0.png resize: (136, 72) 1396267253 -0.3611954364259757 treat image : temp/1764173429_401214_1396262324_690087f83f79c6e0296df51904c02260_rle_crop_4046253647_0.png resize: (66, 65) 1396267254 -0.2982910574042275 treat image : temp/1764173429_401214_1396262324_690087f83f79c6e0296df51904c02260_rle_crop_4046253649_0.png resize: (167, 116) 1396267255 -2.438447271940632 treat image : temp/1764173429_401214_1396262324_690087f83f79c6e0296df51904c02260_rle_crop_4046253651_0.png resize: (60, 74) 1396267256 -1.1846637544922922 treat image : temp/1764173429_401214_1396262324_690087f83f79c6e0296df51904c02260_rle_crop_4046253652_0.png resize: (90, 92) 1396267257 -3.914938918637792 treat image : temp/1764173429_401214_1396262324_690087f83f79c6e0296df51904c02260_rle_crop_4046253653_0.png resize: (60, 161) 1396267258 -1.0734853260356279 treat image : temp/1764173429_401214_1396262321_afdb6fc8723adb363df70c93e1a69938_rle_crop_4046253654_0.png resize: (149, 110) 1396267259 -1.3663809208090403 treat image : temp/1764173429_401214_1396262321_afdb6fc8723adb363df70c93e1a69938_rle_crop_4046253655_0.png resize: (98, 124) 1396267260 0.14093662899942216 treat image : temp/1764173429_401214_1396262318_973ca8646c872fedd0eff6f284909276_rle_crop_4046253659_0.png resize: (77, 156) 1396267261 -0.03575649348147308 treat image : temp/1764173429_401214_1396262317_cb6ebeab3636e815e399e6ed1875300e_rle_crop_4046253660_0.png resize: (124, 80) 1396267262 0.5030624029175342 treat image : temp/1764173429_401214_1396262317_cb6ebeab3636e815e399e6ed1875300e_rle_crop_4046253661_0.png resize: (141, 246) 1396267263 -2.997834047955227 treat image : temp/1764173429_401214_1396262300_3a1bad2304f0d9919d8edfeca6ba5718_rle_crop_4046253662_0.png resize: (136, 231) 1396267264 -1.641347441788142 treat image : temp/1764173429_401214_1396262300_3a1bad2304f0d9919d8edfeca6ba5718_rle_crop_4046253663_0.png resize: (83, 99) 1396267265 -4.6774565170007945 treat image : temp/1764173429_401214_1396262300_3a1bad2304f0d9919d8edfeca6ba5718_rle_crop_4046253664_0.png resize: (140, 205) 1396267266 -2.4477522302570778 treat image : temp/1764173429_401214_1396262300_3a1bad2304f0d9919d8edfeca6ba5718_rle_crop_4046253667_0.png resize: (120, 171) 1396267267 -2.2582471269091573 treat image : temp/1764173429_401214_1396262298_d9be73caa378a61d7b80f3607c835273_rle_crop_4046253669_0.png resize: (112, 151) 1396267268 -1.1440092309833256 treat image : temp/1764173429_401214_1396262296_821fab1eb17c28690d7bbd626ea05dce_rle_crop_4046253673_0.png resize: (117, 113) 1396267269 -1.55183099866099 treat image : temp/1764173429_401214_1396262290_894814c1d8e0e69f6c4d42bc225ea82c_rle_crop_4046253675_0.png resize: (45, 139) 1396267270 4.361003042087455 treat image : temp/1764173429_401214_1396262290_894814c1d8e0e69f6c4d42bc225ea82c_rle_crop_4046253676_0.png resize: (71, 137) 1396267271 -1.5974010434839419 treat image : temp/1764173429_401214_1396262290_894814c1d8e0e69f6c4d42bc225ea82c_rle_crop_4046253678_0.png resize: (46, 99) 1396267272 -1.3648214886376298 treat image : temp/1764173429_401214_1396262290_894814c1d8e0e69f6c4d42bc225ea82c_rle_crop_4046253679_0.png resize: (88, 173) 1396267273 -2.8432511475009354 treat image : temp/1764173429_401214_1396262290_894814c1d8e0e69f6c4d42bc225ea82c_rle_crop_4046253681_0.png resize: (151, 98) 1396267274 -1.7757297208367595 treat image : temp/1764173429_401214_1396262287_a5a0ba7f9ee11b0042bb037c9ddb0f56_rle_crop_4046253685_0.png resize: (94, 213) 1396267275 -1.7999257951034253 treat image : temp/1764173429_401214_1396262287_a5a0ba7f9ee11b0042bb037c9ddb0f56_rle_crop_4046253686_0.png resize: (168, 292) 1396267276 -1.5919481541133498 treat image : temp/1764173429_401214_1396262287_a5a0ba7f9ee11b0042bb037c9ddb0f56_rle_crop_4046253687_0.png resize: (84, 165) 1396267277 -0.15578066182135672 treat image : temp/1764173429_401214_1396262287_a5a0ba7f9ee11b0042bb037c9ddb0f56_rle_crop_4046253688_0.png resize: (190, 232) 1396267278 -1.8598094287743727 treat image : temp/1764173429_401214_1396262287_a5a0ba7f9ee11b0042bb037c9ddb0f56_rle_crop_4046253689_0.png resize: (68, 105) 1396267279 1.1183921766059761 treat image : temp/1764173429_401214_1396262265_fdcce414a103b38f3931deeb8857fe16_rle_crop_4046253690_0.png resize: (102, 127) 1396267280 0.057180620173816345 treat image : temp/1764173429_401214_1396262262_46f068a07f537242bcd03ebe0ec6c6e2_rle_crop_4046253692_0.png resize: (74, 141) 1396267281 -1.082328685845889 treat image : temp/1764173429_401214_1396262300_3a1bad2304f0d9919d8edfeca6ba5718_rle_crop_4046253665_0.png resize: (79, 100) 1396267282 -3.6126898614479166 treat image : temp/1764173429_401214_1396262287_a5a0ba7f9ee11b0042bb037c9ddb0f56_rle_crop_4046253683_0.png resize: (95, 99) 1396267283 0.668924378141607 treat image : temp/1764173429_401214_1396262287_a5a0ba7f9ee11b0042bb037c9ddb0f56_rle_crop_4046253684_0.png resize: (95, 121) 1396267284 1.425711778233205 treat image : temp/1764173429_401214_1396262321_afdb6fc8723adb363df70c93e1a69938_rle_crop_4046253657_0.png resize: (44, 81) 1396267286 -1.7736999711009183 treat image : temp/1764173429_401214_1396262332_2bd7b4a5a6fccbae84cb417c72f4fbdc_rle_crop_4046253643_0.png resize: (1002, 996) 1396267290 -0.21594587874563287 treat image : temp/1764173429_401214_1396262332_2bd7b4a5a6fccbae84cb417c72f4fbdc_rle_crop_4046253645_0.png resize: (184, 204) 1396267291 -2.58399922558336 treat image : temp/1764173429_401214_1396262324_690087f83f79c6e0296df51904c02260_rle_crop_4046253648_0.png resize: (121, 83) 1396267292 -0.9328624625431418 treat image : temp/1764173429_401214_1396262324_690087f83f79c6e0296df51904c02260_rle_crop_4046253650_0.png resize: (160, 176) 1396267293 -1.9040431256681287 treat image : temp/1764173429_401214_1396262321_afdb6fc8723adb363df70c93e1a69938_rle_crop_4046253656_0.png resize: (62, 57) 1396267294 -0.4012259057947032 treat image : temp/1764173429_401214_1396262300_3a1bad2304f0d9919d8edfeca6ba5718_rle_crop_4046253666_0.png resize: (129, 330) 1396267295 -3.65094078065299 treat image : temp/1764173429_401214_1396262300_3a1bad2304f0d9919d8edfeca6ba5718_rle_crop_4046253668_0.png resize: (130, 277) 1396267296 -5.1319407991382855 treat image : temp/1764173429_401214_1396262298_d9be73caa378a61d7b80f3607c835273_rle_crop_4046253670_0.png resize: (425, 329) 1396267297 -0.41446461448772065 treat image : temp/1764173429_401214_1396262296_821fab1eb17c28690d7bbd626ea05dce_rle_crop_4046253672_0.png resize: (129, 314) 1396267298 -2.522086089326157 treat image : temp/1764173429_401214_1396262296_821fab1eb17c28690d7bbd626ea05dce_rle_crop_4046253674_0.png resize: (517, 278) 1396267299 0.38220197001466805 treat image : temp/1764173429_401214_1396262290_894814c1d8e0e69f6c4d42bc225ea82c_rle_crop_4046253677_0.png resize: (521, 322) 1396267300 0.2295042480500383 treat image : temp/1764173429_401214_1396262290_894814c1d8e0e69f6c4d42bc225ea82c_rle_crop_4046253680_0.png resize: (126, 90) 1396267301 -0.491433808641685 treat image : temp/1764173429_401214_1396262290_894814c1d8e0e69f6c4d42bc225ea82c_rle_crop_4046253682_0.png resize: (104, 216) 1396267302 -1.6446532574977546 treat image : temp/1764173429_401214_1396262265_fdcce414a103b38f3931deeb8857fe16_rle_crop_4046253691_0.png resize: (153, 85) 1396267303 0.46236445986695573 treat image : temp/1764173429_401214_1396262321_afdb6fc8723adb363df70c93e1a69938_rle_crop_4046253658_0.png resize: (131, 178) 1396267304 2.9093427002874575 treat image : temp/1764173429_401214_1396262298_d9be73caa378a61d7b80f3607c835273_rle_crop_4046253671_0.png resize: (114, 97) 1396267305 0.9436781612745873 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 65 time used for this insertion : 0.01679825782775879 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 65 time used for this insertion : 0.034001827239990234 save missing photos in datou_result : time spend for datou_step_exec : 10.653314590454102 time spend to save output : 0.057515859603881836 total time spend for step 6 : 10.710830450057983 step7:brightness Wed Nov 26 17:11:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1764173429_401214_1396262332_2bd7b4a5a6fccbae84cb417c72f4fbdc.jpg treat image : temp/1764173429_401214_1396262324_690087f83f79c6e0296df51904c02260.jpg treat image : temp/1764173429_401214_1396262321_afdb6fc8723adb363df70c93e1a69938.jpg treat image : temp/1764173429_401214_1396262318_973ca8646c872fedd0eff6f284909276.jpg treat image : temp/1764173429_401214_1396262317_cb6ebeab3636e815e399e6ed1875300e.jpg treat image : temp/1764173429_401214_1396262300_3a1bad2304f0d9919d8edfeca6ba5718.jpg treat image : temp/1764173429_401214_1396262298_d9be73caa378a61d7b80f3607c835273.jpg treat image : temp/1764173429_401214_1396262296_821fab1eb17c28690d7bbd626ea05dce.jpg treat image : temp/1764173429_401214_1396262294_a989585cfec29a80648ed0b36bda1976.jpg treat image : temp/1764173429_401214_1396262290_894814c1d8e0e69f6c4d42bc225ea82c.jpg treat image : temp/1764173429_401214_1396262287_a5a0ba7f9ee11b0042bb037c9ddb0f56.jpg treat image : temp/1764173429_401214_1396262265_fdcce414a103b38f3931deeb8857fe16.jpg treat image : temp/1764173429_401214_1396262262_46f068a07f537242bcd03ebe0ec6c6e2.jpg treat image : temp/1764173429_401214_1396262332_2bd7b4a5a6fccbae84cb417c72f4fbdc_rle_crop_4046253641_0.png treat image : temp/1764173429_401214_1396262332_2bd7b4a5a6fccbae84cb417c72f4fbdc_rle_crop_4046253642_0.png treat image : temp/1764173429_401214_1396262332_2bd7b4a5a6fccbae84cb417c72f4fbdc_rle_crop_4046253644_0.png treat image : temp/1764173429_401214_1396262324_690087f83f79c6e0296df51904c02260_rle_crop_4046253646_0.png treat image : temp/1764173429_401214_1396262324_690087f83f79c6e0296df51904c02260_rle_crop_4046253647_0.png treat image : temp/1764173429_401214_1396262324_690087f83f79c6e0296df51904c02260_rle_crop_4046253649_0.png treat image : temp/1764173429_401214_1396262324_690087f83f79c6e0296df51904c02260_rle_crop_4046253651_0.png treat image : temp/1764173429_401214_1396262324_690087f83f79c6e0296df51904c02260_rle_crop_4046253652_0.png treat image : temp/1764173429_401214_1396262324_690087f83f79c6e0296df51904c02260_rle_crop_4046253653_0.png treat image : temp/1764173429_401214_1396262321_afdb6fc8723adb363df70c93e1a69938_rle_crop_4046253654_0.png treat image : temp/1764173429_401214_1396262321_afdb6fc8723adb363df70c93e1a69938_rle_crop_4046253655_0.png treat image : temp/1764173429_401214_1396262318_973ca8646c872fedd0eff6f284909276_rle_crop_4046253659_0.png treat image : temp/1764173429_401214_1396262317_cb6ebeab3636e815e399e6ed1875300e_rle_crop_4046253660_0.png treat image : temp/1764173429_401214_1396262317_cb6ebeab3636e815e399e6ed1875300e_rle_crop_4046253661_0.png treat image : temp/1764173429_401214_1396262300_3a1bad2304f0d9919d8edfeca6ba5718_rle_crop_4046253662_0.png treat image : temp/1764173429_401214_1396262300_3a1bad2304f0d9919d8edfeca6ba5718_rle_crop_4046253663_0.png treat image : temp/1764173429_401214_1396262300_3a1bad2304f0d9919d8edfeca6ba5718_rle_crop_4046253664_0.png treat image : temp/1764173429_401214_1396262300_3a1bad2304f0d9919d8edfeca6ba5718_rle_crop_4046253667_0.png treat image : temp/1764173429_401214_1396262298_d9be73caa378a61d7b80f3607c835273_rle_crop_4046253669_0.png treat image : temp/1764173429_401214_1396262296_821fab1eb17c28690d7bbd626ea05dce_rle_crop_4046253673_0.png treat image : temp/1764173429_401214_1396262290_894814c1d8e0e69f6c4d42bc225ea82c_rle_crop_4046253675_0.png treat image : temp/1764173429_401214_1396262290_894814c1d8e0e69f6c4d42bc225ea82c_rle_crop_4046253676_0.png treat image : temp/1764173429_401214_1396262290_894814c1d8e0e69f6c4d42bc225ea82c_rle_crop_4046253678_0.png treat image : temp/1764173429_401214_1396262290_894814c1d8e0e69f6c4d42bc225ea82c_rle_crop_4046253679_0.png treat image : temp/1764173429_401214_1396262290_894814c1d8e0e69f6c4d42bc225ea82c_rle_crop_4046253681_0.png treat image : temp/1764173429_401214_1396262287_a5a0ba7f9ee11b0042bb037c9ddb0f56_rle_crop_4046253685_0.png treat image : temp/1764173429_401214_1396262287_a5a0ba7f9ee11b0042bb037c9ddb0f56_rle_crop_4046253686_0.png treat image : temp/1764173429_401214_1396262287_a5a0ba7f9ee11b0042bb037c9ddb0f56_rle_crop_4046253687_0.png treat image : temp/1764173429_401214_1396262287_a5a0ba7f9ee11b0042bb037c9ddb0f56_rle_crop_4046253688_0.png treat image : temp/1764173429_401214_1396262287_a5a0ba7f9ee11b0042bb037c9ddb0f56_rle_crop_4046253689_0.png treat image : temp/1764173429_401214_1396262265_fdcce414a103b38f3931deeb8857fe16_rle_crop_4046253690_0.png treat image : temp/1764173429_401214_1396262262_46f068a07f537242bcd03ebe0ec6c6e2_rle_crop_4046253692_0.png treat image : temp/1764173429_401214_1396262300_3a1bad2304f0d9919d8edfeca6ba5718_rle_crop_4046253665_0.png treat image : temp/1764173429_401214_1396262287_a5a0ba7f9ee11b0042bb037c9ddb0f56_rle_crop_4046253683_0.png treat image : temp/1764173429_401214_1396262287_a5a0ba7f9ee11b0042bb037c9ddb0f56_rle_crop_4046253684_0.png treat image : temp/1764173429_401214_1396262321_afdb6fc8723adb363df70c93e1a69938_rle_crop_4046253657_0.png treat image : temp/1764173429_401214_1396262332_2bd7b4a5a6fccbae84cb417c72f4fbdc_rle_crop_4046253643_0.png treat image : temp/1764173429_401214_1396262332_2bd7b4a5a6fccbae84cb417c72f4fbdc_rle_crop_4046253645_0.png treat image : temp/1764173429_401214_1396262324_690087f83f79c6e0296df51904c02260_rle_crop_4046253648_0.png treat image : temp/1764173429_401214_1396262324_690087f83f79c6e0296df51904c02260_rle_crop_4046253650_0.png treat image : temp/1764173429_401214_1396262321_afdb6fc8723adb363df70c93e1a69938_rle_crop_4046253656_0.png treat image : temp/1764173429_401214_1396262300_3a1bad2304f0d9919d8edfeca6ba5718_rle_crop_4046253666_0.png treat image : temp/1764173429_401214_1396262300_3a1bad2304f0d9919d8edfeca6ba5718_rle_crop_4046253668_0.png treat image : temp/1764173429_401214_1396262298_d9be73caa378a61d7b80f3607c835273_rle_crop_4046253670_0.png treat image : temp/1764173429_401214_1396262296_821fab1eb17c28690d7bbd626ea05dce_rle_crop_4046253672_0.png treat image : temp/1764173429_401214_1396262296_821fab1eb17c28690d7bbd626ea05dce_rle_crop_4046253674_0.png treat image : temp/1764173429_401214_1396262290_894814c1d8e0e69f6c4d42bc225ea82c_rle_crop_4046253677_0.png treat image : temp/1764173429_401214_1396262290_894814c1d8e0e69f6c4d42bc225ea82c_rle_crop_4046253680_0.png treat image : temp/1764173429_401214_1396262290_894814c1d8e0e69f6c4d42bc225ea82c_rle_crop_4046253682_0.png treat image : temp/1764173429_401214_1396262265_fdcce414a103b38f3931deeb8857fe16_rle_crop_4046253691_0.png treat image : temp/1764173429_401214_1396262321_afdb6fc8723adb363df70c93e1a69938_rle_crop_4046253658_0.png treat image : temp/1764173429_401214_1396262298_d9be73caa378a61d7b80f3607c835273_rle_crop_4046253671_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 65 time used for this insertion : 0.020381927490234375 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 65 time used for this insertion : 0.019740581512451172 save missing photos in datou_result : time spend for datou_step_exec : 3.145068645477295 time spend to save output : 0.04589653015136719 total time spend for step 7 : 3.190965175628662 step8:velours_tree Wed Nov 26 17:11:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.13597583770751953 time spend to save output : 3.981590270996094e-05 total time spend for step 8 : 0.1360156536102295 step9:send_mail_cod Wed Nov 26 17:11:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P28927317_26-11-2025_17_11_48.pdf 28927569 change filename to text .imagette289275691764173508 28927571 change filename to text .change filename to text .imagette289275711764173508 28927572 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette289275721764173508 28927573 change filename to text .change filename to text .change filename to text .imagette289275731764173509 28927574 imagette289275741764173509 28927575 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette289275751764173509 28927576 imagette289275761764173511 28927577 imagette289275771764173511 28927578 imagette289275781764173511 28927579 imagette289275791764173511 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=28927317 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/28927569,28927570,28927571,28927572,28927573,28927574,28927575,28927576,28927577,28927578,28927579?tags=metal,environnement,autre,pet_clair,carton,flou,papier,background,mal_croppe,pehd,pet_fonce args[1396262332] : ((1396262332, -1.3478128676011518, 492688767), (1396262332, 0.5613009784217153, 2107752395), '0.057353766025641024') We are sending mail with results at report@fotonower.com args[1396262324] : ((1396262324, -1.8797552479934623, 492688767), (1396262324, 0.41774755602317915, 2107752395), '0.057353766025641024') We are sending mail with results at report@fotonower.com args[1396262321] : ((1396262321, 1.2068763266297198, 492688767), (1396262321, 0.6163149816352502, 2107752395), '0.057353766025641024') We are sending mail with results at report@fotonower.com args[1396262318] : ((1396262318, 2.023837531835325, 492688767), (1396262318, 0.9139872504838321, 2107752395), '0.057353766025641024') We are sending mail with results at report@fotonower.com args[1396262317] : ((1396262317, -1.9445831280898316, 492688767), (1396262317, 0.3863942221097628, 2107752395), '0.057353766025641024') We are sending mail with results at report@fotonower.com args[1396262300] : ((1396262300, -3.9509708058626445, 492609224), (1396262300, 0.4123151275939072, 2107752395), '0.057353766025641024') We are sending mail with results at report@fotonower.com args[1396262298] : ((1396262298, -0.8381798285719638, 492688767), (1396262298, 0.5545430688067812, 2107752395), '0.057353766025641024') We are sending mail with results at report@fotonower.com args[1396262296] : ((1396262296, -3.7207775683932978, 492609224), (1396262296, 0.46049108571430963, 2107752395), '0.057353766025641024') We are sending mail with results at report@fotonower.com args[1396262294] : ((1396262294, 0.08038538710479434, 492688767), (1396262294, 0.45485888667152546, 2107752395), '0.057353766025641024') We are sending mail with results at report@fotonower.com args[1396262290] : ((1396262290, -2.6512505447531183, 492609224), (1396262290, 0.3352295942325677, 2107752395), '0.057353766025641024') We are sending mail with results at report@fotonower.com args[1396262287] : ((1396262287, 1.0216815975228501, 492688767), (1396262287, 0.0322281662234907, 2107752395), '0.057353766025641024') We are sending mail with results at report@fotonower.com args[1396262265] : ((1396262265, 0.6521462167303343, 492688767), (1396262265, 0.6551245003121993, 2107752395), '0.057353766025641024') We are sending mail with results at report@fotonower.com args[1396262262] : ((1396262262, 1.5465191180101308, 492688767), (1396262262, 0.5495417188996101, 2107752395), '0.057353766025641024') We are sending mail with results at report@fotonower.com refus_total : 0.057353766025641024 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=28927317 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28927317_26-11-2025_17_11_48.pdf results_Auto_P28927317_26-11-2025_17_11_48.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28927317_26-11-2025_17_11_48.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','28927317','results_Auto_P28927317_26-11-2025_17_11_48.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28927317_26-11-2025_17_11_48.pdf','pdf','','0.27','0.057353766025641024') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/28927317

https://www.fotonower.com/image?json=false&list_photos_id=1396262332
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396262324
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396262321
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.2068763266297198)
https://www.fotonower.com/image?json=false&list_photos_id=1396262318
La photo est trop floue, merci de reprendre une photo.(avec le score = 2.023837531835325)
https://www.fotonower.com/image?json=false&list_photos_id=1396262317
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396262300
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396262298
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396262296
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396262294
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396262290
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396262287
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.0216815975228501)
https://www.fotonower.com/image?json=false&list_photos_id=1396262265
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1396262262
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.5465191180101308)

Dans ces conditions,le taux de refus est: 5.74%
Veuillez trouver les photos des contaminants.

exemples de contaminants: metal: https://www.fotonower.com/view/28927569?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/28927571?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/28927572?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/28927573?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/28927575?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28927317_26-11-2025_17_11_48.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/28927569,28927570,28927571,28927572,28927573,28927574,28927575,28927576,28927577,28927578,28927579?tags=metal,environnement,autre,pet_clair,carton,flou,papier,background,mal_croppe,pehd,pet_fonce.


L'équipe Fotonower HTTP Error 401: Unauthorized Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1396262332, 1396262324, 1396262321, 1396262318, 1396262317, 1396262300, 1396262298, 1396262296, 1396262294, 1396262290, 1396262287, 1396262265, 1396262262] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262332', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262324', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262321', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262318', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262317', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262300', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262298', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262296', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262294', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262290', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262287', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262265', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262262', None, None, None, None, None, '4121970') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.018863201141357422 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.704796314239502 time spend to save output : 0.019288301467895508 total time spend for step 9 : 4.7240846157073975 step10:split_time_score Wed Nov 26 17:11:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 13),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 26112025 28927317 Nombre de photos uploadées : 13 / 23040 (0%) 26112025 28927317 Nombre de photos taguées (types de déchets): 0 / 13 (0%) 26112025 28927317 Nombre de photos taguées (volume) : 0 / 13 (0%) elapsed_time : load_data_split_time_score 3.0994415283203125e-06 elapsed_time : order_list_meta_photo_and_scores 1.049041748046875e-05 ????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0007598400115966797 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2416527271270752 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.18009831934799386 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28921345_26-11-2025_13_11_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28921345 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28921345 AND mptpi.`type`=3594 To do Qualite : 0.06561518270502646 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28913886_26-11-2025_08_41_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28913886 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28913886 AND mptpi.`type`=3594 To do Qualite : 0.14504273967978396 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28915454_26-11-2025_10_01_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28915454 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28915454 AND mptpi.`type`=3594 To do Qualite : 0.10683708285108026 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28915457_26-11-2025_09_51_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28915457 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28915457 AND mptpi.`type`=3594 To do Qualite : 0.057158625096450644 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28915459_26-11-2025_10_42_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28915459 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28915459 AND mptpi.`type`=3594 To do Qualite : 0.04208984375 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28921350_26-11-2025_14_11_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28921350 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28921350 AND mptpi.`type`=3594 To do Qualite : 0.01618742766203704 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28921359_26-11-2025_12_51_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28921359 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28921359 AND mptpi.`type`=3594 To do Qualite : 0.027386911651234573 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28921363_26-11-2025_12_41_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28921363 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28921363 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28927314 order by id desc limit 1 Qualite : 0.057353766025641024 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P28927317_26-11-2025_17_11_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 28927317 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28927317 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'26112025': {'nb_upload': 13, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1396262332, 1396262324, 1396262321, 1396262318, 1396262317, 1396262300, 1396262298, 1396262296, 1396262294, 1396262290, 1396262287, 1396262265, 1396262262] Looping around the photos to save general results len do output : 1 /28927317Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262332', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262324', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262321', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262318', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262317', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262300', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262298', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262296', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262294', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262290', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262287', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262265', None, None, None, None, None, '4121970') ('3318', None, None, None, None, None, None, None, '4121970') ('3318', '28927317', '1396262262', None, None, None, None, None, '4121970') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.016913652420043945 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.2598321437835693 time spend to save output : 0.01715540885925293 total time spend for step 10 : 2.2769875526428223 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 13 set_done_treatment 41.42user 23.39system 1:30.24elapsed 71%CPU (0avgtext+0avgdata 2935000maxresident)k 544528inputs+19584outputs (906major+1656387minor)pagefaults 0swaps