python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 76524 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3940179'] with mtr_portfolio_ids : ['27796154'] and first list_photo_ids : [] new path : /proc/76524/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 7 ; length of list_pids : 7 ; length of list_args : 7 time to download the photos : 2.0336945056915283 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Tue Oct 14 13:40:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-10-14 13:40:34.490370: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-10-14 13:40:34.514630: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-10-14 13:40:34.516813: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fb070000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-10-14 13:40:34.516877: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-10-14 13:40:34.520942: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-10-14 13:40:34.634128: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x3d75e450 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-10-14 13:40:34.634174: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-10-14 13:40:34.635658: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-14 13:40:34.636074: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-14 13:40:34.639315: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-14 13:40:34.642471: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-14 13:40:34.642991: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-14 13:40:34.645792: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-14 13:40:34.647107: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-14 13:40:34.652292: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-14 13:40:34.653883: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-14 13:40:34.653979: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-14 13:40:34.654798: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-14 13:40:34.654816: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-14 13:40:34.654825: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-14 13:40:34.656626: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10049 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-10-14 13:40:35.123969: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-14 13:40:35.124070: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-14 13:40:35.124098: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-14 13:40:35.124123: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-14 13:40:35.124147: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-14 13:40:35.124171: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-14 13:40:35.124194: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-14 13:40:35.124218: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-14 13:40:35.126440: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-14 13:40:35.128414: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-10-14 13:40:35.128492: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-10-14 13:40:35.128519: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-14 13:40:35.128543: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-10-14 13:40:35.128567: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-10-14 13:40:35.128591: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-10-14 13:40:35.128614: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-10-14 13:40:35.128638: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-10-14 13:40:35.130876: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-10-14 13:40:35.130922: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-10-14 13:40:35.130937: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-10-14 13:40:35.130951: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-10-14 13:40:35.132786: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10049 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-10-14 13:40:45.062611: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-10-14 13:40:45.242606: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 7 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 35 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 24 Detection mask done ! Trying to reset tf kernel 77203 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1929 tf kernel not reseted sub process len(results) : 7 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 7 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10998 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0013327598571777344 nb_pixel_total : 30529 time to create 1 rle with old method : 0.03368353843688965 length of segment : 223 time for calcul the mask position with numpy : 0.0029082298278808594 nb_pixel_total : 137312 time to create 1 rle with old method : 0.14700698852539062 length of segment : 480 time for calcul the mask position with numpy : 0.002073526382446289 nb_pixel_total : 115075 time to create 1 rle with old method : 0.1235196590423584 length of segment : 417 time for calcul the mask position with numpy : 0.00035691261291503906 nb_pixel_total : 16792 time to create 1 rle with old method : 0.018262386322021484 length of segment : 291 time for calcul the mask position with numpy : 0.00055694580078125 nb_pixel_total : 34892 time to create 1 rle with old method : 0.03876686096191406 length of segment : 169 time for calcul the mask position with numpy : 0.0006642341613769531 nb_pixel_total : 29359 time to create 1 rle with old method : 0.03451251983642578 length of segment : 215 time for calcul the mask position with numpy : 0.0011134147644042969 nb_pixel_total : 48541 time to create 1 rle with old method : 0.05255699157714844 length of segment : 384 time for calcul the mask position with numpy : 0.00019431114196777344 nb_pixel_total : 9331 time to create 1 rle with old method : 0.010797739028930664 length of segment : 87 time for calcul the mask position with numpy : 0.00032210350036621094 nb_pixel_total : 17063 time to create 1 rle with old method : 0.019504070281982422 length of segment : 156 time for calcul the mask position with numpy : 0.0037615299224853516 nb_pixel_total : 174996 time to create 1 rle with new method : 0.008733272552490234 length of segment : 444 time for calcul the mask position with numpy : 0.0028917789459228516 nb_pixel_total : 106048 time to create 1 rle with old method : 0.11828136444091797 length of segment : 635 time for calcul the mask position with numpy : 0.0016007423400878906 nb_pixel_total : 108734 time to create 1 rle with old method : 0.1423349380493164 length of segment : 373 time for calcul the mask position with numpy : 0.00046539306640625 nb_pixel_total : 23024 time to create 1 rle with old method : 0.025882720947265625 length of segment : 177 time for calcul the mask position with numpy : 0.00024771690368652344 nb_pixel_total : 14339 time to create 1 rle with old method : 0.015956640243530273 length of segment : 121 time for calcul the mask position with numpy : 0.00037741661071777344 nb_pixel_total : 24755 time to create 1 rle with old method : 0.027114152908325195 length of segment : 137 time for calcul the mask position with numpy : 0.0003437995910644531 nb_pixel_total : 23153 time to create 1 rle with old method : 0.025784969329833984 length of segment : 122 time for calcul the mask position with numpy : 0.00016307830810546875 nb_pixel_total : 10016 time to create 1 rle with old method : 0.011550188064575195 length of segment : 102 time for calcul the mask position with numpy : 0.001493692398071289 nb_pixel_total : 82303 time to create 1 rle with old method : 0.08934950828552246 length of segment : 559 time for calcul the mask position with numpy : 0.00020360946655273438 nb_pixel_total : 9611 time to create 1 rle with old method : 0.010395288467407227 length of segment : 106 time for calcul the mask position with numpy : 0.002105236053466797 nb_pixel_total : 146089 time to create 1 rle with old method : 0.15691685676574707 length of segment : 639 time for calcul the mask position with numpy : 0.0014805793762207031 nb_pixel_total : 95087 time to create 1 rle with old method : 0.10843348503112793 length of segment : 438 time for calcul the mask position with numpy : 0.0006394386291503906 nb_pixel_total : 43401 time to create 1 rle with old method : 0.04797530174255371 length of segment : 248 time for calcul the mask position with numpy : 0.0002875328063964844 nb_pixel_total : 13375 time to create 1 rle with old method : 0.01488351821899414 length of segment : 120 time for calcul the mask position with numpy : 0.010340690612792969 nb_pixel_total : 340279 time to create 1 rle with new method : 0.02784895896911621 length of segment : 872 time for calcul the mask position with numpy : 0.00046181678771972656 nb_pixel_total : 26903 time to create 1 rle with old method : 0.029252052307128906 length of segment : 315 time for calcul the mask position with numpy : 0.0002262592315673828 nb_pixel_total : 10847 time to create 1 rle with old method : 0.012200355529785156 length of segment : 103 time for calcul the mask position with numpy : 0.000989675521850586 nb_pixel_total : 65448 time to create 1 rle with old method : 0.07251906394958496 length of segment : 292 time for calcul the mask position with numpy : 0.0010237693786621094 nb_pixel_total : 65688 time to create 1 rle with old method : 0.07144665718078613 length of segment : 297 time for calcul the mask position with numpy : 0.0002200603485107422 nb_pixel_total : 11887 time to create 1 rle with old method : 0.017801523208618164 length of segment : 139 time for calcul the mask position with numpy : 0.0008094310760498047 nb_pixel_total : 30388 time to create 1 rle with old method : 0.03392744064331055 length of segment : 154 time for calcul the mask position with numpy : 0.0014221668243408203 nb_pixel_total : 49086 time to create 1 rle with old method : 0.05448770523071289 length of segment : 326 time for calcul the mask position with numpy : 0.004424095153808594 nb_pixel_total : 147341 time to create 1 rle with old method : 0.15958166122436523 length of segment : 440 time for calcul the mask position with numpy : 0.0020940303802490234 nb_pixel_total : 52638 time to create 1 rle with old method : 0.05774116516113281 length of segment : 264 time for calcul the mask position with numpy : 0.002529144287109375 nb_pixel_total : 92649 time to create 1 rle with old method : 0.10106205940246582 length of segment : 411 time for calcul the mask position with numpy : 0.0004901885986328125 nb_pixel_total : 9309 time to create 1 rle with old method : 0.01034235954284668 length of segment : 105 time for calcul the mask position with numpy : 0.000873565673828125 nb_pixel_total : 27601 time to create 1 rle with old method : 0.03369736671447754 length of segment : 230 time for calcul the mask position with numpy : 0.000804901123046875 nb_pixel_total : 22451 time to create 1 rle with old method : 0.024672508239746094 length of segment : 223 time for calcul the mask position with numpy : 0.0015001296997070312 nb_pixel_total : 43058 time to create 1 rle with old method : 0.046663522720336914 length of segment : 463 time for calcul the mask position with numpy : 0.0020651817321777344 nb_pixel_total : 80070 time to create 1 rle with old method : 0.08927035331726074 length of segment : 502 time for calcul the mask position with numpy : 0.002282857894897461 nb_pixel_total : 89503 time to create 1 rle with old method : 0.11284112930297852 length of segment : 383 time for calcul the mask position with numpy : 0.002305746078491211 nb_pixel_total : 80029 time to create 1 rle with old method : 0.0847008228302002 length of segment : 345 time for calcul the mask position with numpy : 0.002663135528564453 nb_pixel_total : 84463 time to create 1 rle with old method : 0.09093976020812988 length of segment : 297 time for calcul the mask position with numpy : 0.0003418922424316406 nb_pixel_total : 9198 time to create 1 rle with old method : 0.01070547103881836 length of segment : 93 time for calcul the mask position with numpy : 0.0011463165283203125 nb_pixel_total : 37221 time to create 1 rle with old method : 0.04069089889526367 length of segment : 264 time for calcul the mask position with numpy : 0.001939535140991211 nb_pixel_total : 71750 time to create 1 rle with old method : 0.07932353019714355 length of segment : 248 time for calcul the mask position with numpy : 0.0012710094451904297 nb_pixel_total : 42887 time to create 1 rle with old method : 0.046927452087402344 length of segment : 283 time for calcul the mask position with numpy : 0.003050088882446289 nb_pixel_total : 77707 time to create 1 rle with old method : 0.08485674858093262 length of segment : 527 time for calcul the mask position with numpy : 0.0007376670837402344 nb_pixel_total : 20706 time to create 1 rle with old method : 0.02300429344177246 length of segment : 191 time for calcul the mask position with numpy : 0.0005886554718017578 nb_pixel_total : 16857 time to create 1 rle with old method : 0.019877195358276367 length of segment : 132 time for calcul the mask position with numpy : 0.004848480224609375 nb_pixel_total : 160390 time to create 1 rle with new method : 0.006927013397216797 length of segment : 593 time for calcul the mask position with numpy : 0.001188516616821289 nb_pixel_total : 27572 time to create 1 rle with old method : 0.03122997283935547 length of segment : 334 time for calcul the mask position with numpy : 0.005084037780761719 nb_pixel_total : 141090 time to create 1 rle with old method : 0.1564655303955078 length of segment : 500 time for calcul the mask position with numpy : 0.0014247894287109375 nb_pixel_total : 38388 time to create 1 rle with old method : 0.04485440254211426 length of segment : 253 time for calcul the mask position with numpy : 0.003441333770751953 nb_pixel_total : 86602 time to create 1 rle with old method : 0.09462451934814453 length of segment : 500 time for calcul the mask position with numpy : 0.0009474754333496094 nb_pixel_total : 38985 time to create 1 rle with old method : 0.04364728927612305 length of segment : 353 time for calcul the mask position with numpy : 0.0008187294006347656 nb_pixel_total : 24772 time to create 1 rle with old method : 0.027837038040161133 length of segment : 145 time for calcul the mask position with numpy : 0.0036470890045166016 nb_pixel_total : 157850 time to create 1 rle with new method : 0.00475764274597168 length of segment : 395 time for calcul the mask position with numpy : 0.0008234977722167969 nb_pixel_total : 27237 time to create 1 rle with old method : 0.030157804489135742 length of segment : 159 time for calcul the mask position with numpy : 0.0008182525634765625 nb_pixel_total : 23398 time to create 1 rle with old method : 0.02617502212524414 length of segment : 207 time for calcul the mask position with numpy : 0.0010247230529785156 nb_pixel_total : 49688 time to create 1 rle with old method : 0.05462169647216797 length of segment : 377 time for calcul the mask position with numpy : 0.0005705356597900391 nb_pixel_total : 20196 time to create 1 rle with old method : 0.022718429565429688 length of segment : 165 time for calcul the mask position with numpy : 0.0003294944763183594 nb_pixel_total : 8670 time to create 1 rle with old method : 0.014470577239990234 length of segment : 84 time for calcul the mask position with numpy : 0.0013773441314697266 nb_pixel_total : 46790 time to create 1 rle with old method : 0.07086515426635742 length of segment : 175 time for calcul the mask position with numpy : 0.005184173583984375 nb_pixel_total : 125326 time to create 1 rle with old method : 0.13613295555114746 length of segment : 818 time for calcul the mask position with numpy : 0.0007307529449462891 nb_pixel_total : 23978 time to create 1 rle with old method : 0.026405811309814453 length of segment : 172 time for calcul the mask position with numpy : 0.001809835433959961 nb_pixel_total : 47432 time to create 1 rle with old method : 0.052100419998168945 length of segment : 381 time for calcul the mask position with numpy : 0.0014333724975585938 nb_pixel_total : 41263 time to create 1 rle with old method : 0.04625415802001953 length of segment : 263 time for calcul the mask position with numpy : 0.0011773109436035156 nb_pixel_total : 39791 time to create 1 rle with old method : 0.04346108436584473 length of segment : 304 time for calcul the mask position with numpy : 0.00041937828063964844 nb_pixel_total : 22226 time to create 1 rle with old method : 0.024927854537963867 length of segment : 240 time for calcul the mask position with numpy : 0.00631403923034668 nb_pixel_total : 183369 time to create 1 rle with new method : 0.01148843765258789 length of segment : 508 time for calcul the mask position with numpy : 0.0010759830474853516 nb_pixel_total : 38014 time to create 1 rle with old method : 0.04210186004638672 length of segment : 182 time for calcul the mask position with numpy : 0.0016744136810302734 nb_pixel_total : 60128 time to create 1 rle with old method : 0.06531095504760742 length of segment : 272 time for calcul the mask position with numpy : 0.0005185604095458984 nb_pixel_total : 15710 time to create 1 rle with old method : 0.01779341697692871 length of segment : 144 time for calcul the mask position with numpy : 0.003305673599243164 nb_pixel_total : 127911 time to create 1 rle with old method : 0.141587495803833 length of segment : 504 time for calcul the mask position with numpy : 0.0016274452209472656 nb_pixel_total : 37302 time to create 1 rle with old method : 0.05840635299682617 length of segment : 434 time spent for convertir_results : 7.840367555618286 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 75 chid ids of type : 3594 Number RLEs to save : 23004 save missing photos in datou_result : time spend for datou_step_exec : 53.22513556480408 time spend to save output : 2.5677855014801025 total time spend for step 1 : 55.79292106628418 step2:crop_condition Tue Oct 14 13:41:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 7 ! batch 1 Loaded 75 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 39 About to insert : list_path_to_insert length 39 new photo from crops ! About to upload 39 photos upload in portfolio : 3736932 init cache_photo without model_param we have 39 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760442100_76524 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544574_0.png', 0, 367, 363, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544569_0.png', 0, 203, 384, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544572_0.png', 0, 511, 427, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544565_0.png', 0, 449, 417, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544564_0.png', 0, 375, 473, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544570_0.png', 0, 156, 86, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544566_0.png', 0, 85, 273, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544573_0.png', 0, 584, 635, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544567_0.png', 0, 277, 164, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544580_0.png', 0, 357, 386, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544576_0.png', 0, 191, 121, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544575_0.png', 0, 262, 158, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544582_0.png', 0, 361, 592, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544596_0.png', 0, 330, 411, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544587_0.png', 0, 115, 313, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544597_0.png', 0, 166, 103, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544585_0.png', 0, 204, 108, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544589_0.png', 0, 359, 287, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544594_0.png', 0, 517, 423, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544592_0.png', 0, 245, 153, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544588_0.png', 0, 133, 102, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544602_0.png', 0, 316, 382, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544606_0.png', 0, 227, 245, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544611_0.png', 0, 188, 126, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388090_11c36232b51741c4ab998df4c3a04e09_rle_crop_3997544612_0.png', 0, 349, 590, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388090_11c36232b51741c4ab998df4c3a04e09_rle_crop_3997544614_0.png', 0, 427, 498, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388090_11c36232b51741c4ab998df4c3a04e09_rle_crop_3997544613_0.png', 0, 106, 334, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388090_11c36232b51741c4ab998df4c3a04e09_rle_crop_3997544617_0.png', 0, 195, 271, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388090_11c36232b51741c4ab998df4c3a04e09_rle_crop_3997544615_0.png', 0, 203, 245, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389387885_e5d680d9763c3d12174c1d79b23fd64e_rle_crop_3997544622_0.png', 0, 272, 283, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389387885_e5d680d9763c3d12174c1d79b23fd64e_rle_crop_3997544621_0.png', 0, 201, 207, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389387885_e5d680d9763c3d12174c1d79b23fd64e_rle_crop_3997544620_0.png', 0, 221, 159, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389387885_e5d680d9763c3d12174c1d79b23fd64e_rle_crop_3997544626_0.png', 0, 549, 629, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389387885_e5d680d9763c3d12174c1d79b23fd64e_rle_crop_3997544623_0.png', 0, 192, 165, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544628_0.png', 0, 192, 375, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544630_0.png', 0, 269, 222, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544631_0.png', 0, 185, 234, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544633_0.png', 0, 316, 172, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442109), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544627_0.png', 0, 168, 171, 0, 1760442109,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 39 photos in the portfolio 3736932 time of upload the photos Elapsed time : 14.427539587020874 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760442118_76524 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442121), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544563_0.png', 0, 225, 220, 0, 1760442121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442121), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544571_0.png', 0, 156, 156, 0, 1760442121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442121), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544568_0.png', 0, 288, 177, 0, 1760442121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442121), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544586_0.png', 0, 628, 871, 0, 1760442121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442121), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544607_0.png', 0, 425, 247, 0, 1760442121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442121), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544632_0.png', 0, 605, 504, 0, 1760442121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.987745761871338 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760442123_76524 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442125), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544581_0.png', 0, 104, 104, 0, 1760442125,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442125), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544593_0.png', 0, 178, 326, 0, 1760442125,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442125), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544610_0.png', 0, 138, 190, 0, 1760442125,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442125), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388090_11c36232b51741c4ab998df4c3a04e09_rle_crop_3997544618_0.png', 0, 214, 145, 0, 1760442125,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442125), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389387885_e5d680d9763c3d12174c1d79b23fd64e_rle_crop_3997544625_0.png', 0, 335, 171, 0, 1760442125,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442125), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544635_0.png', 0, 141, 143, 0, 1760442125,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.1716599464416504 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 22 About to insert : list_path_to_insert length 22 new photo from crops ! About to upload 22 photos upload in portfolio : 3736932 init cache_photo without model_param we have 22 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760442132_76524 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442136), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544578_0.png', 0, 265, 121, 0, 1760442136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442136), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544579_0.png', 0, 120, 98, 0, 1760442136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442136), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544583_0.png', 0, 280, 435, 0, 1760442136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442136), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544577_0.png', 0, 270, 134, 0, 1760442136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442136), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544584_0.png', 0, 216, 246, 0, 1760442136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442136), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544599_0.png', 0, 183, 195, 0, 1760442136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442136), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544595_0.png', 0, 535, 214, 0, 1760442136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442136), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544598_0.png', 0, 204, 230, 0, 1760442136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442136), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544590_0.png', 0, 275, 296, 0, 1760442136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442136), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544600_0.png', 0, 285, 261, 0, 1760442136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442136), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544605_0.png', 0, 120, 93, 0, 1760442136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442136), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544603_0.png', 0, 354, 343, 0, 1760442136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442136), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544609_0.png', 0, 275, 480, 0, 1760442136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442136), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544604_0.png', 0, 443, 287, 0, 1760442136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442136), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544601_0.png', 0, 182, 502, 0, 1760442136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442136), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388090_11c36232b51741c4ab998df4c3a04e09_rle_crop_3997544616_0.png', 0, 238, 492, 0, 1760442136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442136), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389387885_e5d680d9763c3d12174c1d79b23fd64e_rle_crop_3997544624_0.png', 0, 121, 84, 0, 1760442136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442136), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389387885_e5d680d9763c3d12174c1d79b23fd64e_rle_crop_3997544619_0.png', 0, 467, 393, 0, 1760442136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442136), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544636_0.png', 0, 390, 426, 0, 1760442136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442136), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544637_0.png', 0, 267, 297, 0, 1760442136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442136), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544629_0.png', 0, 259, 227, 0, 1760442136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442136), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544634_0.png', 0, 295, 272, 0, 1760442136,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 22 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.197141170501709 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760442141_76524 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442141), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544591_0.png', 0, 107, 139, 0, 1760442141,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8890471458435059 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1760442143_76524 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1760442143), 0.0, 0.0, 14, '', 0, 0, '1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544608_0.png', 0, 236, 283, 0, 1760442143,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8380653858184814 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1389388101, 1389388100, 1389388098, 1389388096, 1389388090, 1389387885, 1389387848] Looping around the photos to save general results len do output : 75 /1389399474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1389399807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388101', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388100', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388098', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388096', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388090', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389387885', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389387848', None, None, None, None, None, '3940179') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 232 time used for this insertion : 0.04263138771057129 save_final save missing photos in datou_result : time spend for datou_step_exec : 55.99058794975281 time spend to save output : 0.04550433158874512 total time spend for step 2 : 56.03609228134155 step3:rle_unique_nms_with_priority Tue Oct 14 13:42:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 75 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 12 nb_hashtags : 2 time to prepare the origin masks : 5.076985836029053 time for calcul the mask position with numpy : 0.5550198554992676 nb_pixel_total : 7465763 time to create 1 rle with new method : 0.7019762992858887 time for calcul the mask position with numpy : 0.02620220184326172 nb_pixel_total : 108734 time to create 1 rle with old method : 0.11887264251708984 time for calcul the mask position with numpy : 0.025937318801879883 nb_pixel_total : 106048 time to create 1 rle with old method : 0.11528944969177246 time for calcul the mask position with numpy : 0.029862403869628906 nb_pixel_total : 174996 time to create 1 rle with new method : 0.5286219120025635 time for calcul the mask position with numpy : 0.024147987365722656 nb_pixel_total : 17063 time to create 1 rle with old method : 0.018493175506591797 time for calcul the mask position with numpy : 0.043421268463134766 nb_pixel_total : 9296 time to create 1 rle with old method : 0.010373115539550781 time for calcul the mask position with numpy : 0.047817230224609375 nb_pixel_total : 48541 time to create 1 rle with old method : 0.0633389949798584 time for calcul the mask position with numpy : 0.04016304016113281 nb_pixel_total : 29359 time to create 1 rle with old method : 0.03233981132507324 time for calcul the mask position with numpy : 0.03836250305175781 nb_pixel_total : 34892 time to create 1 rle with old method : 0.0406341552734375 time for calcul the mask position with numpy : 0.03734612464904785 nb_pixel_total : 16792 time to create 1 rle with old method : 0.018758773803710938 time for calcul the mask position with numpy : 0.03470969200134277 nb_pixel_total : 115075 time to create 1 rle with old method : 0.12584900856018066 time for calcul the mask position with numpy : 0.03627610206604004 nb_pixel_total : 137312 time to create 1 rle with old method : 0.1511673927307129 time for calcul the mask position with numpy : 0.04089021682739258 nb_pixel_total : 30529 time to create 1 rle with old method : 0.03316140174865723 create new chi : 3.0071003437042236 time to delete rle : 0.0696859359741211 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++Number RLEs to save : 9902 TO DO : save crop sub photo not yet done ! save time : 1.1378908157348633 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 3.6331377029418945 time for calcul the mask position with numpy : 0.5990049839019775 nb_pixel_total : 7822622 time to create 1 rle with new method : 0.5754556655883789 time for calcul the mask position with numpy : 0.03863024711608887 nb_pixel_total : 43401 time to create 1 rle with old method : 0.045694589614868164 time for calcul the mask position with numpy : 0.023382186889648438 nb_pixel_total : 95087 time to create 1 rle with old method : 0.09890222549438477 time for calcul the mask position with numpy : 0.024222135543823242 nb_pixel_total : 146089 time to create 1 rle with old method : 0.15478181838989258 time for calcul the mask position with numpy : 0.024545669555664062 nb_pixel_total : 9611 time to create 1 rle with old method : 0.010320186614990234 time for calcul the mask position with numpy : 0.026103973388671875 nb_pixel_total : 82303 time to create 1 rle with old method : 0.08683085441589355 time for calcul the mask position with numpy : 0.02467060089111328 nb_pixel_total : 10016 time to create 1 rle with old method : 0.01082158088684082 time for calcul the mask position with numpy : 0.02413177490234375 nb_pixel_total : 23153 time to create 1 rle with old method : 0.024782419204711914 time for calcul the mask position with numpy : 0.023607969284057617 nb_pixel_total : 24755 time to create 1 rle with old method : 0.026433229446411133 time for calcul the mask position with numpy : 0.025665760040283203 nb_pixel_total : 14339 time to create 1 rle with old method : 0.015535593032836914 time for calcul the mask position with numpy : 0.03904867172241211 nb_pixel_total : 23024 time to create 1 rle with old method : 0.024903059005737305 create new chi : 1.9888312816619873 time to delete rle : 0.001100301742553711 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++Number RLEs to save : 7458 TO DO : save crop sub photo not yet done ! save time : 0.9491844177246094 nb_obj : 16 nb_hashtags : 5 time to prepare the origin masks : 5.119501113891602 time for calcul the mask position with numpy : 0.41815757751464844 nb_pixel_total : 7285452 time to create 1 rle with new method : 0.7550044059753418 time for calcul the mask position with numpy : 0.0335688591003418 nb_pixel_total : 43058 time to create 1 rle with old method : 0.045830726623535156 time for calcul the mask position with numpy : 0.02375650405883789 nb_pixel_total : 22451 time to create 1 rle with old method : 0.02434515953063965 time for calcul the mask position with numpy : 0.0239102840423584 nb_pixel_total : 27601 time to create 1 rle with old method : 0.029082059860229492 time for calcul the mask position with numpy : 0.023632287979125977 nb_pixel_total : 9309 time to create 1 rle with old method : 0.009933710098266602 time for calcul the mask position with numpy : 0.023894548416137695 nb_pixel_total : 92649 time to create 1 rle with old method : 0.09808945655822754 time for calcul the mask position with numpy : 0.02410292625427246 nb_pixel_total : 52638 time to create 1 rle with old method : 0.05527853965759277 time for calcul the mask position with numpy : 0.02564716339111328 nb_pixel_total : 147341 time to create 1 rle with old method : 0.15470623970031738 time for calcul the mask position with numpy : 0.02438950538635254 nb_pixel_total : 49086 time to create 1 rle with old method : 0.05199432373046875 time for calcul the mask position with numpy : 0.024631738662719727 nb_pixel_total : 30388 time to create 1 rle with old method : 0.03197479248046875 time for calcul the mask position with numpy : 0.02340078353881836 nb_pixel_total : 11887 time to create 1 rle with old method : 0.012457132339477539 time for calcul the mask position with numpy : 0.02334451675415039 nb_pixel_total : 65688 time to create 1 rle with old method : 0.06760811805725098 time for calcul the mask position with numpy : 0.024273157119750977 nb_pixel_total : 65448 time to create 1 rle with old method : 0.07079625129699707 time for calcul the mask position with numpy : 0.02416205406188965 nb_pixel_total : 10847 time to create 1 rle with old method : 0.011098861694335938 time for calcul the mask position with numpy : 0.023601770401000977 nb_pixel_total : 26903 time to create 1 rle with old method : 0.02764129638671875 time for calcul the mask position with numpy : 0.024799108505249023 nb_pixel_total : 340279 time to create 1 rle with new method : 0.5159850120544434 time for calcul the mask position with numpy : 0.025485515594482422 nb_pixel_total : 13375 time to create 1 rle with old method : 0.014821052551269531 create new chi : 2.859029531478882 time to delete rle : 0.0014421939849853516 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 11668 TO DO : save crop sub photo not yet done ! save time : 1.3153131008148193 nb_obj : 11 nb_hashtags : 5 time to prepare the origin masks : 3.7107248306274414 time for calcul the mask position with numpy : 0.5481884479522705 nb_pixel_total : 7684009 time to create 1 rle with new method : 0.6577901840209961 time for calcul the mask position with numpy : 0.03626656532287598 nb_pixel_total : 16857 time to create 1 rle with old method : 0.018134355545043945 time for calcul the mask position with numpy : 0.023444414138793945 nb_pixel_total : 20706 time to create 1 rle with old method : 0.02235102653503418 time for calcul the mask position with numpy : 0.02370429039001465 nb_pixel_total : 77707 time to create 1 rle with old method : 0.08257079124450684 time for calcul the mask position with numpy : 0.02308368682861328 nb_pixel_total : 42887 time to create 1 rle with old method : 0.044043779373168945 time for calcul the mask position with numpy : 0.023244619369506836 nb_pixel_total : 71750 time to create 1 rle with old method : 0.07477283477783203 time for calcul the mask position with numpy : 0.023461580276489258 nb_pixel_total : 37221 time to create 1 rle with old method : 0.0381777286529541 time for calcul the mask position with numpy : 0.024062633514404297 nb_pixel_total : 9198 time to create 1 rle with old method : 0.0099029541015625 time for calcul the mask position with numpy : 0.024590015411376953 nb_pixel_total : 84463 time to create 1 rle with old method : 0.08762884140014648 time for calcul the mask position with numpy : 0.024667739868164062 nb_pixel_total : 80029 time to create 1 rle with old method : 0.08298802375793457 time for calcul the mask position with numpy : 0.024372339248657227 nb_pixel_total : 89503 time to create 1 rle with old method : 0.09105587005615234 time for calcul the mask position with numpy : 0.023914575576782227 nb_pixel_total : 80070 time to create 1 rle with old method : 0.08167338371276855 create new chi : 2.1554269790649414 time to delete rle : 0.0011258125305175781 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++Number RLEs to save : 8690 TO DO : save crop sub photo not yet done ! save time : 1.0596458911895752 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 2.320176601409912 time for calcul the mask position with numpy : 0.457305908203125 nb_pixel_total : 7776601 time to create 1 rle with new method : 0.566399335861206 time for calcul the mask position with numpy : 0.02271747589111328 nb_pixel_total : 24772 time to create 1 rle with old method : 0.025217771530151367 time for calcul the mask position with numpy : 0.022593021392822266 nb_pixel_total : 38985 time to create 1 rle with old method : 0.04109621047973633 time for calcul the mask position with numpy : 0.023047208786010742 nb_pixel_total : 86602 time to create 1 rle with old method : 0.08955860137939453 time for calcul the mask position with numpy : 0.023052215576171875 nb_pixel_total : 38388 time to create 1 rle with old method : 0.040799856185913086 time for calcul the mask position with numpy : 0.024165868759155273 nb_pixel_total : 141090 time to create 1 rle with old method : 0.14692974090576172 time for calcul the mask position with numpy : 0.02426910400390625 nb_pixel_total : 27572 time to create 1 rle with old method : 0.0299527645111084 time for calcul the mask position with numpy : 0.024255752563476562 nb_pixel_total : 160390 time to create 1 rle with new method : 0.6073834896087646 create new chi : 2.233119010925293 time to delete rle : 0.001184701919555664 batch 1 Loaded 15 chid ids of type : 3594 ++++++++++Number RLEs to save : 7516 TO DO : save crop sub photo not yet done ! save time : 0.9266316890716553 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 2.6302669048309326 time for calcul the mask position with numpy : 0.3857405185699463 nb_pixel_total : 7847884 time to create 1 rle with new method : 0.6565272808074951 time for calcul the mask position with numpy : 0.023983001708984375 nb_pixel_total : 125326 time to create 1 rle with old method : 0.13119745254516602 time for calcul the mask position with numpy : 0.023325443267822266 nb_pixel_total : 46790 time to create 1 rle with old method : 0.05022931098937988 time for calcul the mask position with numpy : 0.023975133895874023 nb_pixel_total : 8670 time to create 1 rle with old method : 0.009662389755249023 time for calcul the mask position with numpy : 0.024874210357666016 nb_pixel_total : 20196 time to create 1 rle with old method : 0.02197551727294922 time for calcul the mask position with numpy : 0.02620673179626465 nb_pixel_total : 37049 time to create 1 rle with old method : 0.06099748611450195 time for calcul the mask position with numpy : 0.026015520095825195 nb_pixel_total : 23398 time to create 1 rle with old method : 0.025233030319213867 time for calcul the mask position with numpy : 0.024747133255004883 nb_pixel_total : 27237 time to create 1 rle with old method : 0.029741764068603516 time for calcul the mask position with numpy : 0.024332046508789062 nb_pixel_total : 157850 time to create 1 rle with new method : 0.6794521808624268 create new chi : 2.312941789627075 time to delete rle : 0.0010161399841308594 batch 1 Loaded 17 chid ids of type : 3594 +++++++++++Number RLEs to save : 6573 TO DO : save crop sub photo not yet done ! save time : 0.8295149803161621 nb_obj : 11 nb_hashtags : 4 time to prepare the origin masks : 3.6344704627990723 time for calcul the mask position with numpy : 0.5322971343994141 nb_pixel_total : 7680351 time to create 1 rle with new method : 0.5273351669311523 time for calcul the mask position with numpy : 0.0238802433013916 nb_pixel_total : 14227 time to create 1 rle with old method : 0.015630245208740234 time for calcul the mask position with numpy : 0.0388944149017334 nb_pixel_total : 127911 time to create 1 rle with old method : 0.13533258438110352 time for calcul the mask position with numpy : 0.03510785102844238 nb_pixel_total : 15710 time to create 1 rle with old method : 0.016319990158081055 time for calcul the mask position with numpy : 0.023825407028198242 nb_pixel_total : 60128 time to create 1 rle with old method : 0.06249094009399414 time for calcul the mask position with numpy : 0.023922204971313477 nb_pixel_total : 38014 time to create 1 rle with old method : 0.040216922760009766 time for calcul the mask position with numpy : 0.02408456802368164 nb_pixel_total : 183369 time to create 1 rle with new method : 0.5693094730377197 time for calcul the mask position with numpy : 0.02465057373046875 nb_pixel_total : 22226 time to create 1 rle with old method : 0.023569822311401367 time for calcul the mask position with numpy : 0.024597883224487305 nb_pixel_total : 39791 time to create 1 rle with old method : 0.042403459548950195 time for calcul the mask position with numpy : 0.024007320404052734 nb_pixel_total : 41263 time to create 1 rle with old method : 0.04345297813415527 time for calcul the mask position with numpy : 0.023898601531982422 nb_pixel_total : 47432 time to create 1 rle with old method : 0.04919075965881348 time for calcul the mask position with numpy : 0.02397322654724121 nb_pixel_total : 23978 time to create 1 rle with old method : 0.025449037551879883 create new chi : 2.4393668174743652 time to delete rle : 0.0012052059173583984 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 8480 TO DO : save crop sub photo not yet done ! save time : 1.0139644145965576 map_output_result : {1389388101: (0.0, 'Should be the crop_list due to order', 0), 1389388100: (0.0, 'Should be the crop_list due to order', 0), 1389388098: (0.0, 'Should be the crop_list due to order', 0), 1389388096: (0.0, 'Should be the crop_list due to order', 0), 1389388090: (0.0, 'Should be the crop_list due to order', 0), 1389387885: (0.0, 'Should be the crop_list due to order', 0), 1389387848: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1389388101, 1389388100, 1389388098, 1389388096, 1389388090, 1389387885, 1389387848] Looping around the photos to save general results len do output : 7 /1389388101.Didn't retrieve data . /1389388100.Didn't retrieve data . /1389388098.Didn't retrieve data . /1389388096.Didn't retrieve data . /1389388090.Didn't retrieve data . /1389387885.Didn't retrieve data . /1389387848.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388101', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388100', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388098', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388096', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388090', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389387885', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389387848', None, None, None, None, None, '3940179') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.04002881050109863 save_final save missing photos in datou_result : time spend for datou_step_exec : 51.4904670715332 time spend to save output : 0.04036092758178711 total time spend for step 3 : 51.53082799911499 step4:ventilate_hashtags_in_portfolio Tue Oct 14 13:43:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 27796154 get user id for portfolio 27796154 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27796154 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','flou','pet_clair','pehd','mal_croppe','metal','autre','papier','carton','pet_fonce','background')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27796154 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','flou','pet_clair','pehd','mal_croppe','metal','autre','papier','carton','pet_fonce','background')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27796154 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','flou','pet_clair','pehd','mal_croppe','metal','autre','papier','carton','pet_fonce','background')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/27796385,27796386,27796387,27796388,27796389,27796390,27796391,27796392,27796393,27796394,27796395?tags=environnement,flou,pet_clair,pehd,mal_croppe,metal,autre,papier,carton,pet_fonce,background Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1389388101, 1389388100, 1389388098, 1389388096, 1389388090, 1389387885, 1389387848] Looping around the photos to save general results len do output : 1 /27796154. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388101', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388100', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388098', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388096', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388090', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389387885', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389387848', None, None, None, None, None, '3940179') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.046591758728027344 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.636420965194702 time spend to save output : 0.0468142032623291 total time spend for step 4 : 2.6832351684570312 step5:final Tue Oct 14 13:43:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1389388101: ('0.07747254602072311',), 1389388100: ('0.07747254602072311',), 1389388098: ('0.07747254602072311',), 1389388096: ('0.07747254602072311',), 1389388090: ('0.07747254602072311',), 1389387885: ('0.07747254602072311',), 1389387848: ('0.07747254602072311',)} new output for save of step final : {1389388101: ('0.07747254602072311',), 1389388100: ('0.07747254602072311',), 1389388098: ('0.07747254602072311',), 1389388096: ('0.07747254602072311',), 1389388090: ('0.07747254602072311',), 1389387885: ('0.07747254602072311',), 1389387848: ('0.07747254602072311',)} [1389388101, 1389388100, 1389388098, 1389388096, 1389388090, 1389387885, 1389387848] Looping around the photos to save general results len do output : 7 /1389388101.Didn't retrieve data . /1389388100.Didn't retrieve data . /1389388098.Didn't retrieve data . /1389388096.Didn't retrieve data . /1389388090.Didn't retrieve data . /1389387885.Didn't retrieve data . /1389387848.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388101', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388100', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388098', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388096', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388090', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389387885', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389387848', None, None, None, None, None, '3940179') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.03548097610473633 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.3772759437561035 time spend to save output : 0.03603339195251465 total time spend for step 5 : 0.41330933570861816 step6:blur_detection Tue Oct 14 13:43:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2.jpg resize: (2160, 3840) 1389388101 -6.846477717309053 treat image : temp/1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6.jpg resize: (2160, 3840) 1389388100 -6.96900747070261 treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333.jpg resize: (2160, 3840) 1389388098 -7.160179067739828 treat image : temp/1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284.jpg resize: (2160, 3840) 1389388096 -6.970641210018742 treat image : temp/1760442029_76524_1389388090_11c36232b51741c4ab998df4c3a04e09.jpg resize: (2160, 3840) 1389388090 -7.177133015972442 treat image : temp/1760442029_76524_1389387885_e5d680d9763c3d12174c1d79b23fd64e.jpg resize: (2160, 3840) 1389387885 -7.076357316206959 treat image : temp/1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8.jpg resize: (2160, 3840) 1389387848 -7.010191391729179 treat image : temp/1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544574_0.png resize: (363, 367) 1389399474 -4.231955752508908 treat image : temp/1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544569_0.png resize: (384, 203) 1389399475 -5.511632222969341 treat image : temp/1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544572_0.png resize: (427, 511) 1389399476 -5.742531513394778 treat image : temp/1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544565_0.png resize: (417, 449) 1389399477 -3.2026607075848603 treat image : temp/1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544564_0.png resize: (473, 375) 1389399478 -3.2853261367099194 treat image : temp/1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544570_0.png resize: (86, 156) 1389399479 -4.690171447273733 treat image : temp/1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544566_0.png resize: (273, 85) 1389399480 -4.498016499150232 treat image : temp/1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544573_0.png resize: (635, 584) 1389399481 -3.60984830844558 treat image : temp/1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544567_0.png resize: (164, 277) 1389399482 -4.011817876300579 treat image : temp/1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544580_0.png resize: (386, 357) 1389399483 -5.251402688380474 treat image : temp/1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544576_0.png resize: (121, 191) 1389399484 -4.729289565809326 treat image : temp/1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544575_0.png resize: (158, 262) 1389399485 -2.7976819604242484 treat image : temp/1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544582_0.png resize: (592, 361) 1389399486 -5.198187941256357 treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544596_0.png resize: (411, 330) 1389399487 -4.105188179646467 treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544587_0.png resize: (313, 115) 1389399488 -3.9083394170289996 treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544597_0.png resize: (103, 166) 1389399489 -4.186044180572813 treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544585_0.png resize: (108, 204) 1389399490 -3.7120173062554978 treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544589_0.png resize: (287, 359) 1389399491 -3.7426678481325917 treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544594_0.png resize: (423, 517) 1389399492 -5.260638148215666 treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544592_0.png resize: (153, 245) 1389399494 -4.662469726943338 treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544588_0.png resize: (102, 133) 1389399495 -4.107038298488949 treat image : temp/1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544602_0.png resize: (382, 316) 1389399496 -4.009910725999296 treat image : temp/1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544606_0.png resize: (245, 227) 1389399497 -4.646039219076579 treat image : temp/1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544611_0.png resize: (126, 188) 1389399498 -4.03571959262421 treat image : temp/1760442029_76524_1389388090_11c36232b51741c4ab998df4c3a04e09_rle_crop_3997544612_0.png resize: (590, 349) 1389399500 -2.872558613855192 treat image : temp/1760442029_76524_1389388090_11c36232b51741c4ab998df4c3a04e09_rle_crop_3997544614_0.png resize: (498, 427) 1389399501 -5.25686114701696 treat image : temp/1760442029_76524_1389388090_11c36232b51741c4ab998df4c3a04e09_rle_crop_3997544613_0.png resize: (334, 106) 1389399502 -3.4793569463429175 treat image : temp/1760442029_76524_1389388090_11c36232b51741c4ab998df4c3a04e09_rle_crop_3997544617_0.png resize: (271, 195) 1389399515 -4.533118601681024 treat image : temp/1760442029_76524_1389388090_11c36232b51741c4ab998df4c3a04e09_rle_crop_3997544615_0.png resize: (245, 203) 1389399528 -4.863093850393628 treat image : temp/1760442029_76524_1389387885_e5d680d9763c3d12174c1d79b23fd64e_rle_crop_3997544622_0.png resize: (283, 272) 1389399544 -4.627233617906636 treat image : temp/1760442029_76524_1389387885_e5d680d9763c3d12174c1d79b23fd64e_rle_crop_3997544621_0.png resize: (207, 201) 1389399557 -2.6447562037349264 treat image : temp/1760442029_76524_1389387885_e5d680d9763c3d12174c1d79b23fd64e_rle_crop_3997544620_0.png resize: (159, 221) 1389399559 -4.888160923772633 treat image : temp/1760442029_76524_1389387885_e5d680d9763c3d12174c1d79b23fd64e_rle_crop_3997544626_0.png resize: (629, 549) 1389399560 -4.0208027565117055 treat image : temp/1760442029_76524_1389387885_e5d680d9763c3d12174c1d79b23fd64e_rle_crop_3997544623_0.png resize: (165, 192) 1389399561 -5.059313517976365 treat image : temp/1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544628_0.png resize: (375, 192) 1389399562 -3.589250032527676 treat image : temp/1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544630_0.png resize: (222, 269) 1389399563 -3.3594626647011463 treat image : temp/1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544631_0.png resize: (234, 185) 1389399564 -3.6865809393162476 treat image : temp/1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544633_0.png resize: (172, 316) 1389399565 -5.186197982000877 treat image : temp/1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544627_0.png resize: (171, 168) 1389399566 -4.07995670259111 treat image : temp/1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544563_0.png resize: (220, 225) 1389399571 -3.3386161432043835 treat image : temp/1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544571_0.png resize: (156, 156) 1389399583 -2.519684254555504 treat image : temp/1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544568_0.png resize: (177, 288) 1389399591 -3.907051098666393 treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544586_0.png resize: (871, 628) 1389399592 -4.608587186001569 treat image : temp/1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544607_0.png resize: (247, 425) 1389399593 -5.0949553641219705 treat image : temp/1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544632_0.png resize: (504, 605) 1389399594 -3.56711431337478 treat image : temp/1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544581_0.png resize: (104, 104) 1389399613 -3.259402320375324 treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544593_0.png resize: (326, 178) 1389399614 -5.304708618459068 treat image : temp/1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544610_0.png resize: (190, 138) 1389399615 -4.346315555495561 treat image : temp/1760442029_76524_1389388090_11c36232b51741c4ab998df4c3a04e09_rle_crop_3997544618_0.png resize: (145, 214) 1389399616 -5.248228815748348 treat image : temp/1760442029_76524_1389387885_e5d680d9763c3d12174c1d79b23fd64e_rle_crop_3997544625_0.png resize: (171, 335) 1389399617 -5.532403804359329 treat image : temp/1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544635_0.png resize: (143, 141) 1389399618 -3.8749893749173774 treat image : temp/1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544578_0.png resize: (121, 265) 1389399636 -3.4947020158137656 treat image : temp/1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544579_0.png resize: (98, 120) 1389399637 -2.360255902636896 treat image : temp/1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544583_0.png resize: (435, 280) 1389399638 -4.607714238606858 treat image : temp/1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544577_0.png resize: (134, 270) 1389399639 -1.2352886384217998 treat image : temp/1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544584_0.png resize: (246, 216) 1389399640 -4.163890746385143 treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544599_0.png resize: (195, 183) 1389399641 -3.9583545185003888 treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544595_0.png resize: (214, 535) 1389399642 -3.604897507794602 treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544598_0.png resize: (230, 204) 1389399643 -3.832680671852215 treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544590_0.png resize: (296, 275) 1389399644 -4.53662770661291 treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544600_0.png resize: (261, 285) 1389399645 -4.302091897881798 treat image : temp/1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544605_0.png resize: (93, 120) 1389399646 -1.6434689624603263 treat image : temp/1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544603_0.png resize: (343, 354) 1389399647 -4.319878767304385 treat image : temp/1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544609_0.png resize: (480, 275) 1389399649 -5.033930359469025 treat image : temp/1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544604_0.png resize: (287, 443) 1389399650 -4.308284503278011 treat image : temp/1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544601_0.png resize: (502, 182) 1389399651 -4.463896434653891 treat image : temp/1760442029_76524_1389388090_11c36232b51741c4ab998df4c3a04e09_rle_crop_3997544616_0.png resize: (492, 238) 1389399652 -4.625660813583162 treat image : temp/1760442029_76524_1389387885_e5d680d9763c3d12174c1d79b23fd64e_rle_crop_3997544624_0.png resize: (84, 121) 1389399653 -3.263779159311428 treat image : temp/1760442029_76524_1389387885_e5d680d9763c3d12174c1d79b23fd64e_rle_crop_3997544619_0.png resize: (393, 467) 1389399654 -5.651503352449738 treat image : temp/1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544636_0.png resize: (426, 390) 1389399655 -5.342993601956804 treat image : temp/1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544637_0.png resize: (297, 267) 1389399656 -3.783962639784567 treat image : temp/1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544629_0.png resize: (227, 259) 1389399657 -5.002318085322952 treat image : temp/1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544634_0.png resize: (272, 295) 1389399659 -4.582069929798085 treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544591_0.png resize: (139, 107) 1389399782 -4.721721844674796 treat image : temp/1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544608_0.png resize: (283, 236) 1389399807 -4.885878548279387 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 82 time used for this insertion : 0.0387115478515625 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 82 time used for this insertion : 0.03852987289428711 save missing photos in datou_result : time spend for datou_step_exec : 27.172560453414917 time spend to save output : 0.09456801414489746 total time spend for step 6 : 27.267128467559814 step7:brightness Tue Oct 14 13:43:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2.jpg treat image : temp/1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6.jpg treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333.jpg treat image : temp/1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284.jpg treat image : temp/1760442029_76524_1389388090_11c36232b51741c4ab998df4c3a04e09.jpg treat image : temp/1760442029_76524_1389387885_e5d680d9763c3d12174c1d79b23fd64e.jpg treat image : temp/1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8.jpg treat image : temp/1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544574_0.png treat image : temp/1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544569_0.png treat image : temp/1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544572_0.png treat image : temp/1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544565_0.png treat image : temp/1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544564_0.png treat image : temp/1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544570_0.png treat image : temp/1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544566_0.png treat image : temp/1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544573_0.png treat image : temp/1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544567_0.png treat image : temp/1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544580_0.png treat image : temp/1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544576_0.png treat image : temp/1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544575_0.png treat image : temp/1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544582_0.png treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544596_0.png treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544587_0.png treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544597_0.png treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544585_0.png treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544589_0.png treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544594_0.png treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544592_0.png treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544588_0.png treat image : temp/1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544602_0.png treat image : temp/1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544606_0.png treat image : temp/1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544611_0.png treat image : temp/1760442029_76524_1389388090_11c36232b51741c4ab998df4c3a04e09_rle_crop_3997544612_0.png treat image : temp/1760442029_76524_1389388090_11c36232b51741c4ab998df4c3a04e09_rle_crop_3997544614_0.png treat image : temp/1760442029_76524_1389388090_11c36232b51741c4ab998df4c3a04e09_rle_crop_3997544613_0.png treat image : temp/1760442029_76524_1389388090_11c36232b51741c4ab998df4c3a04e09_rle_crop_3997544617_0.png treat image : temp/1760442029_76524_1389388090_11c36232b51741c4ab998df4c3a04e09_rle_crop_3997544615_0.png treat image : temp/1760442029_76524_1389387885_e5d680d9763c3d12174c1d79b23fd64e_rle_crop_3997544622_0.png treat image : temp/1760442029_76524_1389387885_e5d680d9763c3d12174c1d79b23fd64e_rle_crop_3997544621_0.png treat image : temp/1760442029_76524_1389387885_e5d680d9763c3d12174c1d79b23fd64e_rle_crop_3997544620_0.png treat image : temp/1760442029_76524_1389387885_e5d680d9763c3d12174c1d79b23fd64e_rle_crop_3997544626_0.png treat image : temp/1760442029_76524_1389387885_e5d680d9763c3d12174c1d79b23fd64e_rle_crop_3997544623_0.png treat image : temp/1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544628_0.png treat image : temp/1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544630_0.png treat image : temp/1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544631_0.png treat image : temp/1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544633_0.png treat image : temp/1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544627_0.png treat image : temp/1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544563_0.png treat image : temp/1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544571_0.png treat image : temp/1760442029_76524_1389388101_c557c1858d8b012279f102e12dc019d2_rle_crop_3997544568_0.png treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544586_0.png treat image : temp/1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544607_0.png treat image : temp/1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544632_0.png treat image : temp/1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544581_0.png treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544593_0.png treat image : temp/1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544610_0.png treat image : temp/1760442029_76524_1389388090_11c36232b51741c4ab998df4c3a04e09_rle_crop_3997544618_0.png treat image : temp/1760442029_76524_1389387885_e5d680d9763c3d12174c1d79b23fd64e_rle_crop_3997544625_0.png treat image : temp/1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544635_0.png treat image : temp/1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544578_0.png treat image : temp/1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544579_0.png treat image : temp/1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544583_0.png treat image : temp/1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544577_0.png treat image : temp/1760442029_76524_1389388100_aed2d126f3405fb9e46590fe4cf219b6_rle_crop_3997544584_0.png treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544599_0.png treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544595_0.png treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544598_0.png treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544590_0.png treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544600_0.png treat image : temp/1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544605_0.png treat image : temp/1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544603_0.png treat image : temp/1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544609_0.png treat image : temp/1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544604_0.png treat image : temp/1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544601_0.png treat image : temp/1760442029_76524_1389388090_11c36232b51741c4ab998df4c3a04e09_rle_crop_3997544616_0.png treat image : temp/1760442029_76524_1389387885_e5d680d9763c3d12174c1d79b23fd64e_rle_crop_3997544624_0.png treat image : temp/1760442029_76524_1389387885_e5d680d9763c3d12174c1d79b23fd64e_rle_crop_3997544619_0.png treat image : temp/1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544636_0.png treat image : temp/1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544637_0.png treat image : temp/1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544629_0.png treat image : temp/1760442029_76524_1389387848_86d46cbb1d9c62478770f99abfc329f8_rle_crop_3997544634_0.png treat image : temp/1760442029_76524_1389388098_a4a7b6aa8b2f8475b679f767d6ccc333_rle_crop_3997544591_0.png treat image : temp/1760442029_76524_1389388096_bb3df0d037cf0316cad6b00ef79d5284_rle_crop_3997544608_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 82 time used for this insertion : 0.04076743125915527 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 82 time used for this insertion : 0.03908538818359375 save missing photos in datou_result : time spend for datou_step_exec : 6.913225173950195 time spend to save output : 0.09724044799804688 total time spend for step 7 : 7.010465621948242 step8:velours_tree Tue Oct 14 13:43:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.15823006629943848 time spend to save output : 3.933906555175781e-05 total time spend for step 8 : 0.15826940536499023 step9:send_mail_cod Tue Oct 14 13:43:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P27796154_14-10-2025_13_43_52.pdf 27796386 imagette277963861760442232 27796387 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette277963871760442232 27796388 imagette277963881760442234 27796389 imagette277963891760442234 27796390 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette277963901760442234 27796391 change filename to text .imagette277963911760442235 27796392 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette277963921760442235 27796393 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette277963931760442237 27796394 change filename to text .imagette277963941760442238 27796395 imagette277963951760442238 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=27796154 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/27796385,27796386,27796387,27796388,27796389,27796390,27796391,27796392,27796393,27796394,27796395?tags=environnement,flou,pet_clair,pehd,mal_croppe,metal,autre,papier,carton,pet_fonce,background args[1389388101] : ((1389388101, -6.846477717309053, 492609224), (1389388101, 0.18329629937447772, 2107752395), '0.07747254602072311') We are sending mail with results at report@fotonower.com args[1389388100] : ((1389388100, -6.96900747070261, 492609224), (1389388100, 0.3165785565710339, 2107752395), '0.07747254602072311') We are sending mail with results at report@fotonower.com args[1389388098] : ((1389388098, -7.160179067739828, 492609224), (1389388098, 0.27053283967986835, 2107752395), '0.07747254602072311') We are sending mail with results at report@fotonower.com args[1389388096] : ((1389388096, -6.970641210018742, 492609224), (1389388096, 0.18600553621530902, 2107752395), '0.07747254602072311') We are sending mail with results at report@fotonower.com args[1389388090] : ((1389388090, -7.177133015972442, 492609224), (1389388090, 0.2975526500007457, 2107752395), '0.07747254602072311') We are sending mail with results at report@fotonower.com args[1389387885] : ((1389387885, -7.076357316206959, 492609224), (1389387885, 0.27258258537662605, 2107752395), '0.07747254602072311') We are sending mail with results at report@fotonower.com args[1389387848] : ((1389387848, -7.010191391729179, 492609224), (1389387848, 0.23190458309732612, 2107752395), '0.07747254602072311') We are sending mail with results at report@fotonower.com refus_total : 0.07747254602072311 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=27796154 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27796154_14-10-2025_13_43_52.pdf results_Auto_P27796154_14-10-2025_13_43_52.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27796154_14-10-2025_13_43_52.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','27796154','results_Auto_P27796154_14-10-2025_13_43_52.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27796154_14-10-2025_13_43_52.pdf','pdf','','0.66','0.07747254602072311') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/27796154

https://www.fotonower.com/image?json=false&list_photos_id=1389388101
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389388100
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389388098
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389388096
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389388090
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389387885
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1389387848
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 7.75%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/27796387?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/27796390?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/27796391?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/27796392?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/27796393?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/27796394?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27796154_14-10-2025_13_43_52.pdf.

Lien vers velours :https://marlene.fotonower.com/velours/27796385,27796386,27796387,27796388,27796389,27796390,27796391,27796392,27796393,27796394,27796395?tags=environnement,flou,pet_clair,pehd,mal_croppe,metal,autre,papier,carton,pet_fonce,background.


L'équipe Fotonower 202 b'' Server: nginx Date: Tue, 14 Oct 2025 11:44:02 GMT Content-Length: 0 Connection: close X-Message-Id: Vsh-AZekRi2tJnCGMAQeZQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1389388101, 1389388100, 1389388098, 1389388096, 1389388090, 1389387885, 1389387848] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388101', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388100', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388098', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388096', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388090', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389387885', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389387848', None, None, None, None, None, '3940179') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.03531622886657715 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.198159456253052 time spend to save output : 0.03556227684020996 total time spend for step 9 : 10.233721733093262 step10:split_time_score Tue Oct 14 13:44:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('12', 7),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 14102025 27796154 Nombre de photos uploadées : 7 / 23040 (0%) 14102025 27796154 Nombre de photos taguées (types de déchets): 0 / 7 (0%) 14102025 27796154 Nombre de photos taguées (volume) : 0 / 7 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 5.9604644775390625e-06 ??????? elapsed_time : fill_and_build_computed_from_old_data 0.0004177093505859375 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.6430683135986328 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.012213108730269363 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27783603_14-10-2025_07_21_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27783603 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27783603 AND mptpi.`type`=3726 To do Qualite : 0.016011342777948114 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27783624_14-10-2025_07_26_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27783624 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27783624 AND mptpi.`type`=3726 To do Qualite : 0.03147167769897415 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27783639_14-10-2025_07_33_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27783639 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27783639 AND mptpi.`type`=3726 To do Qualite : 0.03959074831389489 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27783669_14-10-2025_07_27_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27783669 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27783669 AND mptpi.`type`=3726 To do Qualite : 0.06589188402502202 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27783676_14-10-2025_07_16_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27783676 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27783676 AND mptpi.`type`=3594 To do Qualite : 0.03876937297793143 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27783703_14-10-2025_07_12_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27783703 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27783703 AND mptpi.`type`=3726 To do Qualite : 0.020589842022130874 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27796151_14-10-2025_13_42_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27796151 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27796151 AND mptpi.`type`=3726 To do Qualite : 0.023398349130290635 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27793995_14-10-2025_12_17_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27793995 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27793995 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27795187 order by id desc limit 1 Qualite : 0.08800531511794533 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27795188_14-10-2025_12_45_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27795188 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27795188 AND mptpi.`type`=3594 To do Qualite : 0.07747254602072311 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27796154_14-10-2025_13_43_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27796154 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27796154 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'14102025': {'nb_upload': 7, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1389388101, 1389388100, 1389388098, 1389388096, 1389388090, 1389387885, 1389387848] Looping around the photos to save general results len do output : 1 /27796154Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388101', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388100', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388098', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388096', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389388090', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389387885', None, None, None, None, None, '3940179') ('3318', None, None, None, None, None, None, None, '3940179') ('3318', '27796154', '1389387848', None, None, None, None, None, '3940179') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.04054617881774902 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.01161003112793 time spend to save output : 0.041217803955078125 total time spend for step 10 : 4.052827835083008 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 7 set_done_treatment 96.22user 71.43system 3:42.50elapsed 75%CPU (0avgtext+0avgdata 4472816maxresident)k 519320inputs+103128outputs (8709major+9623534minor)pagefaults 0swaps