python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3909803 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4329239'] with mtr_portfolio_ids : ['30095678'] and first list_photo_ids : [] new path : /proc/3909803/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 13 ; length of list_pids : 13 ; length of list_args : 13 time to download the photos : 2.2028374671936035 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon Jan 12 22:40:32 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10605 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2026-01-12 22:40:35.475423: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2026-01-12 22:40:35.506413: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2026-01-12 22:40:35.508414: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f6bf4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2026-01-12 22:40:35.508460: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2026-01-12 22:40:35.512842: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2026-01-12 22:40:35.726736: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2eafcdf0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2026-01-12 22:40:35.726791: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2026-01-12 22:40:35.728588: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-12 22:40:35.728998: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-12 22:40:35.731798: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-12 22:40:35.735276: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-12 22:40:35.735635: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-12 22:40:35.739355: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-12 22:40:35.740924: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-12 22:40:35.763379: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-12 22:40:35.766227: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-12 22:40:35.766724: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-12 22:40:35.768341: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-12 22:40:35.768372: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-12 22:40:35.768391: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-12 22:40:35.771661: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9826 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2026-01-12 22:40:36.050675: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-12 22:40:36.050764: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-12 22:40:36.050788: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-12 22:40:36.050809: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-12 22:40:36.050830: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-12 22:40:36.050850: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-12 22:40:36.050870: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-12 22:40:36.050890: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-12 22:40:36.052446: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-12 22:40:36.053673: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-12 22:40:36.053709: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-12 22:40:36.053728: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-12 22:40:36.053746: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-12 22:40:36.053763: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-12 22:40:36.053780: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-12 22:40:36.053797: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-12 22:40:36.053815: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-12 22:40:36.055413: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-12 22:40:36.055446: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-12 22:40:36.055457: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-12 22:40:36.055466: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-12 22:40:36.056783: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9826 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2026-01-12 22:40:47.804128: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-12 22:40:48.006144: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 Detection mask done ! Trying to reset tf kernel 3910514 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5316 tf kernel not reseted sub process len(results) : 13 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 13 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10605 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [1986, 1566, 2154, 1788] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006351470947265625 nb_pixel_total : 25391 time to create 1 rle with old method : 0.027980804443359375 length of segment : 165 DEBUG bbox = [438, 1098, 900, 1512] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0023250579833984375 nb_pixel_total : 94436 time to create 1 rle with old method : 0.10143446922302246 length of segment : 407 DEBUG bbox = [1074, 1122, 1482, 1830] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004580259323120117 nb_pixel_total : 177592 time to create 1 rle with new method : 0.009179115295410156 length of segment : 465 DEBUG bbox = [492, 2736, 648, 2892] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003020763397216797 nb_pixel_total : 19740 time to create 1 rle with old method : 0.021343708038330078 length of segment : 148 DEBUG bbox = [606, 552, 834, 744] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005369186401367188 nb_pixel_total : 25113 time to create 1 rle with old method : 0.027779579162597656 length of segment : 225 DEBUG bbox = [756, 3078, 948, 3234] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0001976490020751953 nb_pixel_total : 1541 time to create 1 rle with old method : 0.001794576644897461 length of segment : 84 DEBUG bbox = [1626, 2880, 1830, 3138] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00040721893310546875 nb_pixel_total : 20620 time to create 1 rle with old method : 0.02270364761352539 length of segment : 189 DEBUG bbox = [192, 2118, 648, 2550] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00146484375 nb_pixel_total : 118756 time to create 1 rle with old method : 0.13049864768981934 length of segment : 427 DEBUG bbox = [1680, 1524, 1890, 1704] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004162788391113281 nb_pixel_total : 15529 time to create 1 rle with old method : 0.03142666816711426 length of segment : 186 DEBUG bbox = [300, 348, 498, 444] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002548694610595703 nb_pixel_total : 10651 time to create 1 rle with old method : 0.017616748809814453 length of segment : 183 DEBUG bbox = [1524, 1164, 1728, 1386] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00036835670471191406 nb_pixel_total : 17764 time to create 1 rle with old method : 0.019634723663330078 length of segment : 178 DEBUG bbox = [330, 1896, 600, 2154] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005338191986083984 nb_pixel_total : 28352 time to create 1 rle with old method : 0.030633211135864258 length of segment : 248 DEBUG bbox = [1146, 1014, 1386, 1218] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003566741943359375 nb_pixel_total : 19147 time to create 1 rle with old method : 0.02054452896118164 length of segment : 204 DEBUG bbox = [2046, 2268, 2148, 2394] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0001552104949951172 nb_pixel_total : 9794 time to create 1 rle with old method : 0.010869979858398438 length of segment : 95 DEBUG bbox = [894, 1578, 1080, 1662] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00018668174743652344 nb_pixel_total : 10569 time to create 1 rle with old method : 0.012102603912353516 length of segment : 174 DEBUG bbox = [1830, 1596, 1980, 1698] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00017142295837402344 nb_pixel_total : 8825 time to create 1 rle with old method : 0.015398740768432617 length of segment : 146 DEBUG bbox = [894, 462, 1032, 588] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0001976490020751953 nb_pixel_total : 10881 time to create 1 rle with old method : 0.014440536499023438 length of segment : 128 DEBUG bbox = [150, 1212, 372, 1500] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006632804870605469 nb_pixel_total : 40351 time to create 1 rle with old method : 0.045325279235839844 length of segment : 226 DEBUG bbox = [690, 636, 1170, 1128] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0022890567779541016 nb_pixel_total : 135287 time to create 1 rle with old method : 0.1640334129333496 length of segment : 447 DEBUG bbox = [96, 1752, 432, 2166] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001131296157836914 nb_pixel_total : 57100 time to create 1 rle with old method : 0.07077479362487793 length of segment : 316 DEBUG bbox = [1410, 1764, 1656, 1956] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005259513854980469 nb_pixel_total : 30669 time to create 1 rle with old method : 0.038106441497802734 length of segment : 204 DEBUG bbox = [1728, 1662, 1956, 1854] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003914833068847656 nb_pixel_total : 23817 time to create 1 rle with old method : 0.034326791763305664 length of segment : 216 DEBUG bbox = [42, 888, 420, 1122] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001110076904296875 nb_pixel_total : 55637 time to create 1 rle with old method : 0.06263899803161621 length of segment : 372 DEBUG bbox = [1572, 1338, 2070, 1668] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0022306442260742188 nb_pixel_total : 112474 time to create 1 rle with old method : 0.12638497352600098 length of segment : 460 DEBUG bbox = [2052, 1260, 2154, 1524] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004475116729736328 nb_pixel_total : 19257 time to create 1 rle with old method : 0.0236203670501709 length of segment : 93 DEBUG bbox = [306, 2490, 888, 2856] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002489328384399414 nb_pixel_total : 101472 time to create 1 rle with old method : 0.11131477355957031 length of segment : 554 DEBUG bbox = [1674, 2472, 2094, 2946] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0024166107177734375 nb_pixel_total : 138246 time to create 1 rle with old method : 0.15377378463745117 length of segment : 408 DEBUG bbox = [42, 2820, 594, 3684] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.011059284210205078 nb_pixel_total : 269796 time to create 1 rle with new method : 0.01563739776611328 length of segment : 536 DEBUG bbox = [1038, 1800, 1194, 1956] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00023627281188964844 nb_pixel_total : 11857 time to create 1 rle with old method : 0.013253927230834961 length of segment : 135 DEBUG bbox = [0, 240, 438, 768] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0021448135375976562 nb_pixel_total : 113925 time to create 1 rle with old method : 0.12115097045898438 length of segment : 500 DEBUG bbox = [18, 1608, 96, 1830] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00021767616271972656 nb_pixel_total : 9914 time to create 1 rle with old method : 0.01111745834350586 length of segment : 72 DEBUG bbox = [1344, 1170, 1752, 1488] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009751319885253906 nb_pixel_total : 49905 time to create 1 rle with old method : 0.054390907287597656 length of segment : 371 DEBUG bbox = [6, 1476, 102, 1650] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00016808509826660156 nb_pixel_total : 8979 time to create 1 rle with old method : 0.00982213020324707 length of segment : 92 DEBUG bbox = [2040, 1650, 2154, 1890] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00031876564025878906 nb_pixel_total : 20586 time to create 1 rle with old method : 0.02222132682800293 length of segment : 113 DEBUG bbox = [1692, 1968, 1890, 2190] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00040411949157714844 nb_pixel_total : 15692 time to create 1 rle with old method : 0.016865015029907227 length of segment : 171 DEBUG bbox = [330, 1452, 726, 1800] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010769367218017578 nb_pixel_total : 81325 time to create 1 rle with old method : 0.08793354034423828 length of segment : 355 DEBUG bbox = [1908, 474, 2088, 696] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003783702850341797 nb_pixel_total : 19093 time to create 1 rle with old method : 0.020450115203857422 length of segment : 227 DEBUG bbox = [1938, 624, 2148, 864] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00046753883361816406 nb_pixel_total : 26270 time to create 1 rle with old method : 0.028070449829101562 length of segment : 250 DEBUG bbox = [1488, 1644, 1626, 1788] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00021648406982421875 nb_pixel_total : 12465 time to create 1 rle with old method : 0.013335943222045898 length of segment : 129 DEBUG bbox = [552, 2526, 762, 2724] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00036835670471191406 nb_pixel_total : 26867 time to create 1 rle with old method : 0.028289079666137695 length of segment : 206 DEBUG bbox = [1842, 1878, 1956, 1998] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0001544952392578125 nb_pixel_total : 7837 time to create 1 rle with old method : 0.00844264030456543 length of segment : 98 DEBUG bbox = [258, 2748, 432, 2910] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004963874816894531 nb_pixel_total : 15266 time to create 1 rle with old method : 0.016109943389892578 length of segment : 175 DEBUG bbox = [1362, 1938, 1896, 2406] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0031807422637939453 nb_pixel_total : 109587 time to create 1 rle with old method : 0.11847519874572754 length of segment : 519 DEBUG bbox = [1488, 486, 1896, 1056] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0029921531677246094 nb_pixel_total : 110465 time to create 1 rle with old method : 0.11359500885009766 length of segment : 361 DEBUG bbox = [1902, 1050, 2148, 1416] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014085769653320312 nb_pixel_total : 67068 time to create 1 rle with old method : 0.07105493545532227 length of segment : 229 DEBUG bbox = [1788, 2040, 2154, 2376] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001375436782836914 nb_pixel_total : 41901 time to create 1 rle with old method : 0.04526782035827637 length of segment : 328 DEBUG bbox = [204, 696, 498, 942] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001096963882446289 nb_pixel_total : 28785 time to create 1 rle with old method : 0.03105950355529785 length of segment : 266 DEBUG bbox = [1638, 1470, 1746, 1608] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003161430358886719 nb_pixel_total : 8780 time to create 1 rle with old method : 0.009665966033935547 length of segment : 103 DEBUG bbox = [1476, 510, 1884, 1032] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015630722045898438 nb_pixel_total : 114925 time to create 1 rle with old method : 0.11940169334411621 length of segment : 367 DEBUG bbox = [1050, 2526, 1854, 3066] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.005817413330078125 nb_pixel_total : 299764 time to create 1 rle with new method : 0.012529373168945312 length of segment : 723 DEBUG bbox = [1080, 768, 1200, 990] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005087852478027344 nb_pixel_total : 19623 time to create 1 rle with old method : 0.02114391326904297 length of segment : 114 DEBUG bbox = [1596, 1386, 2076, 2172] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00388336181640625 nb_pixel_total : 174703 time to create 1 rle with new method : 0.009601593017578125 length of segment : 373 DEBUG bbox = [1998, 1434, 2154, 1650] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004487037658691406 nb_pixel_total : 21043 time to create 1 rle with old method : 0.022801876068115234 length of segment : 150 DEBUG bbox = [870, 1530, 1146, 1890] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001271963119506836 nb_pixel_total : 48436 time to create 1 rle with old method : 0.05049538612365723 length of segment : 239 DEBUG bbox = [1056, 1722, 1440, 2016] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012178421020507812 nb_pixel_total : 33720 time to create 1 rle with old method : 0.03641009330749512 length of segment : 354 DEBUG bbox = [1776, 534, 2160, 1320] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00394129753112793 nb_pixel_total : 226657 time to create 1 rle with new method : 0.008537054061889648 length of segment : 376 DEBUG bbox = [108, 1164, 474, 1590] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00215911865234375 nb_pixel_total : 96261 time to create 1 rle with old method : 0.10171699523925781 length of segment : 334 DEBUG bbox = [84, 498, 384, 696] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010571479797363281 nb_pixel_total : 45490 time to create 1 rle with old method : 0.04881858825683594 length of segment : 352 DEBUG bbox = [1848, 342, 1992, 504] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003609657287597656 nb_pixel_total : 16363 time to create 1 rle with old method : 0.01838088035583496 length of segment : 130 DEBUG bbox = [2052, 1524, 2148, 1818] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004100799560546875 nb_pixel_total : 15816 time to create 1 rle with old method : 0.017165184020996094 length of segment : 88 DEBUG bbox = [444, 126, 708, 312] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007863044738769531 nb_pixel_total : 23108 time to create 1 rle with old method : 0.024574756622314453 length of segment : 226 DEBUG bbox = [732, 2844, 1512, 3156] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003398895263671875 nb_pixel_total : 103626 time to create 1 rle with old method : 0.11011147499084473 length of segment : 765 DEBUG bbox = [6, 2808, 180, 2964] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006558895111083984 nb_pixel_total : 17246 time to create 1 rle with old method : 0.028043508529663086 length of segment : 159 DEBUG bbox = [1746, 1368, 1950, 1530] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005247592926025391 nb_pixel_total : 16168 time to create 1 rle with old method : 0.020647764205932617 length of segment : 189 DEBUG bbox = [1230, 2784, 1308, 2886] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00018215179443359375 nb_pixel_total : 3353 time to create 1 rle with old method : 0.003757476806640625 length of segment : 53 DEBUG bbox = [6, 2892, 240, 3186] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009016990661621094 nb_pixel_total : 46463 time to create 1 rle with old method : 0.049233436584472656 length of segment : 230 DEBUG bbox = [84, 234, 378, 876] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0019223690032958984 nb_pixel_total : 74596 time to create 1 rle with old method : 0.08041238784790039 length of segment : 295 DEBUG bbox = [738, 60, 996, 294] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008587837219238281 nb_pixel_total : 29723 time to create 1 rle with old method : 0.03124380111694336 length of segment : 241 DEBUG bbox = [6, 1362, 90, 1488] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00022220611572265625 nb_pixel_total : 7193 time to create 1 rle with old method : 0.008091449737548828 length of segment : 77 DEBUG bbox = [2040, 1398, 2148, 1638] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00042128562927246094 nb_pixel_total : 17118 time to create 1 rle with old method : 0.019266605377197266 length of segment : 105 DEBUG bbox = [552, 2526, 720, 2634] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003981590270996094 nb_pixel_total : 9436 time to create 1 rle with old method : 0.010396957397460938 length of segment : 149 DEBUG bbox = [702, 2766, 1050, 3042] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014863014221191406 nb_pixel_total : 54078 time to create 1 rle with old method : 0.0573732852935791 length of segment : 304 DEBUG bbox = [474, 2010, 882, 2292] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016641616821289062 nb_pixel_total : 56947 time to create 1 rle with old method : 0.060333967208862305 length of segment : 328 DEBUG bbox = [882, 1968, 1272, 2268] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017631053924560547 nb_pixel_total : 70536 time to create 1 rle with old method : 0.07450985908508301 length of segment : 372 DEBUG bbox = [660, 2634, 954, 2826] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006661415100097656 nb_pixel_total : 35094 time to create 1 rle with old method : 0.03659534454345703 length of segment : 296 DEBUG bbox = [96, 1722, 576, 2202] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0034804344177246094 nb_pixel_total : 133252 time to create 1 rle with old method : 0.13921380043029785 length of segment : 463 DEBUG bbox = [348, 1236, 636, 1590] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013508796691894531 nb_pixel_total : 47085 time to create 1 rle with old method : 0.05067181587219238 length of segment : 279 DEBUG bbox = [1320, 564, 1656, 1122] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002454519271850586 nb_pixel_total : 103417 time to create 1 rle with old method : 0.1107175350189209 length of segment : 386 DEBUG bbox = [450, 1434, 810, 1890] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018353462219238281 nb_pixel_total : 104927 time to create 1 rle with old method : 0.10961699485778809 length of segment : 345 DEBUG bbox = [78, 1056, 402, 1500] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0019207000732421875 nb_pixel_total : 67206 time to create 1 rle with old method : 0.07252264022827148 length of segment : 316 DEBUG bbox = [1248, 1248, 1386, 1386] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00045561790466308594 nb_pixel_total : 14712 time to create 1 rle with old method : 0.016620635986328125 length of segment : 130 DEBUG bbox = [1260, 2112, 1386, 2226] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00034880638122558594 nb_pixel_total : 6034 time to create 1 rle with old method : 0.0068285465240478516 length of segment : 99 DEBUG bbox = [162, 1362, 480, 1638] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006768703460693359 nb_pixel_total : 51477 time to create 1 rle with old method : 0.05460166931152344 length of segment : 277 DEBUG bbox = [1944, 738, 2118, 972] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006923675537109375 nb_pixel_total : 24688 time to create 1 rle with old method : 0.02648138999938965 length of segment : 172 DEBUG bbox = [354, 1056, 666, 1284] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008702278137207031 nb_pixel_total : 35131 time to create 1 rle with old method : 0.03889322280883789 length of segment : 259 DEBUG bbox = [1302, 462, 1494, 708] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005228519439697266 nb_pixel_total : 25828 time to create 1 rle with old method : 0.028096437454223633 length of segment : 188 DEBUG bbox = [1740, 1644, 2106, 2190] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0024297237396240234 nb_pixel_total : 99853 time to create 1 rle with old method : 0.10816645622253418 length of segment : 317 DEBUG bbox = [1080, 2790, 1308, 2952] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007472038269042969 nb_pixel_total : 24696 time to create 1 rle with old method : 0.026871442794799805 length of segment : 208 DEBUG bbox = [1896, 2250, 2142, 2394] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005381107330322266 nb_pixel_total : 21132 time to create 1 rle with old method : 0.023119449615478516 length of segment : 245 DEBUG bbox = [1722, 2328, 2070, 2622] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011148452758789062 nb_pixel_total : 53879 time to create 1 rle with old method : 0.05701613426208496 length of segment : 289 DEBUG bbox = [12, 1746, 192, 1866] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004596710205078125 nb_pixel_total : 15169 time to create 1 rle with old method : 0.01687765121459961 length of segment : 176 DEBUG bbox = [1842, 618, 2112, 798] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000911712646484375 nb_pixel_total : 34614 time to create 1 rle with old method : 0.03791689872741699 length of segment : 260 time spent for convertir_results : 7.6458821296691895 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 92 chid ids of type : 3594 Number RLEs to save : 23982 save missing photos in datou_result : time spend for datou_step_exec : 68.91895484924316 time spend to save output : 1.4386892318725586 total time spend for step 1 : 70.35764408111572 step2:crop_condition Mon Jan 12 22:41:42 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 13 ! batch 1 Loaded 92 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 39 About to insert : list_path_to_insert length 39 new photo from crops ! About to upload 39 photos upload in portfolio : 3736932 init cache_photo without model_param we have 39 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768254114_3909803 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548945_e5e4f7ecb119b96b69102ca5c32592d5_rle_crop_4098166412_0.png', 0, 213, 163, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548945_e5e4f7ecb119b96b69102ca5c32592d5_rle_crop_4098166413_0.png', 0, 373, 407, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548945_e5e4f7ecb119b96b69102ca5c32592d5_rle_crop_4098166414_0.png', 0, 694, 358, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548945_e5e4f7ecb119b96b69102ca5c32592d5_rle_crop_4098166418_0.png', 0, 164, 189, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548944_276f57037a611f4eb39e2b5b7f9dd2e2_rle_crop_4098166419_0.png', 0, 407, 420, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548944_276f57037a611f4eb39e2b5b7f9dd2e2_rle_crop_4098166420_0.png', 0, 176, 186, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548944_276f57037a611f4eb39e2b5b7f9dd2e2_rle_crop_4098166422_0.png', 0, 214, 178, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548944_276f57037a611f4eb39e2b5b7f9dd2e2_rle_crop_4098166424_0.png', 0, 182, 200, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548942_3264e66189ae77d5b845965673be0613_rle_crop_4098166426_0.png', 0, 79, 171, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548942_3264e66189ae77d5b845965673be0613_rle_crop_4098166427_0.png', 0, 83, 146, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548942_3264e66189ae77d5b845965673be0613_rle_crop_4098166430_0.png', 0, 433, 447, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548942_3264e66189ae77d5b845965673be0613_rle_crop_4098166432_0.png', 0, 173, 203, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548942_3264e66189ae77d5b845965673be0613_rle_crop_4098166433_0.png', 0, 159, 207, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548934_6e6cd27f6a4c2986b7f70b5c197260df_rle_crop_4098166435_0.png', 0, 308, 445, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548934_6e6cd27f6a4c2986b7f70b5c197260df_rle_crop_4098166436_0.png', 0, 256, 89, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548932_528fef84dc5fbd36efdee269547aa665_rle_crop_4098166440_0.png', 0, 149, 135, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548932_528fef84dc5fbd36efdee269547aa665_rle_crop_4098166441_0.png', 0, 491, 422, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548932_528fef84dc5fbd36efdee269547aa665_rle_crop_4098166443_0.png', 0, 264, 371, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472_rle_crop_4098166445_0.png', 0, 237, 113, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472_rle_crop_4098166446_0.png', 0, 215, 171, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472_rle_crop_4098166448_0.png', 0, 185, 164, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472_rle_crop_4098166449_0.png', 0, 209, 202, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548930_535ca58a5b98a07451a9a0456061bc20_rle_crop_4098166456_0.png', 0, 363, 229, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548930_535ca58a5b98a07451a9a0456061bc20_rle_crop_4098166457_0.png', 0, 321, 317, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548930_535ca58a5b98a07451a9a0456061bc20_rle_crop_4098166459_0.png', 0, 119, 102, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548929_ae4772afe0a85289c639fb7f97a55286_rle_crop_4098166465_0.png', 0, 277, 232, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548929_ae4772afe0a85289c639fb7f97a55286_rle_crop_4098166466_0.png', 0, 253, 381, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548928_680b23a412ab1e6f95a56ca184578926_rle_crop_4098166469_0.png', 0, 180, 299, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548928_680b23a412ab1e6f95a56ca184578926_rle_crop_4098166471_0.png', 0, 272, 88, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548926_cb0353b5c44378745289a7b2505c38c7_rle_crop_4098166475_0.png', 0, 145, 189, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548926_cb0353b5c44378745289a7b2505c38c7_rle_crop_4098166476_0.png', 0, 98, 47, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548926_cb0353b5c44378745289a7b2505c38c7_rle_crop_4098166481_0.png', 0, 235, 105, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548924_f8fc0e79a9f0e8748d958d767ae64047_rle_crop_4098166484_0.png', 0, 258, 322, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166487_0.png', 0, 455, 463, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166493_0.png', 0, 96, 99, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166494_0.png', 0, 269, 277, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548866_79f0da4a15982fa551a58abef9e0fb15_rle_crop_4098166500_0.png', 0, 103, 245, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548866_79f0da4a15982fa551a58abef9e0fb15_rle_crop_4098166501_0.png', 0, 289, 289, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254121), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548866_79f0da4a15982fa551a58abef9e0fb15_rle_crop_4098166502_0.png', 0, 109, 173, 0, 1768254121,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 39 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.179713726043701 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 10 About to insert : list_path_to_insert length 10 new photo from crops ! About to upload 10 photos upload in portfolio : 3736932 init cache_photo without model_param we have 10 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768254126_3909803 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254128), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548945_e5e4f7ecb119b96b69102ca5c32592d5_rle_crop_4098166416_0.png', 0, 192, 225, 0, 1768254128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254128), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548945_e5e4f7ecb119b96b69102ca5c32592d5_rle_crop_4098166417_0.png', 0, 55, 84, 0, 1768254128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254128), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548944_276f57037a611f4eb39e2b5b7f9dd2e2_rle_crop_4098166421_0.png', 0, 82, 183, 0, 1768254128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254128), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548944_276f57037a611f4eb39e2b5b7f9dd2e2_rle_crop_4098166423_0.png', 0, 213, 248, 0, 1768254128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254128), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548932_528fef84dc5fbd36efdee269547aa665_rle_crop_4098166437_0.png', 0, 341, 531, 0, 1768254128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254128), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472_rle_crop_4098166451_0.png', 0, 188, 206, 0, 1768254128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254128), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548930_535ca58a5b98a07451a9a0456061bc20_rle_crop_4098166458_0.png', 0, 171, 250, 0, 1768254128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254128), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548929_ae4772afe0a85289c639fb7f97a55286_rle_crop_4098166462_0.png', 0, 218, 114, 0, 1768254128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254128), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548928_680b23a412ab1e6f95a56ca184578926_rle_crop_4098166472_0.png', 0, 162, 226, 0, 1768254128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254128), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548924_f8fc0e79a9f0e8748d958d767ae64047_rle_crop_4098166485_0.png', 0, 277, 372, 0, 1768254128,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 10 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.547560214996338 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! About to upload 12 photos upload in portfolio : 3736932 init cache_photo without model_param we have 12 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768254132_3909803 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254134), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548945_e5e4f7ecb119b96b69102ca5c32592d5_rle_crop_4098166415_0.png', 0, 154, 148, 0, 1768254134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254134), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548944_276f57037a611f4eb39e2b5b7f9dd2e2_rle_crop_4098166425_0.png', 0, 124, 95, 0, 1768254134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254134), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548942_3264e66189ae77d5b845965673be0613_rle_crop_4098166428_0.png', 0, 106, 126, 0, 1768254134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254134), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548932_528fef84dc5fbd36efdee269547aa665_rle_crop_4098166444_0.png', 0, 124, 89, 0, 1768254134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254134), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472_rle_crop_4098166450_0.png', 0, 120, 125, 0, 1768254134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254134), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548928_680b23a412ab1e6f95a56ca184578926_rle_crop_4098166468_0.png', 0, 365, 330, 0, 1768254134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254134), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548928_680b23a412ab1e6f95a56ca184578926_rle_crop_4098166470_0.png', 0, 155, 126, 0, 1768254134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254134), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548926_cb0353b5c44378745289a7b2505c38c7_rle_crop_4098166477_0.png', 0, 252, 228, 0, 1768254134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254134), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548924_f8fc0e79a9f0e8748d958d767ae64047_rle_crop_4098166482_0.png', 0, 93, 148, 0, 1768254134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254134), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548924_f8fc0e79a9f0e8748d958d767ae64047_rle_crop_4098166486_0.png', 0, 157, 264, 0, 1768254134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254134), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166492_0.png', 0, 137, 128, 0, 1768254134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254134), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548866_79f0da4a15982fa551a58abef9e0fb15_rle_crop_4098166499_0.png', 0, 141, 208, 0, 1768254134,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 12 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.2271580696105957 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 29 About to insert : list_path_to_insert length 29 new photo from crops ! About to upload 29 photos upload in portfolio : 3736932 init cache_photo without model_param we have 29 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768254147_3909803 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548942_3264e66189ae77d5b845965673be0613_rle_crop_4098166429_0.png', 0, 265, 219, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548942_3264e66189ae77d5b845965673be0613_rle_crop_4098166431_0.png', 0, 360, 264, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548934_6e6cd27f6a4c2986b7f70b5c197260df_rle_crop_4098166434_0.png', 0, 197, 372, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548932_528fef84dc5fbd36efdee269547aa665_rle_crop_4098166438_0.png', 0, 439, 401, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548932_528fef84dc5fbd36efdee269547aa665_rle_crop_4098166439_0.png', 0, 828, 532, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548932_528fef84dc5fbd36efdee269547aa665_rle_crop_4098166442_0.png', 0, 203, 68, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472_rle_crop_4098166447_0.png', 0, 299, 354, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472_rle_crop_4098166453_0.png', 0, 147, 154, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548930_535ca58a5b98a07451a9a0456061bc20_rle_crop_4098166454_0.png', 0, 437, 490, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548930_535ca58a5b98a07451a9a0456061bc20_rle_crop_4098166455_0.png', 0, 499, 355, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548930_535ca58a5b98a07451a9a0456061bc20_rle_crop_4098166461_0.png', 0, 530, 723, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548929_ae4772afe0a85289c639fb7f97a55286_rle_crop_4098166463_0.png', 0, 637, 373, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548929_ae4772afe0a85289c639fb7f97a55286_rle_crop_4098166464_0.png', 0, 210, 150, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548928_680b23a412ab1e6f95a56ca184578926_rle_crop_4098166467_0.png', 0, 780, 365, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548928_680b23a412ab1e6f95a56ca184578926_rle_crop_4098166473_0.png', 0, 310, 744, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548928_680b23a412ab1e6f95a56ca184578926_rle_crop_4098166474_0.png', 0, 146, 159, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548926_cb0353b5c44378745289a7b2505c38c7_rle_crop_4098166478_0.png', 0, 449, 264, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548926_cb0353b5c44378745289a7b2505c38c7_rle_crop_4098166479_0.png', 0, 217, 215, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548926_cb0353b5c44378745289a7b2505c38c7_rle_crop_4098166480_0.png', 0, 121, 77, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548924_f8fc0e79a9f0e8748d958d767ae64047_rle_crop_4098166483_0.png', 0, 255, 303, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166488_0.png', 0, 316, 276, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166489_0.png', 0, 518, 300, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166490_0.png', 0, 400, 340, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166491_0.png', 0, 370, 277, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166495_0.png', 0, 207, 170, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166496_0.png', 0, 188, 259, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166497_0.png', 0, 221, 184, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548866_79f0da4a15982fa551a58abef9e0fb15_rle_crop_4098166498_0.png', 0, 454, 314, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254152), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548866_79f0da4a15982fa551a58abef9e0fb15_rle_crop_4098166503_0.png', 0, 165, 260, 0, 1768254152,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 29 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.6833086013793945 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768254156_3909803 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254156), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472_rle_crop_4098166452_0.png', 0, 100, 98, 0, 1768254156,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6462042331695557 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768254158_3909803 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768254159), 0.0, 0.0, 14, '', 0, 0, '1768254030_3909803_1403548930_535ca58a5b98a07451a9a0456061bc20_rle_crop_4098166460_0.png', 0, 503, 363, 0, 1768254159,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.570406436920166 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1403548945, 1403548944, 1403548942, 1403548934, 1403548932, 1403548931, 1403548930, 1403548929, 1403548928, 1403548926, 1403548924, 1403548873, 1403548866] Looping around the photos to save general results len do output : 92 /1403574946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574973Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574995Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403574999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575011Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403575295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548945', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548944', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548942', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548934', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548932', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548931', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548930', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548929', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548928', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548926', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548924', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548873', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548866', None, None, None, None, None, '4329239') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 289 time used for this insertion : 0.03519582748413086 save_final save missing photos in datou_result : time spend for datou_step_exec : 56.327629804611206 time spend to save output : 0.03873300552368164 total time spend for step 2 : 56.36636281013489 step3:rle_unique_nms_with_priority Mon Jan 12 22:42:39 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 92 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 3.152050495147705 time for calcul the mask position with numpy : 0.9615707397460938 nb_pixel_total : 7929967 time to create 1 rle with new method : 0.9567475318908691 time for calcul the mask position with numpy : 0.023418903350830078 nb_pixel_total : 20620 time to create 1 rle with old method : 0.021661043167114258 time for calcul the mask position with numpy : 0.023797988891601562 nb_pixel_total : 1541 time to create 1 rle with old method : 0.0017371177673339844 time for calcul the mask position with numpy : 0.024186372756958008 nb_pixel_total : 25113 time to create 1 rle with old method : 0.025891542434692383 time for calcul the mask position with numpy : 0.022334575653076172 nb_pixel_total : 19740 time to create 1 rle with old method : 0.02042365074157715 time for calcul the mask position with numpy : 0.025319814682006836 nb_pixel_total : 177592 time to create 1 rle with new method : 0.8427107334136963 time for calcul the mask position with numpy : 0.025117874145507812 nb_pixel_total : 94436 time to create 1 rle with old method : 0.09924030303955078 time for calcul the mask position with numpy : 0.023875951766967773 nb_pixel_total : 25391 time to create 1 rle with old method : 0.026754140853881836 create new chi : 3.18344783782959 time to delete rle : 0.02170109748840332 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 5526 TO DO : save crop sub photo not yet done ! save time : 0.37962961196899414 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 3.6420600414276123 time for calcul the mask position with numpy : 0.5522828102111816 nb_pixel_total : 8074407 time to create 1 rle with new method : 0.8809609413146973 time for calcul the mask position with numpy : 0.02278733253479004 nb_pixel_total : 9794 time to create 1 rle with old method : 0.010343790054321289 time for calcul the mask position with numpy : 0.023667097091674805 nb_pixel_total : 19147 time to create 1 rle with old method : 0.0201871395111084 time for calcul the mask position with numpy : 0.023929834365844727 nb_pixel_total : 28352 time to create 1 rle with old method : 0.030693769454956055 time for calcul the mask position with numpy : 0.024341583251953125 nb_pixel_total : 17764 time to create 1 rle with old method : 0.01915717124938965 time for calcul the mask position with numpy : 0.024008512496948242 nb_pixel_total : 10651 time to create 1 rle with old method : 0.011299848556518555 time for calcul the mask position with numpy : 0.023923635482788086 nb_pixel_total : 15529 time to create 1 rle with old method : 0.016225099563598633 time for calcul the mask position with numpy : 0.024535417556762695 nb_pixel_total : 118756 time to create 1 rle with old method : 0.12404012680053711 create new chi : 1.87233567237854 time to delete rle : 0.0007011890411376953 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 5202 TO DO : save crop sub photo not yet done ! save time : 0.3623313903808594 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 4.190047264099121 time for calcul the mask position with numpy : 0.6853117942810059 nb_pixel_total : 7976911 time to create 1 rle with new method : 0.8891899585723877 time for calcul the mask position with numpy : 0.023568153381347656 nb_pixel_total : 23807 time to create 1 rle with old method : 0.025969505310058594 time for calcul the mask position with numpy : 0.02417469024658203 nb_pixel_total : 30669 time to create 1 rle with old method : 0.03169679641723633 time for calcul the mask position with numpy : 0.023135662078857422 nb_pixel_total : 57100 time to create 1 rle with old method : 0.06016349792480469 time for calcul the mask position with numpy : 0.024532556533813477 nb_pixel_total : 135287 time to create 1 rle with old method : 0.14163970947265625 time for calcul the mask position with numpy : 0.02424454689025879 nb_pixel_total : 40351 time to create 1 rle with old method : 0.042052268981933594 time for calcul the mask position with numpy : 0.02397012710571289 nb_pixel_total : 10881 time to create 1 rle with old method : 0.011738777160644531 time for calcul the mask position with numpy : 0.023968935012817383 nb_pixel_total : 8825 time to create 1 rle with old method : 0.009381532669067383 time for calcul the mask position with numpy : 0.023973941802978516 nb_pixel_total : 10569 time to create 1 rle with old method : 0.01121377944946289 create new chi : 2.141444683074951 time to delete rle : 0.0008256435394287109 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 5868 TO DO : save crop sub photo not yet done ! save time : 0.3618581295013428 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 1.9961321353912354 time for calcul the mask position with numpy : 0.7509591579437256 nb_pixel_total : 8107032 time to create 1 rle with new method : 0.9146080017089844 time for calcul the mask position with numpy : 0.02342677116394043 nb_pixel_total : 19257 time to create 1 rle with old method : 0.0208282470703125 time for calcul the mask position with numpy : 0.024616718292236328 nb_pixel_total : 112474 time to create 1 rle with old method : 0.12091064453125 time for calcul the mask position with numpy : 0.02421283721923828 nb_pixel_total : 55637 time to create 1 rle with old method : 0.06122183799743652 create new chi : 1.9817614555358887 time to delete rle : 0.0005636215209960938 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 4010 TO DO : save crop sub photo not yet done ! save time : 0.29422616958618164 nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 4.189901828765869 time for calcul the mask position with numpy : 0.6701235771179199 nb_pixel_total : 7590306 time to create 1 rle with new method : 0.8521525859832764 time for calcul the mask position with numpy : 0.039658546447753906 nb_pixel_total : 8979 time to create 1 rle with old method : 0.009893417358398438 time for calcul the mask position with numpy : 0.039344072341918945 nb_pixel_total : 49905 time to create 1 rle with old method : 0.05344700813293457 time for calcul the mask position with numpy : 0.024096250534057617 nb_pixel_total : 9914 time to create 1 rle with old method : 0.010677099227905273 time for calcul the mask position with numpy : 0.025004148483276367 nb_pixel_total : 113925 time to create 1 rle with old method : 0.12355613708496094 time for calcul the mask position with numpy : 0.025938987731933594 nb_pixel_total : 11857 time to create 1 rle with old method : 0.01288461685180664 time for calcul the mask position with numpy : 0.02657461166381836 nb_pixel_total : 269796 time to create 1 rle with new method : 0.8089151382446289 time for calcul the mask position with numpy : 0.0326690673828125 nb_pixel_total : 138246 time to create 1 rle with old method : 0.17237019538879395 time for calcul the mask position with numpy : 0.0392756462097168 nb_pixel_total : 101472 time to create 1 rle with old method : 0.11033797264099121 create new chi : 3.142921209335327 time to delete rle : 0.0012645721435546875 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 7496 TO DO : save crop sub photo not yet done ! save time : 0.4958310127258301 nb_obj : 9 nb_hashtags : 5 time to prepare the origin masks : 6.071099042892456 time for calcul the mask position with numpy : 0.7268655300140381 nb_pixel_total : 8068999 time to create 1 rle with new method : 1.1028413772583008 time for calcul the mask position with numpy : 0.038141489028930664 nb_pixel_total : 15266 time to create 1 rle with old method : 0.016332626342773438 time for calcul the mask position with numpy : 0.025539875030517578 nb_pixel_total : 7837 time to create 1 rle with old method : 0.00851130485534668 time for calcul the mask position with numpy : 0.023511886596679688 nb_pixel_total : 26867 time to create 1 rle with old method : 0.028443336486816406 time for calcul the mask position with numpy : 0.02362537384033203 nb_pixel_total : 12465 time to create 1 rle with old method : 0.013333320617675781 time for calcul the mask position with numpy : 0.023527860641479492 nb_pixel_total : 26270 time to create 1 rle with old method : 0.02778172492980957 time for calcul the mask position with numpy : 0.0244295597076416 nb_pixel_total : 19093 time to create 1 rle with old method : 0.02129340171813965 time for calcul the mask position with numpy : 0.024523258209228516 nb_pixel_total : 81325 time to create 1 rle with old method : 0.0863182544708252 time for calcul the mask position with numpy : 0.024446964263916016 nb_pixel_total : 15692 time to create 1 rle with old method : 0.017792463302612305 time for calcul the mask position with numpy : 0.024629831314086914 nb_pixel_total : 20586 time to create 1 rle with old method : 0.02182149887084961 create new chi : 2.3447227478027344 time to delete rle : 0.0013051033020019531 batch 1 Loaded 19 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 5608 TO DO : save crop sub photo not yet done ! save time : 0.38638973236083984 nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 4.786107301712036 time for calcul the mask position with numpy : 0.3746378421783447 nb_pixel_total : 7620593 time to create 1 rle with new method : 1.2549657821655273 time for calcul the mask position with numpy : 0.02715158462524414 nb_pixel_total : 299764 time to create 1 rle with new method : 0.7855119705200195 time for calcul the mask position with numpy : 0.02471137046813965 nb_pixel_total : 7457 time to create 1 rle with old method : 0.00838017463684082 time for calcul the mask position with numpy : 0.024197816848754883 nb_pixel_total : 8780 time to create 1 rle with old method : 0.009102344512939453 time for calcul the mask position with numpy : 0.02705836296081543 nb_pixel_total : 28785 time to create 1 rle with old method : 0.04641318321228027 time for calcul the mask position with numpy : 0.0272367000579834 nb_pixel_total : 41901 time to create 1 rle with old method : 0.045282602310180664 time for calcul the mask position with numpy : 0.026662349700927734 nb_pixel_total : 67068 time to create 1 rle with old method : 0.07373785972595215 time for calcul the mask position with numpy : 0.02691173553466797 nb_pixel_total : 110465 time to create 1 rle with old method : 0.11650896072387695 time for calcul the mask position with numpy : 0.025176525115966797 nb_pixel_total : 109587 time to create 1 rle with old method : 0.11737346649169922 create new chi : 3.1104040145874023 time to delete rle : 0.001165628433227539 batch 1 Loaded 17 chid ids of type : 3594 +++++++++++Number RLEs to save : 7619 TO DO : save crop sub photo not yet done ! save time : 0.5171420574188232 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 3.0031545162200928 time for calcul the mask position with numpy : 0.7585091590881348 nb_pixel_total : 7996875 time to create 1 rle with new method : 0.9176480770111084 time for calcul the mask position with numpy : 0.03054022789001465 nb_pixel_total : 33720 time to create 1 rle with old method : 0.036460161209106445 time for calcul the mask position with numpy : 0.0237882137298584 nb_pixel_total : 48436 time to create 1 rle with old method : 0.05175280570983887 time for calcul the mask position with numpy : 0.02514338493347168 nb_pixel_total : 21043 time to create 1 rle with old method : 0.023001909255981445 time for calcul the mask position with numpy : 0.026422500610351562 nb_pixel_total : 174703 time to create 1 rle with new method : 1.2628710269927979 time for calcul the mask position with numpy : 0.026043176651000977 nb_pixel_total : 19623 time to create 1 rle with old method : 0.021052837371826172 create new chi : 3.2718091011047363 time to delete rle : 0.0007543563842773438 batch 1 Loaded 11 chid ids of type : 3594 +++++++Number RLEs to save : 4620 TO DO : save crop sub photo not yet done ! save time : 0.33263731002807617 nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 4.679805755615234 time for calcul the mask position with numpy : 0.4889185428619385 nb_pixel_total : 7749833 time to create 1 rle with new method : 0.909799337387085 time for calcul the mask position with numpy : 0.0239260196685791 nb_pixel_total : 17246 time to create 1 rle with old method : 0.018466711044311523 time for calcul the mask position with numpy : 0.03000187873840332 nb_pixel_total : 103626 time to create 1 rle with old method : 0.12759923934936523 time for calcul the mask position with numpy : 0.02346181869506836 nb_pixel_total : 23108 time to create 1 rle with old method : 0.02456808090209961 time for calcul the mask position with numpy : 0.023979663848876953 nb_pixel_total : 15816 time to create 1 rle with old method : 0.016988039016723633 time for calcul the mask position with numpy : 0.0247957706451416 nb_pixel_total : 16363 time to create 1 rle with old method : 0.017943859100341797 time for calcul the mask position with numpy : 0.02453017234802246 nb_pixel_total : 45490 time to create 1 rle with old method : 0.04999995231628418 time for calcul the mask position with numpy : 0.02521967887878418 nb_pixel_total : 96261 time to create 1 rle with old method : 0.1048741340637207 time for calcul the mask position with numpy : 0.02501821517944336 nb_pixel_total : 226657 time to create 1 rle with new method : 0.9065701961517334 create new chi : 2.945176124572754 time to delete rle : 0.0011181831359863281 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7020 TO DO : save crop sub photo not yet done ! save time : 0.4710052013397217 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 4.2604405879974365 time for calcul the mask position with numpy : 0.7556302547454834 nb_pixel_total : 8099786 time to create 1 rle with new method : 0.8719081878662109 time for calcul the mask position with numpy : 0.023766756057739258 nb_pixel_total : 17118 time to create 1 rle with old method : 0.018273353576660156 time for calcul the mask position with numpy : 0.022779464721679688 nb_pixel_total : 7193 time to create 1 rle with old method : 0.007622241973876953 time for calcul the mask position with numpy : 0.02397751808166504 nb_pixel_total : 29723 time to create 1 rle with old method : 0.031150102615356445 time for calcul the mask position with numpy : 0.024019479751586914 nb_pixel_total : 74596 time to create 1 rle with old method : 0.0775909423828125 time for calcul the mask position with numpy : 0.022931814193725586 nb_pixel_total : 46463 time to create 1 rle with old method : 0.04814553260803223 time for calcul the mask position with numpy : 0.023670673370361328 nb_pixel_total : 3353 time to create 1 rle with old method : 0.0035963058471679688 time for calcul the mask position with numpy : 0.024131298065185547 nb_pixel_total : 16168 time to create 1 rle with old method : 0.01750802993774414 create new chi : 2.039104461669922 time to delete rle : 0.0007631778717041016 batch 1 Loaded 15 chid ids of type : 3594 ++++++++Number RLEs to save : 4540 TO DO : save crop sub photo not yet done ! save time : 0.32793116569519043 nb_obj : 5 nb_hashtags : 4 time to prepare the origin masks : 3.3292171955108643 time for calcul the mask position with numpy : 0.5630908012390137 nb_pixel_total : 8068309 time to create 1 rle with new method : 0.7450089454650879 time for calcul the mask position with numpy : 0.023880958557128906 nb_pixel_total : 35094 time to create 1 rle with old method : 0.03707075119018555 time for calcul the mask position with numpy : 0.02294301986694336 nb_pixel_total : 70536 time to create 1 rle with old method : 0.07334733009338379 time for calcul the mask position with numpy : 0.023142337799072266 nb_pixel_total : 56947 time to create 1 rle with old method : 0.059938669204711914 time for calcul the mask position with numpy : 0.023363113403320312 nb_pixel_total : 54078 time to create 1 rle with old method : 0.05846381187438965 time for calcul the mask position with numpy : 0.023085355758666992 nb_pixel_total : 9436 time to create 1 rle with old method : 0.009970426559448242 create new chi : 1.7058000564575195 time to delete rle : 0.0007805824279785156 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 5058 TO DO : save crop sub photo not yet done ! save time : 0.3428652286529541 nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 5.251462936401367 time for calcul the mask position with numpy : 0.8682613372802734 nb_pixel_total : 7686334 time to create 1 rle with new method : 0.9921104907989502 time for calcul the mask position with numpy : 0.023856401443481445 nb_pixel_total : 20221 time to create 1 rle with old method : 0.022115707397460938 time for calcul the mask position with numpy : 0.024127483367919922 nb_pixel_total : 35131 time to create 1 rle with old method : 0.039228200912475586 time for calcul the mask position with numpy : 0.024949312210083008 nb_pixel_total : 24688 time to create 1 rle with old method : 0.027551651000976562 time for calcul the mask position with numpy : 0.029133319854736328 nb_pixel_total : 51468 time to create 1 rle with old method : 0.057356834411621094 time for calcul the mask position with numpy : 0.027013540267944336 nb_pixel_total : 6034 time to create 1 rle with old method : 0.00689387321472168 time for calcul the mask position with numpy : 0.02564406394958496 nb_pixel_total : 14712 time to create 1 rle with old method : 0.016237258911132812 time for calcul the mask position with numpy : 0.025255680084228516 nb_pixel_total : 67206 time to create 1 rle with old method : 0.07218384742736816 time for calcul the mask position with numpy : 0.0259706974029541 nb_pixel_total : 104852 time to create 1 rle with old method : 0.11195039749145508 time for calcul the mask position with numpy : 0.036248207092285156 nb_pixel_total : 103417 time to create 1 rle with old method : 0.11228227615356445 time for calcul the mask position with numpy : 0.038423776626586914 nb_pixel_total : 47085 time to create 1 rle with old method : 0.050379276275634766 time for calcul the mask position with numpy : 0.0386357307434082 nb_pixel_total : 133252 time to create 1 rle with old method : 0.13818764686584473 create new chi : 2.8755061626434326 time to delete rle : 0.0013883113861083984 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++Number RLEs to save : 7825 TO DO : save crop sub photo not yet done ! save time : 0.5142683982849121 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 3.6302127838134766 time for calcul the mask position with numpy : 0.6447679996490479 nb_pixel_total : 8045080 time to create 1 rle with new method : 0.8025872707366943 time for calcul the mask position with numpy : 0.023693561553955078 nb_pixel_total : 34614 time to create 1 rle with old method : 0.03609108924865723 time for calcul the mask position with numpy : 0.022447824478149414 nb_pixel_total : 15169 time to create 1 rle with old method : 0.015700101852416992 time for calcul the mask position with numpy : 0.024158716201782227 nb_pixel_total : 53856 time to create 1 rle with old method : 0.058312416076660156 time for calcul the mask position with numpy : 0.025236129760742188 nb_pixel_total : 21132 time to create 1 rle with old method : 0.022630691528320312 time for calcul the mask position with numpy : 0.025185108184814453 nb_pixel_total : 24696 time to create 1 rle with old method : 0.026666641235351562 time for calcul the mask position with numpy : 0.04203224182128906 nb_pixel_total : 99853 time to create 1 rle with old method : 0.1077415943145752 create new chi : 1.9206364154815674 time to delete rle : 0.0009348392486572266 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 5131 TO DO : save crop sub photo not yet done ! save time : 0.36142420768737793 map_output_result : {1403548945: (0.0, 'Should be the crop_list due to order', 0), 1403548944: (0.0, 'Should be the crop_list due to order', 0), 1403548942: (0.0, 'Should be the crop_list due to order', 0), 1403548934: (0.0, 'Should be the crop_list due to order', 0), 1403548932: (0.0, 'Should be the crop_list due to order', 0), 1403548931: (0.0, 'Should be the crop_list due to order', 0), 1403548930: (0.0, 'Should be the crop_list due to order', 0), 1403548929: (0.0, 'Should be the crop_list due to order', 0), 1403548928: (0.0, 'Should be the crop_list due to order', 0), 1403548926: (0.0, 'Should be the crop_list due to order', 0), 1403548924: (0.0, 'Should be the crop_list due to order', 0), 1403548873: (0.0, 'Should be the crop_list due to order', 0), 1403548866: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1403548945, 1403548944, 1403548942, 1403548934, 1403548932, 1403548931, 1403548930, 1403548929, 1403548928, 1403548926, 1403548924, 1403548873, 1403548866] Looping around the photos to save general results len do output : 13 /1403548945.Didn't retrieve data . /1403548944.Didn't retrieve data . /1403548942.Didn't retrieve data . /1403548934.Didn't retrieve data . /1403548932.Didn't retrieve data . /1403548931.Didn't retrieve data . /1403548930.Didn't retrieve data . /1403548929.Didn't retrieve data . /1403548928.Didn't retrieve data . /1403548926.Didn't retrieve data . /1403548924.Didn't retrieve data . /1403548873.Didn't retrieve data . /1403548866.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548945', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548944', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548942', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548934', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548932', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548931', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548930', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548929', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548928', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548926', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548924', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548873', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548866', None, None, None, None, None, '4329239') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 39 time used for this insertion : 0.01680278778076172 save_final save missing photos in datou_result : time spend for datou_step_exec : 91.63005232810974 time spend to save output : 0.020651578903198242 total time spend for step 3 : 91.65070390701294 step4:ventilate_hashtags_in_portfolio Mon Jan 12 22:44:10 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 30095678 get user id for portfolio 30095678 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30095678 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','flou','metal','pet_fonce','pehd','background','mal_croppe','carton','environnement','pet_clair','papier')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30095678 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','flou','metal','pet_fonce','pehd','background','mal_croppe','carton','environnement','pet_clair','papier')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30095678 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','flou','metal','pet_fonce','pehd','background','mal_croppe','carton','environnement','pet_clair','papier')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/30096163,30096164,30096165,30096166,30096167,30096168,30096169,30096170,30096171,30096172,30096173?tags=autre,flou,metal,pet_fonce,pehd,background,mal_croppe,carton,environnement,pet_clair,papier Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1403548945, 1403548944, 1403548942, 1403548934, 1403548932, 1403548931, 1403548930, 1403548929, 1403548928, 1403548926, 1403548924, 1403548873, 1403548866] Looping around the photos to save general results len do output : 1 /30095678. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548945', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548944', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548942', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548934', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548932', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548931', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548930', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548929', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548928', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548926', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548924', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548873', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548866', None, None, None, None, None, '4329239') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.01564478874206543 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.9577314853668213 time spend to save output : 0.015910625457763672 total time spend for step 4 : 1.973642110824585 step5:final Mon Jan 12 22:44:12 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1403548945: ('0.044634081196581195',), 1403548944: ('0.044634081196581195',), 1403548942: ('0.044634081196581195',), 1403548934: ('0.044634081196581195',), 1403548932: ('0.044634081196581195',), 1403548931: ('0.044634081196581195',), 1403548930: ('0.044634081196581195',), 1403548929: ('0.044634081196581195',), 1403548928: ('0.044634081196581195',), 1403548926: ('0.044634081196581195',), 1403548924: ('0.044634081196581195',), 1403548873: ('0.044634081196581195',), 1403548866: ('0.044634081196581195',)} new output for save of step final : {1403548945: ('0.044634081196581195',), 1403548944: ('0.044634081196581195',), 1403548942: ('0.044634081196581195',), 1403548934: ('0.044634081196581195',), 1403548932: ('0.044634081196581195',), 1403548931: ('0.044634081196581195',), 1403548930: ('0.044634081196581195',), 1403548929: ('0.044634081196581195',), 1403548928: ('0.044634081196581195',), 1403548926: ('0.044634081196581195',), 1403548924: ('0.044634081196581195',), 1403548873: ('0.044634081196581195',), 1403548866: ('0.044634081196581195',)} [1403548945, 1403548944, 1403548942, 1403548934, 1403548932, 1403548931, 1403548930, 1403548929, 1403548928, 1403548926, 1403548924, 1403548873, 1403548866] Looping around the photos to save general results len do output : 13 /1403548945.Didn't retrieve data . /1403548944.Didn't retrieve data . /1403548942.Didn't retrieve data . /1403548934.Didn't retrieve data . /1403548932.Didn't retrieve data . /1403548931.Didn't retrieve data . /1403548930.Didn't retrieve data . /1403548929.Didn't retrieve data . /1403548928.Didn't retrieve data . /1403548926.Didn't retrieve data . /1403548924.Didn't retrieve data . /1403548873.Didn't retrieve data . /1403548866.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548945', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548944', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548942', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548934', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548932', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548931', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548930', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548929', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548928', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548926', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548924', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548873', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548866', None, None, None, None, None, '4329239') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 39 time used for this insertion : 0.01638960838317871 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.14381742477416992 time spend to save output : 0.017119884490966797 total time spend for step 5 : 0.16093730926513672 step6:blur_detection Mon Jan 12 22:44:12 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1768254030_3909803_1403548945_e5e4f7ecb119b96b69102ca5c32592d5.jpg resize: (2160, 3840) 1403548945 -6.288475571160993 treat image : temp/1768254030_3909803_1403548944_276f57037a611f4eb39e2b5b7f9dd2e2.jpg resize: (2160, 3840) 1403548944 -7.009945502653058 treat image : temp/1768254030_3909803_1403548942_3264e66189ae77d5b845965673be0613.jpg resize: (2160, 3840) 1403548942 -6.927618518480331 treat image : temp/1768254030_3909803_1403548934_6e6cd27f6a4c2986b7f70b5c197260df.jpg resize: (2160, 3840) 1403548934 -7.027592369283617 treat image : temp/1768254030_3909803_1403548932_528fef84dc5fbd36efdee269547aa665.jpg resize: (2160, 3840) 1403548932 -6.926652220270013 treat image : temp/1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472.jpg resize: (2160, 3840) 1403548931 -7.030500638269465 treat image : temp/1768254030_3909803_1403548930_535ca58a5b98a07451a9a0456061bc20.jpg resize: (2160, 3840) 1403548930 -7.0197612552741955 treat image : temp/1768254030_3909803_1403548929_ae4772afe0a85289c639fb7f97a55286.jpg resize: (2160, 3840) 1403548929 -7.08804341667076 treat image : temp/1768254030_3909803_1403548928_680b23a412ab1e6f95a56ca184578926.jpg resize: (2160, 3840) 1403548928 -6.999608174066991 treat image : temp/1768254030_3909803_1403548926_cb0353b5c44378745289a7b2505c38c7.jpg resize: (2160, 3840) 1403548926 -6.942485037842891 treat image : temp/1768254030_3909803_1403548924_f8fc0e79a9f0e8748d958d767ae64047.jpg resize: (2160, 3840) 1403548924 -6.3269658833278255 treat image : temp/1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48.jpg resize: (2160, 3840) 1403548873 -4.351339054497784 treat image : temp/1768254030_3909803_1403548866_79f0da4a15982fa551a58abef9e0fb15.jpg resize: (2160, 3840) 1403548866 -6.4254825759522625 treat image : temp/1768254030_3909803_1403548945_e5e4f7ecb119b96b69102ca5c32592d5_rle_crop_4098166412_0.png resize: (163, 213) 1403574946 -3.38050514033479 treat image : temp/1768254030_3909803_1403548945_e5e4f7ecb119b96b69102ca5c32592d5_rle_crop_4098166413_0.png resize: (407, 373) 1403574947 -4.514364639591626 treat image : temp/1768254030_3909803_1403548945_e5e4f7ecb119b96b69102ca5c32592d5_rle_crop_4098166414_0.png resize: (358, 694) 1403574948 -5.5229196841077695 treat image : temp/1768254030_3909803_1403548945_e5e4f7ecb119b96b69102ca5c32592d5_rle_crop_4098166418_0.png resize: (189, 164) 1403574949 -4.365592808235176 treat image : temp/1768254030_3909803_1403548944_276f57037a611f4eb39e2b5b7f9dd2e2_rle_crop_4098166419_0.png resize: (420, 407) 1403574950 -4.658454928209902 treat image : temp/1768254030_3909803_1403548944_276f57037a611f4eb39e2b5b7f9dd2e2_rle_crop_4098166420_0.png resize: (186, 176) 1403574951 -4.166036885453143 treat image : temp/1768254030_3909803_1403548944_276f57037a611f4eb39e2b5b7f9dd2e2_rle_crop_4098166422_0.png resize: (178, 214) 1403574952 -3.7964735669358283 treat image : temp/1768254030_3909803_1403548944_276f57037a611f4eb39e2b5b7f9dd2e2_rle_crop_4098166424_0.png resize: (200, 182) 1403574954 -5.010804388798659 treat image : temp/1768254030_3909803_1403548942_3264e66189ae77d5b845965673be0613_rle_crop_4098166426_0.png resize: (171, 79) 1403574955 -3.7979224773743105 treat image : temp/1768254030_3909803_1403548942_3264e66189ae77d5b845965673be0613_rle_crop_4098166427_0.png resize: (146, 83) 1403574956 -4.216547422664713 treat image : temp/1768254030_3909803_1403548942_3264e66189ae77d5b845965673be0613_rle_crop_4098166430_0.png resize: (447, 433) 1403574957 -5.089435430584045 treat image : temp/1768254030_3909803_1403548942_3264e66189ae77d5b845965673be0613_rle_crop_4098166432_0.png resize: (203, 173) 1403574958 -5.034778819433527 treat image : temp/1768254030_3909803_1403548942_3264e66189ae77d5b845965673be0613_rle_crop_4098166433_0.png resize: (207, 159) 1403574959 -4.004729566710972 treat image : temp/1768254030_3909803_1403548934_6e6cd27f6a4c2986b7f70b5c197260df_rle_crop_4098166435_0.png resize: (445, 308) 1403574960 -5.623824741299182 treat image : temp/1768254030_3909803_1403548934_6e6cd27f6a4c2986b7f70b5c197260df_rle_crop_4098166436_0.png resize: (89, 256) 1403574961 -4.285130748978174 treat image : temp/1768254030_3909803_1403548932_528fef84dc5fbd36efdee269547aa665_rle_crop_4098166440_0.png resize: (135, 149) 1403574962 -3.8717023201362224 treat image : temp/1768254030_3909803_1403548932_528fef84dc5fbd36efdee269547aa665_rle_crop_4098166441_0.png resize: (422, 491) 1403574963 -4.627977768564432 treat image : temp/1768254030_3909803_1403548932_528fef84dc5fbd36efdee269547aa665_rle_crop_4098166443_0.png resize: (371, 264) 1403574964 -4.138663623882605 treat image : temp/1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472_rle_crop_4098166445_0.png resize: (113, 237) 1403574965 -4.662585771854874 treat image : temp/1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472_rle_crop_4098166446_0.png resize: (171, 215) 1403574966 -4.044106903980312 treat image : temp/1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472_rle_crop_4098166448_0.png resize: (164, 185) 1403574967 -4.815871481205172 treat image : temp/1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472_rle_crop_4098166449_0.png resize: (202, 209) 1403574968 -4.545164460703281 treat image : temp/1768254030_3909803_1403548930_535ca58a5b98a07451a9a0456061bc20_rle_crop_4098166456_0.png resize: (229, 363) 1403574969 -3.394911979151969 treat image : temp/1768254030_3909803_1403548930_535ca58a5b98a07451a9a0456061bc20_rle_crop_4098166457_0.png resize: (317, 321) 1403574970 -3.972431003010576 treat image : temp/1768254030_3909803_1403548930_535ca58a5b98a07451a9a0456061bc20_rle_crop_4098166459_0.png resize: (102, 119) 1403574971 -3.991999408171564 treat image : temp/1768254030_3909803_1403548929_ae4772afe0a85289c639fb7f97a55286_rle_crop_4098166465_0.png resize: (232, 277) 1403574972 -5.130986548979229 treat image : temp/1768254030_3909803_1403548929_ae4772afe0a85289c639fb7f97a55286_rle_crop_4098166466_0.png resize: (381, 253) 1403574973 -3.1576653763256526 treat image : temp/1768254030_3909803_1403548928_680b23a412ab1e6f95a56ca184578926_rle_crop_4098166469_0.png resize: (299, 180) 1403574974 -4.048910101805876 treat image : temp/1768254030_3909803_1403548928_680b23a412ab1e6f95a56ca184578926_rle_crop_4098166471_0.png resize: (88, 272) 1403574975 -4.77413416048788 treat image : temp/1768254030_3909803_1403548926_cb0353b5c44378745289a7b2505c38c7_rle_crop_4098166475_0.png resize: (189, 145) 1403574976 -3.789573821941505 treat image : temp/1768254030_3909803_1403548926_cb0353b5c44378745289a7b2505c38c7_rle_crop_4098166476_0.png resize: (47, 98) 1403574977 -2.410122836194115 treat image : temp/1768254030_3909803_1403548926_cb0353b5c44378745289a7b2505c38c7_rle_crop_4098166481_0.png resize: (105, 235) 1403574978 -5.210679553415523 treat image : temp/1768254030_3909803_1403548924_f8fc0e79a9f0e8748d958d767ae64047_rle_crop_4098166484_0.png resize: (322, 258) 1403574979 -3.566041594424756 treat image : temp/1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166487_0.png resize: (463, 455) 1403574980 -4.118573224432427 treat image : temp/1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166493_0.png resize: (99, 96) 1403574981 -4.388537355304296 treat image : temp/1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166494_0.png resize: (277, 269) 1403574982 -3.619403643429794 treat image : temp/1768254030_3909803_1403548866_79f0da4a15982fa551a58abef9e0fb15_rle_crop_4098166500_0.png resize: (245, 103) 1403574983 -4.458190534522318 treat image : temp/1768254030_3909803_1403548866_79f0da4a15982fa551a58abef9e0fb15_rle_crop_4098166501_0.png resize: (289, 289) 1403574984 -5.323898150649354 treat image : temp/1768254030_3909803_1403548866_79f0da4a15982fa551a58abef9e0fb15_rle_crop_4098166502_0.png resize: (173, 109) 1403574985 -2.723246642447145 treat image : temp/1768254030_3909803_1403548945_e5e4f7ecb119b96b69102ca5c32592d5_rle_crop_4098166416_0.png resize: (225, 192) 1403574990 -4.200602342168259 treat image : temp/1768254030_3909803_1403548945_e5e4f7ecb119b96b69102ca5c32592d5_rle_crop_4098166417_0.png resize: (84, 55) 1403574991 -3.6264462466128458 treat image : temp/1768254030_3909803_1403548944_276f57037a611f4eb39e2b5b7f9dd2e2_rle_crop_4098166421_0.png resize: (183, 82) 1403574992 -2.3523855252318544 treat image : temp/1768254030_3909803_1403548944_276f57037a611f4eb39e2b5b7f9dd2e2_rle_crop_4098166423_0.png resize: (248, 213) 1403574993 -2.504200955660479 treat image : temp/1768254030_3909803_1403548932_528fef84dc5fbd36efdee269547aa665_rle_crop_4098166437_0.png resize: (531, 341) 1403574994 -3.8806356879180903 treat image : temp/1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472_rle_crop_4098166451_0.png resize: (206, 188) 1403574995 -1.7332480627540179 treat image : temp/1768254030_3909803_1403548930_535ca58a5b98a07451a9a0456061bc20_rle_crop_4098166458_0.png resize: (250, 171) 1403574996 -3.342298129876218 treat image : temp/1768254030_3909803_1403548929_ae4772afe0a85289c639fb7f97a55286_rle_crop_4098166462_0.png resize: (114, 218) 1403574997 -2.0232744990335667 treat image : temp/1768254030_3909803_1403548928_680b23a412ab1e6f95a56ca184578926_rle_crop_4098166472_0.png resize: (226, 162) 1403574998 -3.1762665278362543 treat image : temp/1768254030_3909803_1403548924_f8fc0e79a9f0e8748d958d767ae64047_rle_crop_4098166485_0.png resize: (372, 277) 1403574999 -4.069834176359796 treat image : temp/1768254030_3909803_1403548945_e5e4f7ecb119b96b69102ca5c32592d5_rle_crop_4098166415_0.png resize: (148, 154) 1403575003 -4.440778164703152 treat image : temp/1768254030_3909803_1403548944_276f57037a611f4eb39e2b5b7f9dd2e2_rle_crop_4098166425_0.png resize: (95, 124) 1403575004 -3.8974098434162574 treat image : temp/1768254030_3909803_1403548942_3264e66189ae77d5b845965673be0613_rle_crop_4098166428_0.png resize: (126, 106) 1403575005 -4.703780652972347 treat image : temp/1768254030_3909803_1403548932_528fef84dc5fbd36efdee269547aa665_rle_crop_4098166444_0.png resize: (89, 124) 1403575006 -4.040960078248853 treat image : temp/1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472_rle_crop_4098166450_0.png resize: (125, 120) 1403575007 -4.494884107645022 treat image : temp/1768254030_3909803_1403548928_680b23a412ab1e6f95a56ca184578926_rle_crop_4098166468_0.png resize: (330, 365) 1403575008 -4.880585711626933 treat image : temp/1768254030_3909803_1403548928_680b23a412ab1e6f95a56ca184578926_rle_crop_4098166470_0.png resize: (126, 155) 1403575009 -4.960848021027672 treat image : temp/1768254030_3909803_1403548926_cb0353b5c44378745289a7b2505c38c7_rle_crop_4098166477_0.png resize: (228, 252) 1403575010 -4.707666351321579 treat image : temp/1768254030_3909803_1403548924_f8fc0e79a9f0e8748d958d767ae64047_rle_crop_4098166482_0.png resize: (148, 93) 1403575011 -4.338224133697104 treat image : temp/1768254030_3909803_1403548924_f8fc0e79a9f0e8748d958d767ae64047_rle_crop_4098166486_0.png resize: (264, 157) 1403575012 -3.756197427447687 treat image : temp/1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166492_0.png resize: (128, 137) 1403575013 -3.7874555454398693 treat image : temp/1768254030_3909803_1403548866_79f0da4a15982fa551a58abef9e0fb15_rle_crop_4098166499_0.png resize: (208, 141) 1403575014 -4.0172730146925275 treat image : temp/1768254030_3909803_1403548942_3264e66189ae77d5b845965673be0613_rle_crop_4098166429_0.png resize: (219, 265) 1403575111 -5.079465734875678 treat image : temp/1768254030_3909803_1403548942_3264e66189ae77d5b845965673be0613_rle_crop_4098166431_0.png resize: (264, 360) 1403575113 -4.200558153224723 treat image : temp/1768254030_3909803_1403548934_6e6cd27f6a4c2986b7f70b5c197260df_rle_crop_4098166434_0.png resize: (372, 197) 1403575115 -3.6518023281012466 treat image : temp/1768254030_3909803_1403548932_528fef84dc5fbd36efdee269547aa665_rle_crop_4098166438_0.png resize: (401, 439) 1403575117 -2.9215776970240435 treat image : temp/1768254030_3909803_1403548932_528fef84dc5fbd36efdee269547aa665_rle_crop_4098166439_0.png resize: (532, 828) 1403575119 -4.471107042790535 treat image : temp/1768254030_3909803_1403548932_528fef84dc5fbd36efdee269547aa665_rle_crop_4098166442_0.png resize: (68, 203) 1403575121 -3.6397341354242174 treat image : temp/1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472_rle_crop_4098166447_0.png resize: (354, 299) 1403575123 -5.593136091133174 treat image : temp/1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472_rle_crop_4098166453_0.png resize: (154, 147) 1403575125 -3.649837619346542 treat image : temp/1768254030_3909803_1403548930_535ca58a5b98a07451a9a0456061bc20_rle_crop_4098166454_0.png resize: (490, 437) 1403575127 -5.3029136162184 treat image : temp/1768254030_3909803_1403548930_535ca58a5b98a07451a9a0456061bc20_rle_crop_4098166455_0.png resize: (355, 499) 1403575129 -6.769179653838938 treat image : temp/1768254030_3909803_1403548930_535ca58a5b98a07451a9a0456061bc20_rle_crop_4098166461_0.png resize: (723, 530) 1403575131 -5.062975462710919 treat image : temp/1768254030_3909803_1403548929_ae4772afe0a85289c639fb7f97a55286_rle_crop_4098166463_0.png resize: (373, 637) 1403575133 -5.591817930881517 treat image : temp/1768254030_3909803_1403548929_ae4772afe0a85289c639fb7f97a55286_rle_crop_4098166464_0.png resize: (150, 210) 1403575135 -4.016289391495871 treat image : temp/1768254030_3909803_1403548928_680b23a412ab1e6f95a56ca184578926_rle_crop_4098166467_0.png resize: (365, 780) 1403575137 -5.552197607546277 treat image : temp/1768254030_3909803_1403548928_680b23a412ab1e6f95a56ca184578926_rle_crop_4098166473_0.png resize: (744, 310) 1403575139 -4.845273611486447 treat image : temp/1768254030_3909803_1403548928_680b23a412ab1e6f95a56ca184578926_rle_crop_4098166474_0.png resize: (159, 146) 1403575141 -3.225378882034313 treat image : temp/1768254030_3909803_1403548926_cb0353b5c44378745289a7b2505c38c7_rle_crop_4098166478_0.png resize: (264, 449) 1403575143 -5.275789320314735 treat image : temp/1768254030_3909803_1403548926_cb0353b5c44378745289a7b2505c38c7_rle_crop_4098166479_0.png resize: (215, 217) 1403575145 -3.53607936077516 treat image : temp/1768254030_3909803_1403548926_cb0353b5c44378745289a7b2505c38c7_rle_crop_4098166480_0.png resize: (77, 121) 1403575147 -3.348529565234261 treat image : temp/1768254030_3909803_1403548924_f8fc0e79a9f0e8748d958d767ae64047_rle_crop_4098166483_0.png resize: (303, 255) 1403575149 -4.919557486880308 treat image : temp/1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166488_0.png resize: (276, 316) 1403575151 -3.853042392300639 treat image : temp/1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166489_0.png resize: (300, 518) 1403575153 -4.317735231994135 treat image : temp/1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166490_0.png resize: (340, 400) 1403575155 -4.897367138136533 treat image : temp/1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166491_0.png resize: (277, 370) 1403575157 -4.058318294730464 treat image : temp/1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166495_0.png resize: (170, 207) 1403575159 -3.8132295847383793 treat image : temp/1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166496_0.png resize: (259, 188) 1403575161 -3.73672058975096 treat image : temp/1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166497_0.png resize: (184, 221) 1403575163 -4.194633289807181 treat image : temp/1768254030_3909803_1403548866_79f0da4a15982fa551a58abef9e0fb15_rle_crop_4098166498_0.png resize: (314, 454) 1403575165 -5.361504114552605 treat image : temp/1768254030_3909803_1403548866_79f0da4a15982fa551a58abef9e0fb15_rle_crop_4098166503_0.png resize: (260, 165) 1403575167 -4.819897424352021 treat image : temp/1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472_rle_crop_4098166452_0.png resize: (98, 100) 1403575225 -4.590631464102357 treat image : temp/1768254030_3909803_1403548930_535ca58a5b98a07451a9a0456061bc20_rle_crop_4098166460_0.png resize: (363, 503) 1403575295 -6.778255244343933 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 105 time used for this insertion : 0.017164945602416992 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 105 time used for this insertion : 0.03495359420776367 save missing photos in datou_result : time spend for datou_step_exec : 52.63762640953064 time spend to save output : 0.058990478515625 total time spend for step 6 : 52.696616888046265 step7:brightness Mon Jan 12 22:45:05 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1768254030_3909803_1403548945_e5e4f7ecb119b96b69102ca5c32592d5.jpg treat image : temp/1768254030_3909803_1403548944_276f57037a611f4eb39e2b5b7f9dd2e2.jpg treat image : temp/1768254030_3909803_1403548942_3264e66189ae77d5b845965673be0613.jpg treat image : temp/1768254030_3909803_1403548934_6e6cd27f6a4c2986b7f70b5c197260df.jpg treat image : temp/1768254030_3909803_1403548932_528fef84dc5fbd36efdee269547aa665.jpg treat image : temp/1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472.jpg treat image : temp/1768254030_3909803_1403548930_535ca58a5b98a07451a9a0456061bc20.jpg treat image : temp/1768254030_3909803_1403548929_ae4772afe0a85289c639fb7f97a55286.jpg treat image : temp/1768254030_3909803_1403548928_680b23a412ab1e6f95a56ca184578926.jpg treat image : temp/1768254030_3909803_1403548926_cb0353b5c44378745289a7b2505c38c7.jpg treat image : temp/1768254030_3909803_1403548924_f8fc0e79a9f0e8748d958d767ae64047.jpg treat image : temp/1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48.jpg treat image : temp/1768254030_3909803_1403548866_79f0da4a15982fa551a58abef9e0fb15.jpg treat image : temp/1768254030_3909803_1403548945_e5e4f7ecb119b96b69102ca5c32592d5_rle_crop_4098166412_0.png treat image : temp/1768254030_3909803_1403548945_e5e4f7ecb119b96b69102ca5c32592d5_rle_crop_4098166413_0.png treat image : temp/1768254030_3909803_1403548945_e5e4f7ecb119b96b69102ca5c32592d5_rle_crop_4098166414_0.png treat image : temp/1768254030_3909803_1403548945_e5e4f7ecb119b96b69102ca5c32592d5_rle_crop_4098166418_0.png treat image : temp/1768254030_3909803_1403548944_276f57037a611f4eb39e2b5b7f9dd2e2_rle_crop_4098166419_0.png treat image : temp/1768254030_3909803_1403548944_276f57037a611f4eb39e2b5b7f9dd2e2_rle_crop_4098166420_0.png treat image : temp/1768254030_3909803_1403548944_276f57037a611f4eb39e2b5b7f9dd2e2_rle_crop_4098166422_0.png treat image : temp/1768254030_3909803_1403548944_276f57037a611f4eb39e2b5b7f9dd2e2_rle_crop_4098166424_0.png treat image : temp/1768254030_3909803_1403548942_3264e66189ae77d5b845965673be0613_rle_crop_4098166426_0.png treat image : temp/1768254030_3909803_1403548942_3264e66189ae77d5b845965673be0613_rle_crop_4098166427_0.png treat image : temp/1768254030_3909803_1403548942_3264e66189ae77d5b845965673be0613_rle_crop_4098166430_0.png treat image : temp/1768254030_3909803_1403548942_3264e66189ae77d5b845965673be0613_rle_crop_4098166432_0.png treat image : temp/1768254030_3909803_1403548942_3264e66189ae77d5b845965673be0613_rle_crop_4098166433_0.png treat image : temp/1768254030_3909803_1403548934_6e6cd27f6a4c2986b7f70b5c197260df_rle_crop_4098166435_0.png treat image : temp/1768254030_3909803_1403548934_6e6cd27f6a4c2986b7f70b5c197260df_rle_crop_4098166436_0.png treat image : temp/1768254030_3909803_1403548932_528fef84dc5fbd36efdee269547aa665_rle_crop_4098166440_0.png treat image : temp/1768254030_3909803_1403548932_528fef84dc5fbd36efdee269547aa665_rle_crop_4098166441_0.png treat image : temp/1768254030_3909803_1403548932_528fef84dc5fbd36efdee269547aa665_rle_crop_4098166443_0.png treat image : temp/1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472_rle_crop_4098166445_0.png treat image : temp/1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472_rle_crop_4098166446_0.png treat image : temp/1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472_rle_crop_4098166448_0.png treat image : temp/1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472_rle_crop_4098166449_0.png treat image : temp/1768254030_3909803_1403548930_535ca58a5b98a07451a9a0456061bc20_rle_crop_4098166456_0.png treat image : temp/1768254030_3909803_1403548930_535ca58a5b98a07451a9a0456061bc20_rle_crop_4098166457_0.png treat image : temp/1768254030_3909803_1403548930_535ca58a5b98a07451a9a0456061bc20_rle_crop_4098166459_0.png treat image : temp/1768254030_3909803_1403548929_ae4772afe0a85289c639fb7f97a55286_rle_crop_4098166465_0.png treat image : temp/1768254030_3909803_1403548929_ae4772afe0a85289c639fb7f97a55286_rle_crop_4098166466_0.png treat image : temp/1768254030_3909803_1403548928_680b23a412ab1e6f95a56ca184578926_rle_crop_4098166469_0.png treat image : temp/1768254030_3909803_1403548928_680b23a412ab1e6f95a56ca184578926_rle_crop_4098166471_0.png treat image : temp/1768254030_3909803_1403548926_cb0353b5c44378745289a7b2505c38c7_rle_crop_4098166475_0.png treat image : temp/1768254030_3909803_1403548926_cb0353b5c44378745289a7b2505c38c7_rle_crop_4098166476_0.png treat image : temp/1768254030_3909803_1403548926_cb0353b5c44378745289a7b2505c38c7_rle_crop_4098166481_0.png treat image : temp/1768254030_3909803_1403548924_f8fc0e79a9f0e8748d958d767ae64047_rle_crop_4098166484_0.png treat image : temp/1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166487_0.png treat image : temp/1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166493_0.png treat image : temp/1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166494_0.png treat image : temp/1768254030_3909803_1403548866_79f0da4a15982fa551a58abef9e0fb15_rle_crop_4098166500_0.png treat image : temp/1768254030_3909803_1403548866_79f0da4a15982fa551a58abef9e0fb15_rle_crop_4098166501_0.png treat image : temp/1768254030_3909803_1403548866_79f0da4a15982fa551a58abef9e0fb15_rle_crop_4098166502_0.png treat image : temp/1768254030_3909803_1403548945_e5e4f7ecb119b96b69102ca5c32592d5_rle_crop_4098166416_0.png treat image : temp/1768254030_3909803_1403548945_e5e4f7ecb119b96b69102ca5c32592d5_rle_crop_4098166417_0.png treat image : temp/1768254030_3909803_1403548944_276f57037a611f4eb39e2b5b7f9dd2e2_rle_crop_4098166421_0.png treat image : temp/1768254030_3909803_1403548944_276f57037a611f4eb39e2b5b7f9dd2e2_rle_crop_4098166423_0.png treat image : temp/1768254030_3909803_1403548932_528fef84dc5fbd36efdee269547aa665_rle_crop_4098166437_0.png treat image : temp/1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472_rle_crop_4098166451_0.png treat image : temp/1768254030_3909803_1403548930_535ca58a5b98a07451a9a0456061bc20_rle_crop_4098166458_0.png treat image : temp/1768254030_3909803_1403548929_ae4772afe0a85289c639fb7f97a55286_rle_crop_4098166462_0.png treat image : temp/1768254030_3909803_1403548928_680b23a412ab1e6f95a56ca184578926_rle_crop_4098166472_0.png treat image : temp/1768254030_3909803_1403548924_f8fc0e79a9f0e8748d958d767ae64047_rle_crop_4098166485_0.png treat image : temp/1768254030_3909803_1403548945_e5e4f7ecb119b96b69102ca5c32592d5_rle_crop_4098166415_0.png treat image : temp/1768254030_3909803_1403548944_276f57037a611f4eb39e2b5b7f9dd2e2_rle_crop_4098166425_0.png treat image : temp/1768254030_3909803_1403548942_3264e66189ae77d5b845965673be0613_rle_crop_4098166428_0.png treat image : temp/1768254030_3909803_1403548932_528fef84dc5fbd36efdee269547aa665_rle_crop_4098166444_0.png treat image : temp/1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472_rle_crop_4098166450_0.png treat image : temp/1768254030_3909803_1403548928_680b23a412ab1e6f95a56ca184578926_rle_crop_4098166468_0.png treat image : temp/1768254030_3909803_1403548928_680b23a412ab1e6f95a56ca184578926_rle_crop_4098166470_0.png treat image : temp/1768254030_3909803_1403548926_cb0353b5c44378745289a7b2505c38c7_rle_crop_4098166477_0.png treat image : temp/1768254030_3909803_1403548924_f8fc0e79a9f0e8748d958d767ae64047_rle_crop_4098166482_0.png treat image : temp/1768254030_3909803_1403548924_f8fc0e79a9f0e8748d958d767ae64047_rle_crop_4098166486_0.png treat image : temp/1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166492_0.png treat image : temp/1768254030_3909803_1403548866_79f0da4a15982fa551a58abef9e0fb15_rle_crop_4098166499_0.png treat image : temp/1768254030_3909803_1403548942_3264e66189ae77d5b845965673be0613_rle_crop_4098166429_0.png treat image : temp/1768254030_3909803_1403548942_3264e66189ae77d5b845965673be0613_rle_crop_4098166431_0.png treat image : temp/1768254030_3909803_1403548934_6e6cd27f6a4c2986b7f70b5c197260df_rle_crop_4098166434_0.png treat image : temp/1768254030_3909803_1403548932_528fef84dc5fbd36efdee269547aa665_rle_crop_4098166438_0.png treat image : temp/1768254030_3909803_1403548932_528fef84dc5fbd36efdee269547aa665_rle_crop_4098166439_0.png treat image : temp/1768254030_3909803_1403548932_528fef84dc5fbd36efdee269547aa665_rle_crop_4098166442_0.png treat image : temp/1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472_rle_crop_4098166447_0.png treat image : temp/1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472_rle_crop_4098166453_0.png treat image : temp/1768254030_3909803_1403548930_535ca58a5b98a07451a9a0456061bc20_rle_crop_4098166454_0.png treat image : temp/1768254030_3909803_1403548930_535ca58a5b98a07451a9a0456061bc20_rle_crop_4098166455_0.png treat image : temp/1768254030_3909803_1403548930_535ca58a5b98a07451a9a0456061bc20_rle_crop_4098166461_0.png treat image : temp/1768254030_3909803_1403548929_ae4772afe0a85289c639fb7f97a55286_rle_crop_4098166463_0.png treat image : temp/1768254030_3909803_1403548929_ae4772afe0a85289c639fb7f97a55286_rle_crop_4098166464_0.png treat image : temp/1768254030_3909803_1403548928_680b23a412ab1e6f95a56ca184578926_rle_crop_4098166467_0.png treat image : temp/1768254030_3909803_1403548928_680b23a412ab1e6f95a56ca184578926_rle_crop_4098166473_0.png treat image : temp/1768254030_3909803_1403548928_680b23a412ab1e6f95a56ca184578926_rle_crop_4098166474_0.png treat image : temp/1768254030_3909803_1403548926_cb0353b5c44378745289a7b2505c38c7_rle_crop_4098166478_0.png treat image : temp/1768254030_3909803_1403548926_cb0353b5c44378745289a7b2505c38c7_rle_crop_4098166479_0.png treat image : temp/1768254030_3909803_1403548926_cb0353b5c44378745289a7b2505c38c7_rle_crop_4098166480_0.png treat image : temp/1768254030_3909803_1403548924_f8fc0e79a9f0e8748d958d767ae64047_rle_crop_4098166483_0.png treat image : temp/1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166488_0.png treat image : temp/1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166489_0.png treat image : temp/1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166490_0.png treat image : temp/1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166491_0.png treat image : temp/1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166495_0.png treat image : temp/1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166496_0.png treat image : temp/1768254030_3909803_1403548873_d6ba5efaab43f25622e1e5875c5c7e48_rle_crop_4098166497_0.png treat image : temp/1768254030_3909803_1403548866_79f0da4a15982fa551a58abef9e0fb15_rle_crop_4098166498_0.png treat image : temp/1768254030_3909803_1403548866_79f0da4a15982fa551a58abef9e0fb15_rle_crop_4098166503_0.png treat image : temp/1768254030_3909803_1403548931_047e63dff5b16ff8372d6d99bb1ae472_rle_crop_4098166452_0.png treat image : temp/1768254030_3909803_1403548930_535ca58a5b98a07451a9a0456061bc20_rle_crop_4098166460_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 105 time used for this insertion : 0.020270824432373047 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 105 time used for this insertion : 0.034993648529052734 save missing photos in datou_result : time spend for datou_step_exec : 13.317766666412354 time spend to save output : 0.061200618743896484 total time spend for step 7 : 13.37896728515625 step8:velours_tree Mon Jan 12 22:45:19 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.14423012733459473 time spend to save output : 4.4345855712890625e-05 total time spend for step 8 : 0.14427447319030762 step9:send_mail_cod Mon Jan 12 22:45:19 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P30095678_12-01-2026_22_45_19.pdf 30096163 change filename to text .imagette300961631768254319 30096164 imagette300961641768254319 30096165 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette300961651768254319 30096166 change filename to text .imagette300961661768254320 30096167 imagette300961671768254320 30096168 imagette300961681768254320 30096169 imagette300961691768254320 30096170 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette300961701768254320 30096172 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette300961721768254321 30096173 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette300961731768254323 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=30095678 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/30096163,30096164,30096165,30096166,30096167,30096168,30096169,30096170,30096171,30096172,30096173?tags=autre,flou,metal,pet_fonce,pehd,background,mal_croppe,carton,environnement,pet_clair,papier your option no_mail is active, we will not send the real mail to your client args[1403548945] : ((1403548945, -6.288475571160993, 492609224), (1403548945, -0.4449659983692045, 496442774), '0.044634081196581195') We are sending mail with results at report@fotonower.com args[1403548944] : ((1403548944, -7.009945502653058, 492609224), (1403548944, -0.2632750509634535, 496442774), '0.044634081196581195') We are sending mail with results at report@fotonower.com args[1403548942] : ((1403548942, -6.927618518480331, 492609224), (1403548942, -0.4577348830835017, 496442774), '0.044634081196581195') We are sending mail with results at report@fotonower.com args[1403548934] : ((1403548934, -7.027592369283617, 492609224), (1403548934, -0.2516534094342406, 496442774), '0.044634081196581195') We are sending mail with results at report@fotonower.com args[1403548932] : ((1403548932, -6.926652220270013, 492609224), (1403548932, -0.3538868939820782, 496442774), '0.044634081196581195') We are sending mail with results at report@fotonower.com args[1403548931] : ((1403548931, -7.030500638269465, 492609224), (1403548931, -0.1609992350853352, 496442774), '0.044634081196581195') We are sending mail with results at report@fotonower.com args[1403548930] : ((1403548930, -7.0197612552741955, 492609224), (1403548930, -0.2746005594872056, 496442774), '0.044634081196581195') We are sending mail with results at report@fotonower.com args[1403548929] : ((1403548929, -7.08804341667076, 492609224), (1403548929, -0.14359839158069468, 496442774), '0.044634081196581195') We are sending mail with results at report@fotonower.com args[1403548928] : ((1403548928, -6.999608174066991, 492609224), (1403548928, -0.021226181503288977, 2107752395), '0.044634081196581195') We are sending mail with results at report@fotonower.com args[1403548926] : ((1403548926, -6.942485037842891, 492609224), (1403548926, -0.2759334959174297, 496442774), '0.044634081196581195') We are sending mail with results at report@fotonower.com args[1403548924] : ((1403548924, -6.3269658833278255, 492609224), (1403548924, -0.45256212753683345, 496442774), '0.044634081196581195') We are sending mail with results at report@fotonower.com args[1403548873] : ((1403548873, -4.351339054497784, 492609224), (1403548873, -1.5591593585300456, 501862349), '0.044634081196581195') We are sending mail with results at report@fotonower.com args[1403548866] : ((1403548866, -6.4254825759522625, 492609224), (1403548866, -0.7526411290751224, 501862349), '0.044634081196581195') We are sending mail with results at report@fotonower.com refus_total : 0.044634081196581195 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=30095678 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30095678_12-01-2026_22_45_19.pdf results_Auto_P30095678_12-01-2026_22_45_19.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30095678_12-01-2026_22_45_19.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','30095678','results_Auto_P30095678_12-01-2026_22_45_19.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30095678_12-01-2026_22_45_19.pdf','pdf','','0.8','0.044634081196581195') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1403548945, 1403548944, 1403548942, 1403548934, 1403548932, 1403548931, 1403548930, 1403548929, 1403548928, 1403548926, 1403548924, 1403548873, 1403548866] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548945', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548944', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548942', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548934', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548932', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548931', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548930', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548929', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548928', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548926', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548924', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548873', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548866', None, None, None, None, None, '4329239') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.01597452163696289 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.919987916946411 time spend to save output : 0.016339778900146484 total time spend for step 9 : 9.936327695846558 step10:split_time_score Mon Jan 12 22:45:29 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('19', 13),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 12012026 30095678 Nombre de photos uploadées : 13 / 23040 (0%) 12012026 30095678 Nombre de photos taguées (types de déchets): 0 / 13 (0%) 12012026 30095678 Nombre de photos taguées (volume) : 0 / 13 (0%) elapsed_time : load_data_split_time_score 3.5762786865234375e-06 elapsed_time : order_list_meta_photo_and_scores 1.2159347534179688e-05 ????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0007331371307373047 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.24235749244689941 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.03716540222301488 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30090575_12-01-2026_11_08_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30090575 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30090575 AND mptpi.`type`=3726 To do Qualite : 0.03407844745125184 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30090235_12-01-2026_10_05_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30090235 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30090235 AND mptpi.`type`=3726 To do Qualite : 0.03970347315771708 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30090236_12-01-2026_10_08_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30090236 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30090236 AND mptpi.`type`=3726 To do Qualite : 0.07820524691358025 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30090237_12-01-2026_10_14_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30090237 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30090237 AND mptpi.`type`=3594 To do Qualite : 0.03187620563271606 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30091324_12-01-2026_11_42_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30091324 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30091324 AND mptpi.`type`=3594 To do Qualite : 0.04237756129972566 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30092159_12-01-2026_17_43_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30092159 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30092159 AND mptpi.`type`=3594 To do Qualite : 0.044608947763761064 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30092636_12-01-2026_18_05_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30092636 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30092636 AND mptpi.`type`=3726 To do Qualite : 0.014486374796234302 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30092998_12-01-2026_20_32_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30092998 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30092998 AND mptpi.`type`=3726 To do Qualite : 0.03135259232833271 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30094223_12-01-2026_22_14_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30094223 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30094223 AND mptpi.`type`=3726 To do Qualite : 0.07248476039891767 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30094225_12-01-2026_22_09_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30094225 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30094225 AND mptpi.`type`=3726 To do Qualite : 0.046829651583847755 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30094227_12-01-2026_22_09_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30094227 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30094227 AND mptpi.`type`=3726 To do Qualite : 0.044634081196581195 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30095678_12-01-2026_22_45_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30095678 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30095678 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'12012026': {'nb_upload': 13, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1403548945, 1403548944, 1403548942, 1403548934, 1403548932, 1403548931, 1403548930, 1403548929, 1403548928, 1403548926, 1403548924, 1403548873, 1403548866] Looping around the photos to save general results len do output : 1 /30095678Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548945', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548944', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548942', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548934', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548932', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548931', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548930', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548929', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548928', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548926', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548924', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548873', None, None, None, None, None, '4329239') ('3318', None, None, None, None, None, None, None, '4329239') ('3318', '30095678', '1403548866', None, None, None, None, None, '4329239') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.015057563781738281 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.3178777694702148 time spend to save output : 0.015262126922607422 total time spend for step 10 : 1.3331398963928223 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 13 set_done_treatment 128.51user 138.88system 5:04.88elapsed 87%CPU (0avgtext+0avgdata 4868636maxresident)k 1149216inputs+122392outputs (11162major+12971637minor)pagefaults 0swaps