python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2474464 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4330231'] with mtr_portfolio_ids : ['30115050'] and first list_photo_ids : [] new path : /proc/2474464/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 13 ; length of list_pids : 13 ; length of list_args : 13 time to download the photos : 2.439028739929199 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed Jan 14 18:10:29 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10605 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2026-01-14 18:10:32.080568: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2026-01-14 18:10:32.106471: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2026-01-14 18:10:32.110452: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fe168000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2026-01-14 18:10:32.110552: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2026-01-14 18:10:32.113373: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2026-01-14 18:10:32.408023: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x102373d0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2026-01-14 18:10:32.408081: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2026-01-14 18:10:32.408918: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-14 18:10:32.409549: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-14 18:10:32.413214: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-14 18:10:32.416448: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-14 18:10:32.417383: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-14 18:10:32.421099: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-14 18:10:32.423270: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-14 18:10:32.431758: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-14 18:10:32.433425: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-14 18:10:32.433531: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-14 18:10:32.434398: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-14 18:10:32.434420: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-14 18:10:32.434437: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-14 18:10:32.436185: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9826 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2026-01-14 18:10:32.749508: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-14 18:10:32.749655: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-14 18:10:32.749678: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-14 18:10:32.749697: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-14 18:10:32.749714: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-14 18:10:32.749733: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-14 18:10:32.749746: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-14 18:10:32.749761: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-14 18:10:32.751069: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-14 18:10:32.752323: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-14 18:10:32.752356: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-14 18:10:32.752372: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-14 18:10:32.752384: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-14 18:10:32.752397: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-14 18:10:32.752409: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-14 18:10:32.752421: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-14 18:10:32.752433: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-14 18:10:32.753650: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-14 18:10:32.753688: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-14 18:10:32.753696: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-14 18:10:32.753703: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-14 18:10:32.754989: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9826 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2026-01-14 18:10:45.844537: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-14 18:10:46.010508: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 9 Detection mask done ! Trying to reset tf kernel 2474806 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5316 tf kernel not reseted sub process len(results) : 13 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 13 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10605 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [0, 2412, 162, 2742] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007865428924560547 nb_pixel_total : 37133 time to create 1 rle with old method : 0.040697574615478516 length of segment : 150 DEBUG bbox = [1770, 990, 2022, 1188] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004868507385253906 nb_pixel_total : 28234 time to create 1 rle with old method : 0.03152799606323242 length of segment : 251 DEBUG bbox = [0, 1722, 210, 2184] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010218620300292969 nb_pixel_total : 59246 time to create 1 rle with old method : 0.06604528427124023 length of segment : 185 DEBUG bbox = [12, 210, 150, 444] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003447532653808594 nb_pixel_total : 23381 time to create 1 rle with old method : 0.026989221572875977 length of segment : 123 DEBUG bbox = [216, 528, 396, 684] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00026416778564453125 nb_pixel_total : 13435 time to create 1 rle with old method : 0.015380859375 length of segment : 163 DEBUG bbox = [936, 1224, 1308, 1764] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0027086734771728516 nb_pixel_total : 103453 time to create 1 rle with old method : 0.11361145973205566 length of segment : 340 DEBUG bbox = [84, 2586, 414, 2940] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009953975677490234 nb_pixel_total : 53469 time to create 1 rle with old method : 0.06572723388671875 length of segment : 306 DEBUG bbox = [1728, 2574, 1938, 2868] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006442070007324219 nb_pixel_total : 39126 time to create 1 rle with old method : 0.05064702033996582 length of segment : 194 DEBUG bbox = [1548, 1128, 1896, 1422] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011196136474609375 nb_pixel_total : 35570 time to create 1 rle with old method : 0.04422712326049805 length of segment : 289 DEBUG bbox = [270, 2976, 510, 3156] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004825592041015625 nb_pixel_total : 25509 time to create 1 rle with old method : 0.029901742935180664 length of segment : 226 DEBUG bbox = [12, 2514, 126, 2682] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00021123886108398438 nb_pixel_total : 12828 time to create 1 rle with old method : 0.015400886535644531 length of segment : 106 DEBUG bbox = [594, 1014, 882, 1464] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009746551513671875 nb_pixel_total : 57669 time to create 1 rle with old method : 0.0680384635925293 length of segment : 233 DEBUG bbox = [1542, 2526, 1968, 2772] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009655952453613281 nb_pixel_total : 53478 time to create 1 rle with old method : 0.06242108345031738 length of segment : 384 DEBUG bbox = [930, 762, 1158, 870] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002875328063964844 nb_pixel_total : 17885 time to create 1 rle with old method : 0.023307323455810547 length of segment : 211 DEBUG bbox = [384, 1626, 918, 2148] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.003551483154296875 nb_pixel_total : 168454 time to create 1 rle with new method : 0.010028600692749023 length of segment : 506 DEBUG bbox = [1392, 1416, 1578, 1710] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004639625549316406 nb_pixel_total : 27113 time to create 1 rle with old method : 0.03103494644165039 length of segment : 173 DEBUG bbox = [396, 2544, 822, 3006] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015637874603271484 nb_pixel_total : 107455 time to create 1 rle with old method : 0.12450027465820312 length of segment : 403 DEBUG bbox = [978, 1626, 1206, 1938] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009677410125732422 nb_pixel_total : 48149 time to create 1 rle with old method : 0.07651996612548828 length of segment : 223 DEBUG bbox = [1476, 210, 2040, 732] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002254486083984375 nb_pixel_total : 146799 time to create 1 rle with old method : 0.16909503936767578 length of segment : 477 DEBUG bbox = [1920, 636, 2118, 828] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005257129669189453 nb_pixel_total : 27363 time to create 1 rle with old method : 0.04111838340759277 length of segment : 253 DEBUG bbox = [1956, 1614, 2142, 1788] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00043964385986328125 nb_pixel_total : 23973 time to create 1 rle with old method : 0.027712345123291016 length of segment : 174 DEBUG bbox = [1722, 1884, 1866, 2076] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00024962425231933594 nb_pixel_total : 13906 time to create 1 rle with old method : 0.016521215438842773 length of segment : 129 DEBUG bbox = [1272, 3036, 1728, 3264] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010514259338378906 nb_pixel_total : 45135 time to create 1 rle with old method : 0.052544355392456055 length of segment : 459 DEBUG bbox = [702, 948, 888, 1224] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00047969818115234375 nb_pixel_total : 37867 time to create 1 rle with old method : 0.050487518310546875 length of segment : 183 DEBUG bbox = [1050, 1464, 1350, 1830] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008914470672607422 nb_pixel_total : 52348 time to create 1 rle with old method : 0.058249473571777344 length of segment : 271 DEBUG bbox = [420, 2358, 576, 2658] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003981590270996094 nb_pixel_total : 27916 time to create 1 rle with old method : 0.03195476531982422 length of segment : 129 DEBUG bbox = [1668, 1506, 1800, 1734] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00026726722717285156 nb_pixel_total : 15103 time to create 1 rle with old method : 0.017560720443725586 length of segment : 110 DEBUG bbox = [582, 2628, 738, 2862] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003509521484375 nb_pixel_total : 21932 time to create 1 rle with old method : 0.025613784790039062 length of segment : 150 DEBUG bbox = [474, 1254, 954, 1560] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012485980987548828 nb_pixel_total : 79777 time to create 1 rle with old method : 0.09111714363098145 length of segment : 429 DEBUG bbox = [882, 2040, 1218, 2466] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011680126190185547 nb_pixel_total : 64399 time to create 1 rle with old method : 0.0728306770324707 length of segment : 251 DEBUG bbox = [144, 1938, 378, 2136] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004405975341796875 nb_pixel_total : 28372 time to create 1 rle with old method : 0.03879737854003906 length of segment : 224 DEBUG bbox = [1002, 426, 1242, 618] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004649162292480469 nb_pixel_total : 25979 time to create 1 rle with old method : 0.03250741958618164 length of segment : 204 DEBUG bbox = [870, 2562, 996, 2658] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00015091896057128906 nb_pixel_total : 8160 time to create 1 rle with old method : 0.00932621955871582 length of segment : 112 DEBUG bbox = [666, 2160, 840, 2370] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00031757354736328125 nb_pixel_total : 16968 time to create 1 rle with old method : 0.023113012313842773 length of segment : 155 DEBUG bbox = [150, 1398, 486, 1614] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006129741668701172 nb_pixel_total : 31716 time to create 1 rle with old method : 0.03716468811035156 length of segment : 319 DEBUG bbox = [222, 1830, 618, 2028] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007476806640625 nb_pixel_total : 28561 time to create 1 rle with old method : 0.03395843505859375 length of segment : 382 DEBUG bbox = [774, 168, 1068, 366] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005939006805419922 nb_pixel_total : 39367 time to create 1 rle with old method : 0.04539966583251953 length of segment : 290 DEBUG bbox = [54, 2220, 438, 2814] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017197132110595703 nb_pixel_total : 95227 time to create 1 rle with old method : 0.1119997501373291 length of segment : 338 DEBUG bbox = [474, 798, 606, 942] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002193450927734375 nb_pixel_total : 12167 time to create 1 rle with old method : 0.014679193496704102 length of segment : 113 DEBUG bbox = [1212, 528, 2082, 1506] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.15577316284179688 nb_pixel_total : 524963 time to create 1 rle with new method : 0.04126739501953125 length of segment : 990 DEBUG bbox = [30, 714, 396, 1278] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0014963150024414062 nb_pixel_total : 104204 time to create 1 rle with old method : 0.12362957000732422 length of segment : 322 DEBUG bbox = [30, 234, 204, 336] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000209808349609375 nb_pixel_total : 13295 time to create 1 rle with old method : 0.01511240005493164 length of segment : 173 DEBUG bbox = [384, 54, 594, 324] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007426738739013672 nb_pixel_total : 36380 time to create 1 rle with old method : 0.04661273956298828 length of segment : 193 DEBUG bbox = [204, 522, 498, 744] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008237361907958984 nb_pixel_total : 32312 time to create 1 rle with old method : 0.03657054901123047 length of segment : 275 DEBUG bbox = [246, 2490, 486, 2700] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007612705230712891 nb_pixel_total : 31424 time to create 1 rle with old method : 0.035346031188964844 length of segment : 220 DEBUG bbox = [1698, 1422, 1824, 1512] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0001342296600341797 nb_pixel_total : 7541 time to create 1 rle with old method : 0.008767127990722656 length of segment : 118 DEBUG bbox = [1092, 1092, 1332, 1392] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015425682067871094 nb_pixel_total : 35789 time to create 1 rle with old method : 0.04531574249267578 length of segment : 208 DEBUG bbox = [1464, 2184, 1626, 2352] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005748271942138672 nb_pixel_total : 16858 time to create 1 rle with old method : 0.01965022087097168 length of segment : 185 DEBUG bbox = [684, 138, 888, 384] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009005069732666016 nb_pixel_total : 32648 time to create 1 rle with old method : 0.03725481033325195 length of segment : 193 DEBUG bbox = [78, 3030, 606, 3606] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004077434539794922 nb_pixel_total : 146259 time to create 1 rle with old method : 0.16173648834228516 length of segment : 444 DEBUG bbox = [0, 2874, 246, 3228] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009984970092773438 nb_pixel_total : 40423 time to create 1 rle with old method : 0.045432329177856445 length of segment : 237 DEBUG bbox = [1992, 1836, 2160, 2016] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00055694580078125 nb_pixel_total : 19272 time to create 1 rle with old method : 0.021939754486083984 length of segment : 160 DEBUG bbox = [1674, 1776, 1770, 1950] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003535747528076172 nb_pixel_total : 9935 time to create 1 rle with old method : 0.011963844299316406 length of segment : 77 DEBUG bbox = [408, 1062, 858, 1350] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0021393299102783203 nb_pixel_total : 89610 time to create 1 rle with old method : 0.10074973106384277 length of segment : 517 DEBUG bbox = [552, 2862, 750, 3084] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007786750793457031 nb_pixel_total : 26423 time to create 1 rle with old method : 0.029842376708984375 length of segment : 184 DEBUG bbox = [0, 3048, 144, 3264] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002701282501220703 nb_pixel_total : 14837 time to create 1 rle with old method : 0.01684403419494629 length of segment : 141 DEBUG bbox = [1764, 2598, 2022, 2880] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012354850769042969 nb_pixel_total : 32366 time to create 1 rle with old method : 0.036325931549072266 length of segment : 222 DEBUG bbox = [408, 888, 630, 1170] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001207113265991211 nb_pixel_total : 47415 time to create 1 rle with old method : 0.052431344985961914 length of segment : 216 DEBUG bbox = [1032, 450, 1320, 672] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012018680572509766 nb_pixel_total : 32998 time to create 1 rle with old method : 0.03982257843017578 length of segment : 246 DEBUG bbox = [1614, 1206, 1830, 1452] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011410713195800781 nb_pixel_total : 32755 time to create 1 rle with old method : 0.04866623878479004 length of segment : 194 DEBUG bbox = [198, 2760, 510, 3114] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0019102096557617188 nb_pixel_total : 70169 time to create 1 rle with old method : 0.07741379737854004 length of segment : 290 DEBUG bbox = [1284, 426, 1470, 666] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008111000061035156 nb_pixel_total : 26576 time to create 1 rle with old method : 0.03110361099243164 length of segment : 168 DEBUG bbox = [954, 2670, 1062, 2784] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00031876564025878906 nb_pixel_total : 9791 time to create 1 rle with old method : 0.011577606201171875 length of segment : 108 DEBUG bbox = [228, 378, 696, 690] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0025866031646728516 nb_pixel_total : 94538 time to create 1 rle with old method : 0.11602449417114258 length of segment : 870 DEBUG bbox = [744, 312, 1080, 546] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016851425170898438 nb_pixel_total : 34797 time to create 1 rle with old method : 0.04519343376159668 length of segment : 314 DEBUG bbox = [354, 720, 672, 840] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005826950073242188 nb_pixel_total : 21811 time to create 1 rle with old method : 0.026458263397216797 length of segment : 289 DEBUG bbox = [36, 258, 216, 474] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003552436828613281 nb_pixel_total : 26233 time to create 1 rle with old method : 0.030449390411376953 length of segment : 156 DEBUG bbox = [546, 1920, 834, 2244] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007662773132324219 nb_pixel_total : 53567 time to create 1 rle with old method : 0.06222820281982422 length of segment : 259 DEBUG bbox = [1590, 498, 1824, 660] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003390312194824219 nb_pixel_total : 16937 time to create 1 rle with old method : 0.01912689208984375 length of segment : 184 DEBUG bbox = [912, 1536, 1320, 1980] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.005731344223022461 nb_pixel_total : 97409 time to create 1 rle with old method : 0.13693737983703613 length of segment : 399 DEBUG bbox = [1638, 1404, 1956, 1782] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018291473388671875 nb_pixel_total : 60378 time to create 1 rle with old method : 0.0702517032623291 length of segment : 283 DEBUG bbox = [1572, 1824, 1920, 2196] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017774105072021484 nb_pixel_total : 68974 time to create 1 rle with old method : 0.08108901977539062 length of segment : 395 DEBUG bbox = [582, 750, 732, 936] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005533695220947266 nb_pixel_total : 17739 time to create 1 rle with old method : 0.02104663848876953 length of segment : 135 DEBUG bbox = [234, 2262, 426, 2430] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006322860717773438 nb_pixel_total : 14754 time to create 1 rle with old method : 0.01782679557800293 length of segment : 171 DEBUG bbox = [1086, 210, 1668, 732] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0036640167236328125 nb_pixel_total : 106076 time to create 1 rle with old method : 0.12197256088256836 length of segment : 566 DEBUG bbox = [1704, 2316, 2160, 2898] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0033960342407226562 nb_pixel_total : 159169 time to create 1 rle with new method : 0.005370140075683594 length of segment : 526 DEBUG bbox = [792, 2376, 1038, 2706] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001190185546875 nb_pixel_total : 36301 time to create 1 rle with old method : 0.04317212104797363 length of segment : 316 DEBUG bbox = [1002, 156, 1260, 354] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.000659942626953125 nb_pixel_total : 30038 time to create 1 rle with old method : 0.03492450714111328 length of segment : 240 DEBUG bbox = [1602, 486, 2022, 924] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0023343563079833984 nb_pixel_total : 97786 time to create 1 rle with old method : 0.11571931838989258 length of segment : 408 DEBUG bbox = [6, 1644, 240, 1902] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009207725524902344 nb_pixel_total : 33257 time to create 1 rle with old method : 0.038216352462768555 length of segment : 213 DEBUG bbox = [882, 456, 1146, 714] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009515285491943359 nb_pixel_total : 42281 time to create 1 rle with old method : 0.050453901290893555 length of segment : 260 DEBUG bbox = [1002, 2682, 1236, 2880] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006966590881347656 nb_pixel_total : 27007 time to create 1 rle with old method : 0.03225111961364746 length of segment : 219 DEBUG bbox = [1524, 792, 1662, 942] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00035309791564941406 nb_pixel_total : 14096 time to create 1 rle with old method : 0.02109217643737793 length of segment : 133 time spent for convertir_results : 7.500371932983398 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 83 chid ids of type : 3594 Number RLEs to save : 22035 save missing photos in datou_result : time spend for datou_step_exec : 74.93370246887207 time spend to save output : 1.480804204940796 total time spend for step 1 : 76.41450667381287 step2:crop_condition Wed Jan 14 18:11:45 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 13 ! batch 1 Loaded 83 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 32 About to insert : list_path_to_insert length 32 new photo from crops ! About to upload 32 photos upload in portfolio : 3736932 init cache_photo without model_param we have 32 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768410717_2474464 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829085_804b31ca3f9839adc45489de68657045_rle_crop_4099739210_0.png', 0, 190, 232, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829085_804b31ca3f9839adc45489de68657045_rle_crop_4099739214_0.png', 0, 503, 340, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829083_be7d9982c744284c4646b21f01a0038a_rle_crop_4099739217_0.png', 0, 272, 273, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829081_9bccd9a29c6d5fa632073fbdfe4f328b_rle_crop_4099739221_0.png', 0, 232, 350, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829081_9bccd9a29c6d5fa632073fbdfe4f328b_rle_crop_4099739222_0.png', 0, 100, 210, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829078_85809804bbe94726ae089a4ea1aa57af_rle_crop_4099739223_0.png', 0, 516, 499, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829078_85809804bbe94726ae089a4ea1aa57af_rle_crop_4099739224_0.png', 0, 260, 173, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829077_2ae3827fdec73cbfdf7ea539b177381e_rle_crop_4099739229_0.png', 0, 161, 174, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829077_2ae3827fdec73cbfdf7ea539b177381e_rle_crop_4099739230_0.png', 0, 180, 116, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829077_2ae3827fdec73cbfdf7ea539b177381e_rle_crop_4099739232_0.png', 0, 275, 170, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829077_2ae3827fdec73cbfdf7ea539b177381e_rle_crop_4099739233_0.png', 0, 324, 244, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829077_2ae3827fdec73cbfdf7ea539b177381e_rle_crop_4099739234_0.png', 0, 289, 127, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829077_2ae3827fdec73cbfdf7ea539b177381e_rle_crop_4099739235_0.png', 0, 187, 109, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829071_d7d09675a6a39c5d64c0b3f8c5dfdad6_rle_crop_4099739237_0.png', 0, 279, 428, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829071_d7d09675a6a39c5d64c0b3f8c5dfdad6_rle_crop_4099739239_0.png', 0, 188, 223, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829071_d7d09675a6a39c5d64c0b3f8c5dfdad6_rle_crop_4099739242_0.png', 0, 200, 155, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829068_14498c70a403b22e0a899a334b939818_rle_crop_4099739244_0.png', 0, 165, 382, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829068_14498c70a403b22e0a899a334b939818_rle_crop_4099739248_0.png', 0, 927, 826, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829065_2fec9bae7714dd7e40a9927559bb3cf1_rle_crop_4099739249_0.png', 0, 519, 316, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829065_2fec9bae7714dd7e40a9927559bb3cf1_rle_crop_4099739252_0.png', 0, 220, 232, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829065_2fec9bae7714dd7e40a9927559bb3cf1_rle_crop_4099739254_0.png', 0, 78, 117, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739255_0.png', 0, 254, 208, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739258_0.png', 0, 511, 412, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739259_0.png', 0, 320, 226, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739260_0.png', 0, 175, 160, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739261_0.png', 0, 168, 72, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739262_0.png', 0, 284, 417, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739264_0.png', 0, 195, 132, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739268_0.png', 0, 243, 194, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739269_0.png', 0, 329, 276, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829058_a1c11552d7290f30e8ba4a863beae50e_rle_crop_4099739278_0.png', 0, 440, 335, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410724), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403828979_f579e16ab1e4c055ba134ae0fb4382ae_rle_crop_4099739281_0.png', 0, 175, 135, 0, 1768410724,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 32 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.761741876602173 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 3736932 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768410730_2474464 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410732), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829085_804b31ca3f9839adc45489de68657045_rle_crop_4099739213_0.png', 0, 127, 163, 0, 1768410732,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410732), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829083_be7d9982c744284c4646b21f01a0038a_rle_crop_4099739215_0.png', 0, 305, 303, 0, 1768410732,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410732), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829083_be7d9982c744284c4646b21f01a0038a_rle_crop_4099739218_0.png', 0, 176, 218, 0, 1768410732,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410732), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829078_85809804bbe94726ae089a4ea1aa57af_rle_crop_4099739225_0.png', 0, 394, 395, 0, 1768410732,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410732), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829077_2ae3827fdec73cbfdf7ea539b177381e_rle_crop_4099739236_0.png', 0, 215, 150, 0, 1768410732,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410732), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829071_d7d09675a6a39c5d64c0b3f8c5dfdad6_rle_crop_4099739238_0.png', 0, 368, 234, 0, 1768410732,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410732), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829071_d7d09675a6a39c5d64c0b3f8c5dfdad6_rle_crop_4099739241_0.png', 0, 91, 111, 0, 1768410732,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410732), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829068_14498c70a403b22e0a899a334b939818_rle_crop_4099739243_0.png', 0, 202, 274, 0, 1768410732,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410732), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829065_2fec9bae7714dd7e40a9927559bb3cf1_rle_crop_4099739253_0.png', 0, 200, 218, 0, 1768410732,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410732), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739257_0.png', 0, 230, 193, 0, 1768410732,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410732), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739263_0.png', 0, 207, 180, 0, 1768410732,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410732), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829058_a1c11552d7290f30e8ba4a863beae50e_rle_crop_4099739280_0.png', 0, 308, 298, 0, 1768410732,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410732), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403828979_f579e16ab1e4c055ba134ae0fb4382ae_rle_crop_4099739282_0.png', 0, 140, 171, 0, 1768410732,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410732), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403828979_f579e16ab1e4c055ba134ae0fb4382ae_rle_crop_4099739285_0.png', 0, 310, 215, 0, 1768410732,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 14 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.5727996826171875 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 3736932 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768410737_2474464 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410739), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829071_d7d09675a6a39c5d64c0b3f8c5dfdad6_rle_crop_4099739240_0.png', 0, 156, 204, 0, 1768410739,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410739), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829068_14498c70a403b22e0a899a334b939818_rle_crop_4099739245_0.png', 0, 168, 290, 0, 1768410739,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410739), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829068_14498c70a403b22e0a899a334b939818_rle_crop_4099739247_0.png', 0, 134, 110, 0, 1768410739,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410739), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829065_2fec9bae7714dd7e40a9927559bb3cf1_rle_crop_4099739250_0.png', 0, 93, 173, 0, 1768410739,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410739), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829065_2fec9bae7714dd7e40a9927559bb3cf1_rle_crop_4099739251_0.png', 0, 250, 193, 0, 1768410739,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410739), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739267_0.png', 0, 189, 246, 0, 1768410739,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410739), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739270_0.png', 0, 207, 168, 0, 1768410739,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410739), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829058_a1c11552d7290f30e8ba4a863beae50e_rle_crop_4099739277_0.png', 0, 141, 184, 0, 1768410739,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 8 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.8490030765533447 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 23 About to insert : list_path_to_insert length 23 new photo from crops ! About to upload 23 photos upload in portfolio : 3736932 init cache_photo without model_param we have 23 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768410747_2474464 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410752), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829085_804b31ca3f9839adc45489de68657045_rle_crop_4099739209_0.png', 0, 308, 148, 0, 1768410752,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410752), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829085_804b31ca3f9839adc45489de68657045_rle_crop_4099739211_0.png', 0, 446, 185, 0, 1768410752,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410752), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829085_804b31ca3f9839adc45489de68657045_rle_crop_4099739212_0.png', 0, 225, 122, 0, 1768410752,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410752), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829083_be7d9982c744284c4646b21f01a0038a_rle_crop_4099739219_0.png', 0, 136, 106, 0, 1768410752,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410752), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829081_9bccd9a29c6d5fa632073fbdfe4f328b_rle_crop_4099739220_0.png', 0, 354, 233, 0, 1768410752,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410752), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829078_85809804bbe94726ae089a4ea1aa57af_rle_crop_4099739226_0.png', 0, 303, 223, 0, 1768410752,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410752), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829078_85809804bbe94726ae089a4ea1aa57af_rle_crop_4099739227_0.png', 0, 450, 419, 0, 1768410752,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410752), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829078_85809804bbe94726ae089a4ea1aa57af_rle_crop_4099739228_0.png', 0, 187, 195, 0, 1768410752,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410752), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829077_2ae3827fdec73cbfdf7ea539b177381e_rle_crop_4099739231_0.png', 0, 196, 442, 0, 1768410752,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410752), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829068_14498c70a403b22e0a899a334b939818_rle_crop_4099739246_0.png', 0, 510, 338, 0, 1768410752,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410752), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739265_0.png', 0, 225, 222, 0, 1768410752,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410752), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739266_0.png', 0, 281, 216, 0, 1768410752,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410752), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739272_0.png', 0, 304, 465, 0, 1768410752,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410752), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739273_0.png', 0, 191, 314, 0, 1768410752,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410752), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739274_0.png', 0, 119, 289, 0, 1768410752,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410752), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829058_a1c11552d7290f30e8ba4a863beae50e_rle_crop_4099739275_0.png', 0, 204, 150, 0, 1768410752,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410752), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829058_a1c11552d7290f30e8ba4a863beae50e_rle_crop_4099739276_0.png', 0, 318, 253, 0, 1768410752,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410752), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829058_a1c11552d7290f30e8ba4a863beae50e_rle_crop_4099739279_0.png', 0, 339, 283, 0, 1768410752,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410752), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403828979_f579e16ab1e4c055ba134ae0fb4382ae_rle_crop_4099739283_0.png', 0, 399, 561, 0, 1768410752,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410752), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403828979_f579e16ab1e4c055ba134ae0fb4382ae_rle_crop_4099739284_0.png', 0, 552, 403, 0, 1768410752,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410752), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403828979_f579e16ab1e4c055ba134ae0fb4382ae_rle_crop_4099739286_0.png', 0, 169, 240, 0, 1768410752,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410752), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403828979_f579e16ab1e4c055ba134ae0fb4382ae_rle_crop_4099739287_0.png', 0, 381, 407, 0, 1768410752,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410752), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403828979_f579e16ab1e4c055ba134ae0fb4382ae_rle_crop_4099739288_0.png', 0, 256, 213, 0, 1768410752,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 23 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.635070323944092 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1768410756_2474464 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410758), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829083_be7d9982c744284c4646b21f01a0038a_rle_crop_4099739216_0.png', 0, 281, 194, 0, 1768410758,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410758), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739256_0.png', 0, 156, 137, 0, 1768410758,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410758), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739271_0.png', 0, 109, 108, 0, 1768410758,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410758), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403828946_699a8ba46dd5d6d7034a62b8c11fe62a_rle_crop_4099739289_0.png', 0, 256, 247, 0, 1768410758,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410758), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403828946_699a8ba46dd5d6d7034a62b8c11fe62a_rle_crop_4099739290_0.png', 0, 180, 219, 0, 1768410758,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1768410758), 0.0, 0.0, 14, '', 0, 0, '1768410626_2474464_1403828946_699a8ba46dd5d6d7034a62b8c11fe62a_rle_crop_4099739291_0.png', 0, 126, 133, 0, 1768410758,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.10996675491333 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1403829085, 1403829083, 1403829081, 1403829078, 1403829077, 1403829071, 1403829068, 1403829065, 1403829063, 1403829060, 1403829058, 1403828979, 1403828946] Looping around the photos to save general results len do output : 83 /1403831854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403831918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403832098Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829085', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829083', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829081', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829078', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829077', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829071', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829068', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829065', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829063', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829060', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829058', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403828979', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403828946', None, None, None, None, None, '4330231') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 262 time used for this insertion : 0.04257035255432129 save_final save missing photos in datou_result : time spend for datou_step_exec : 52.98617243766785 time spend to save output : 0.046044111251831055 total time spend for step 2 : 53.03221654891968 step3:rle_unique_nms_with_priority Wed Jan 14 18:12:38 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 83 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 3.5972607135772705 time for calcul the mask position with numpy : 0.48017287254333496 nb_pixel_total : 8029518 time to create 1 rle with new method : 0.8356075286865234 time for calcul the mask position with numpy : 0.02480340003967285 nb_pixel_total : 103453 time to create 1 rle with old method : 0.1169135570526123 time for calcul the mask position with numpy : 0.02334427833557129 nb_pixel_total : 13435 time to create 1 rle with old method : 0.014997482299804688 time for calcul the mask position with numpy : 0.024808168411254883 nb_pixel_total : 23381 time to create 1 rle with old method : 0.0266268253326416 time for calcul the mask position with numpy : 0.02504587173461914 nb_pixel_total : 59246 time to create 1 rle with old method : 0.0667717456817627 time for calcul the mask position with numpy : 0.025501728057861328 nb_pixel_total : 28234 time to create 1 rle with old method : 0.03743314743041992 time for calcul the mask position with numpy : 0.023058652877807617 nb_pixel_total : 37133 time to create 1 rle with old method : 0.041028738021850586 create new chi : 1.8028738498687744 time to delete rle : 0.02792048454284668 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 4584 TO DO : save crop sub photo not yet done ! save time : 0.37133312225341797 nb_obj : 5 nb_hashtags : 4 time to prepare the origin masks : 3.527890205383301 time for calcul the mask position with numpy : 0.7608718872070312 nb_pixel_total : 8127898 time to create 1 rle with new method : 1.082885503768921 time for calcul the mask position with numpy : 0.02386331558227539 nb_pixel_total : 12828 time to create 1 rle with old method : 0.014592647552490234 time for calcul the mask position with numpy : 0.024127721786499023 nb_pixel_total : 25509 time to create 1 rle with old method : 0.02927708625793457 time for calcul the mask position with numpy : 0.025545358657836914 nb_pixel_total : 35570 time to create 1 rle with old method : 0.04003548622131348 time for calcul the mask position with numpy : 0.025258779525756836 nb_pixel_total : 39126 time to create 1 rle with old method : 0.04612302780151367 time for calcul the mask position with numpy : 0.026839494705200195 nb_pixel_total : 53469 time to create 1 rle with old method : 0.059302568435668945 create new chi : 2.2037081718444824 time to delete rle : 0.0006549358367919922 batch 1 Loaded 11 chid ids of type : 3594 +++++Number RLEs to save : 4402 TO DO : save crop sub photo not yet done ! save time : 0.35013628005981445 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 2.0542662143707275 time for calcul the mask position with numpy : 0.5758852958679199 nb_pixel_total : 8165368 time to create 1 rle with new method : 0.7683489322662354 time for calcul the mask position with numpy : 0.022891521453857422 nb_pixel_total : 17885 time to create 1 rle with old method : 0.01940155029296875 time for calcul the mask position with numpy : 0.02291727066040039 nb_pixel_total : 53478 time to create 1 rle with old method : 0.057431697845458984 time for calcul the mask position with numpy : 0.0225980281829834 nb_pixel_total : 57669 time to create 1 rle with old method : 0.06082344055175781 create new chi : 1.5918965339660645 time to delete rle : 0.0005185604095458984 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 3816 TO DO : save crop sub photo not yet done ! save time : 0.3022043704986572 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 3.4165186882019043 time for calcul the mask position with numpy : 0.7009687423706055 nb_pixel_total : 7769067 time to create 1 rle with new method : 0.7848649024963379 time for calcul the mask position with numpy : 0.022394418716430664 nb_pixel_total : 27363 time to create 1 rle with old method : 0.028772830963134766 time for calcul the mask position with numpy : 0.023916244506835938 nb_pixel_total : 146799 time to create 1 rle with old method : 0.15587878227233887 time for calcul the mask position with numpy : 0.02352166175842285 nb_pixel_total : 48149 time to create 1 rle with old method : 0.0505521297454834 time for calcul the mask position with numpy : 0.02353191375732422 nb_pixel_total : 107455 time to create 1 rle with old method : 0.1141045093536377 time for calcul the mask position with numpy : 0.02309870719909668 nb_pixel_total : 27113 time to create 1 rle with old method : 0.0289461612701416 time for calcul the mask position with numpy : 0.023319721221923828 nb_pixel_total : 168454 time to create 1 rle with new method : 0.5925812721252441 create new chi : 2.6648595333099365 time to delete rle : 0.0008502006530761719 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 6230 TO DO : save crop sub photo not yet done ! save time : 0.44199323654174805 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 3.7296364307403564 time for calcul the mask position with numpy : 0.7182722091674805 nb_pixel_total : 8056220 time to create 1 rle with new method : 0.6001996994018555 time for calcul the mask position with numpy : 0.02253890037536621 nb_pixel_total : 21932 time to create 1 rle with old method : 0.0234377384185791 time for calcul the mask position with numpy : 0.022399187088012695 nb_pixel_total : 15103 time to create 1 rle with old method : 0.01648998260498047 time for calcul the mask position with numpy : 0.02273702621459961 nb_pixel_total : 27916 time to create 1 rle with old method : 0.03057861328125 time for calcul the mask position with numpy : 0.023560523986816406 nb_pixel_total : 52348 time to create 1 rle with old method : 0.05556130409240723 time for calcul the mask position with numpy : 0.023654937744140625 nb_pixel_total : 37867 time to create 1 rle with old method : 0.04033851623535156 time for calcul the mask position with numpy : 0.02271103858947754 nb_pixel_total : 45135 time to create 1 rle with old method : 0.0523221492767334 time for calcul the mask position with numpy : 0.02648186683654785 nb_pixel_total : 13906 time to create 1 rle with old method : 0.017511844635009766 time for calcul the mask position with numpy : 0.031180381774902344 nb_pixel_total : 23973 time to create 1 rle with old method : 0.0325016975402832 create new chi : 1.8242003917694092 time to delete rle : 0.0010840892791748047 batch 1 Loaded 17 chid ids of type : 3594 ++++++++Number RLEs to save : 5370 TO DO : save crop sub photo not yet done ! save time : 0.38722968101501465 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 3.0021867752075195 time for calcul the mask position with numpy : 0.5597891807556152 nb_pixel_total : 8070745 time to create 1 rle with new method : 0.6796567440032959 time for calcul the mask position with numpy : 0.0233609676361084 nb_pixel_total : 16968 time to create 1 rle with old method : 0.019210100173950195 time for calcul the mask position with numpy : 0.02302837371826172 nb_pixel_total : 8160 time to create 1 rle with old method : 0.008765459060668945 time for calcul the mask position with numpy : 0.022194385528564453 nb_pixel_total : 25979 time to create 1 rle with old method : 0.027445554733276367 time for calcul the mask position with numpy : 0.023779630661010742 nb_pixel_total : 28372 time to create 1 rle with old method : 0.03119826316833496 time for calcul the mask position with numpy : 0.02414727210998535 nb_pixel_total : 64399 time to create 1 rle with old method : 0.06710553169250488 time for calcul the mask position with numpy : 0.022927522659301758 nb_pixel_total : 79777 time to create 1 rle with old method : 0.08524346351623535 create new chi : 1.6587841510772705 time to delete rle : 0.0006587505340576172 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 4910 TO DO : save crop sub photo not yet done ! save time : 0.36321496963500977 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 2.953892946243286 time for calcul the mask position with numpy : 0.6066257953643799 nb_pixel_total : 7562399 time to create 1 rle with new method : 0.718003511428833 time for calcul the mask position with numpy : 0.025353670120239258 nb_pixel_total : 524963 time to create 1 rle with new method : 0.8071835041046143 time for calcul the mask position with numpy : 0.022642850875854492 nb_pixel_total : 12167 time to create 1 rle with old method : 0.013059139251708984 time for calcul the mask position with numpy : 0.023143768310546875 nb_pixel_total : 95227 time to create 1 rle with old method : 0.10005831718444824 time for calcul the mask position with numpy : 0.02354907989501953 nb_pixel_total : 39367 time to create 1 rle with old method : 0.041524410247802734 time for calcul the mask position with numpy : 0.022692203521728516 nb_pixel_total : 28561 time to create 1 rle with old method : 0.0300445556640625 time for calcul the mask position with numpy : 0.022550106048583984 nb_pixel_total : 31716 time to create 1 rle with old method : 0.03356194496154785 create new chi : 2.551861047744751 time to delete rle : 0.0010175704956054688 batch 1 Loaded 13 chid ids of type : 3594 ++++++++++Number RLEs to save : 7024 TO DO : save crop sub photo not yet done ! save time : 0.49602532386779785 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 2.8935065269470215 time for calcul the mask position with numpy : 0.6005127429962158 nb_pixel_total : 8069244 time to create 1 rle with new method : 1.5059831142425537 time for calcul the mask position with numpy : 0.02287912368774414 nb_pixel_total : 7541 time to create 1 rle with old method : 0.008260726928710938 time for calcul the mask position with numpy : 0.022422313690185547 nb_pixel_total : 31424 time to create 1 rle with old method : 0.03357434272766113 time for calcul the mask position with numpy : 0.022628068923950195 nb_pixel_total : 32312 time to create 1 rle with old method : 0.03521013259887695 time for calcul the mask position with numpy : 0.02381753921508789 nb_pixel_total : 36380 time to create 1 rle with old method : 0.04160571098327637 time for calcul the mask position with numpy : 0.023186683654785156 nb_pixel_total : 13295 time to create 1 rle with old method : 0.014332056045532227 time for calcul the mask position with numpy : 0.02333855628967285 nb_pixel_total : 104204 time to create 1 rle with old method : 0.11037683486938477 create new chi : 2.5296895503997803 time to delete rle : 0.0006902217864990234 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 4762 TO DO : save crop sub photo not yet done ! save time : 0.36484456062316895 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 4.954918146133423 time for calcul the mask position with numpy : 0.7980966567993164 nb_pixel_total : 7863483 time to create 1 rle with new method : 0.8223526477813721 time for calcul the mask position with numpy : 0.02357935905456543 nb_pixel_total : 13700 time to create 1 rle with old method : 0.014497518539428711 time for calcul the mask position with numpy : 0.022671937942504883 nb_pixel_total : 26423 time to create 1 rle with old method : 0.028486251831054688 time for calcul the mask position with numpy : 0.02625131607055664 nb_pixel_total : 89610 time to create 1 rle with old method : 0.09804797172546387 time for calcul the mask position with numpy : 0.03901958465576172 nb_pixel_total : 9935 time to create 1 rle with old method : 0.010820150375366211 time for calcul the mask position with numpy : 0.0383455753326416 nb_pixel_total : 19272 time to create 1 rle with old method : 0.021390438079833984 time for calcul the mask position with numpy : 0.03890037536621094 nb_pixel_total : 40423 time to create 1 rle with old method : 0.04408383369445801 time for calcul the mask position with numpy : 0.03676342964172363 nb_pixel_total : 146259 time to create 1 rle with old method : 0.15212392807006836 time for calcul the mask position with numpy : 0.02361321449279785 nb_pixel_total : 32648 time to create 1 rle with old method : 0.04070591926574707 time for calcul the mask position with numpy : 0.023762226104736328 nb_pixel_total : 16858 time to create 1 rle with old method : 0.018159151077270508 time for calcul the mask position with numpy : 0.023644685745239258 nb_pixel_total : 35789 time to create 1 rle with old method : 0.03788614273071289 create new chi : 2.43205189704895 time to delete rle : 0.0009648799896240234 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 6748 TO DO : save crop sub photo not yet done ! save time : 0.47109389305114746 nb_obj : 10 nb_hashtags : 4 time to prepare the origin masks : 4.969143867492676 time for calcul the mask position with numpy : 0.7126500606536865 nb_pixel_total : 7891184 time to create 1 rle with new method : 0.7758164405822754 time for calcul the mask position with numpy : 0.0397486686706543 nb_pixel_total : 21811 time to create 1 rle with old method : 0.024304866790771484 time for calcul the mask position with numpy : 0.03968310356140137 nb_pixel_total : 34797 time to create 1 rle with old method : 0.037775278091430664 time for calcul the mask position with numpy : 0.03696727752685547 nb_pixel_total : 94538 time to create 1 rle with old method : 0.10176873207092285 time for calcul the mask position with numpy : 0.035758256912231445 nb_pixel_total : 9791 time to create 1 rle with old method : 0.01076197624206543 time for calcul the mask position with numpy : 0.024043798446655273 nb_pixel_total : 26576 time to create 1 rle with old method : 0.03002762794494629 time for calcul the mask position with numpy : 0.023081541061401367 nb_pixel_total : 70169 time to create 1 rle with old method : 0.07734179496765137 time for calcul the mask position with numpy : 0.025513648986816406 nb_pixel_total : 32755 time to create 1 rle with old method : 0.03798651695251465 time for calcul the mask position with numpy : 0.02539229393005371 nb_pixel_total : 32998 time to create 1 rle with old method : 0.03867793083190918 time for calcul the mask position with numpy : 0.040024518966674805 nb_pixel_total : 47415 time to create 1 rle with old method : 0.05309700965881348 time for calcul the mask position with numpy : 0.04075431823730469 nb_pixel_total : 32366 time to create 1 rle with old method : 0.03780651092529297 create new chi : 2.3120219707489014 time to delete rle : 0.0023653507232666016 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++++Number RLEs to save : 7994 TO DO : save crop sub photo not yet done ! save time : 0.5607645511627197 nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 3.2702484130859375 time for calcul the mask position with numpy : 0.8349893093109131 nb_pixel_total : 7970902 time to create 1 rle with new method : 1.0717902183532715 time for calcul the mask position with numpy : 0.023251056671142578 nb_pixel_total : 68974 time to create 1 rle with old method : 0.07496213912963867 time for calcul the mask position with numpy : 0.039333343505859375 nb_pixel_total : 60378 time to create 1 rle with old method : 0.06827163696289062 time for calcul the mask position with numpy : 0.03847074508666992 nb_pixel_total : 97409 time to create 1 rle with old method : 0.10841512680053711 time for calcul the mask position with numpy : 0.0376584529876709 nb_pixel_total : 16937 time to create 1 rle with old method : 0.018489360809326172 time for calcul the mask position with numpy : 0.03806805610656738 nb_pixel_total : 53567 time to create 1 rle with old method : 0.058205604553222656 time for calcul the mask position with numpy : 0.036115407943725586 nb_pixel_total : 26233 time to create 1 rle with old method : 0.029557466506958008 create new chi : 2.518601655960083 time to delete rle : 0.0009014606475830078 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 5512 TO DO : save crop sub photo not yet done ! save time : 0.38247227668762207 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 4.658524036407471 time for calcul the mask position with numpy : 0.671959400177002 nb_pixel_total : 7804610 time to create 1 rle with new method : 0.7347173690795898 time for calcul the mask position with numpy : 0.023592710494995117 nb_pixel_total : 33257 time to create 1 rle with old method : 0.03587913513183594 time for calcul the mask position with numpy : 0.028011560440063477 nb_pixel_total : 97786 time to create 1 rle with old method : 0.10509419441223145 time for calcul the mask position with numpy : 0.024971961975097656 nb_pixel_total : 24708 time to create 1 rle with old method : 0.026076316833496094 time for calcul the mask position with numpy : 0.022689342498779297 nb_pixel_total : 36301 time to create 1 rle with old method : 0.03862404823303223 time for calcul the mask position with numpy : 0.02488112449645996 nb_pixel_total : 159169 time to create 1 rle with new method : 0.7595295906066895 time for calcul the mask position with numpy : 0.023424386978149414 nb_pixel_total : 106076 time to create 1 rle with old method : 0.11491823196411133 time for calcul the mask position with numpy : 0.02368760108947754 nb_pixel_total : 14754 time to create 1 rle with old method : 0.015863418579101562 time for calcul the mask position with numpy : 0.03638505935668945 nb_pixel_total : 17739 time to create 1 rle with old method : 0.018736600875854492 create new chi : 2.792396306991577 time to delete rle : 0.0011937618255615234 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++Number RLEs to save : 7163 TO DO : save crop sub photo not yet done ! save time : 0.4893765449523926 nb_obj : 3 nb_hashtags : 1 time to prepare the origin masks : 1.4362075328826904 time for calcul the mask position with numpy : 0.6691608428955078 nb_pixel_total : 8211016 time to create 1 rle with new method : 0.9595038890838623 time for calcul the mask position with numpy : 0.03820085525512695 nb_pixel_total : 14096 time to create 1 rle with old method : 0.015418052673339844 time for calcul the mask position with numpy : 0.036823272705078125 nb_pixel_total : 27007 time to create 1 rle with old method : 0.029082059860229492 time for calcul the mask position with numpy : 0.023628950119018555 nb_pixel_total : 42281 time to create 1 rle with old method : 0.0454561710357666 create new chi : 1.8557794094085693 time to delete rle : 0.0004734992980957031 batch 1 Loaded 7 chid ids of type : 3594 ++++Number RLEs to save : 3384 TO DO : save crop sub photo not yet done ! save time : 0.24570035934448242 map_output_result : {1403829085: (0.0, 'Should be the crop_list due to order', 0), 1403829083: (0.0, 'Should be the crop_list due to order', 0), 1403829081: (0.0, 'Should be the crop_list due to order', 0), 1403829078: (0.0, 'Should be the crop_list due to order', 0), 1403829077: (0.0, 'Should be the crop_list due to order', 0), 1403829071: (0.0, 'Should be the crop_list due to order', 0), 1403829068: (0.0, 'Should be the crop_list due to order', 0), 1403829065: (0.0, 'Should be the crop_list due to order', 0), 1403829063: (0.0, 'Should be the crop_list due to order', 0), 1403829060: (0.0, 'Should be the crop_list due to order', 0), 1403829058: (0.0, 'Should be the crop_list due to order', 0), 1403828979: (0.0, 'Should be the crop_list due to order', 0), 1403828946: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1403829085, 1403829083, 1403829081, 1403829078, 1403829077, 1403829071, 1403829068, 1403829065, 1403829063, 1403829060, 1403829058, 1403828979, 1403828946] Looping around the photos to save general results len do output : 13 /1403829085.Didn't retrieve data . /1403829083.Didn't retrieve data . /1403829081.Didn't retrieve data . /1403829078.Didn't retrieve data . /1403829077.Didn't retrieve data . /1403829071.Didn't retrieve data . /1403829068.Didn't retrieve data . /1403829065.Didn't retrieve data . /1403829063.Didn't retrieve data . /1403829060.Didn't retrieve data . /1403829058.Didn't retrieve data . /1403828979.Didn't retrieve data . /1403828946.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829085', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829083', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829081', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829078', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829077', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829071', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829068', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829065', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829063', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829060', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829058', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403828979', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403828946', None, None, None, None, None, '4330231') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 39 time used for this insertion : 0.016798019409179688 save_final save missing photos in datou_result : time spend for datou_step_exec : 79.97347903251648 time spend to save output : 0.017290353775024414 total time spend for step 3 : 79.9907693862915 step4:ventilate_hashtags_in_portfolio Wed Jan 14 18:13:58 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 30115050 get user id for portfolio 30115050 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30115050 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','environnement','flou','metal','pet_fonce','mal_croppe','papier','pehd','autre','background','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30115050 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','environnement','flou','metal','pet_fonce','mal_croppe','papier','pehd','autre','background','pet_clair')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30115050 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','environnement','flou','metal','pet_fonce','mal_croppe','papier','pehd','autre','background','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/30115206,30115207,30115208,30115209,30115210,30115211,30115212,30115213,30115214,30115215,30115216?tags=carton,environnement,flou,metal,pet_fonce,mal_croppe,papier,pehd,autre,background,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1403829085, 1403829083, 1403829081, 1403829078, 1403829077, 1403829071, 1403829068, 1403829065, 1403829063, 1403829060, 1403829058, 1403828979, 1403828946] Looping around the photos to save general results len do output : 1 /30115050. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829085', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829083', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829081', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829078', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829077', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829071', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829068', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829065', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829063', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829060', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829058', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403828979', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403828946', None, None, None, None, None, '4330231') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.019246816635131836 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.0430850982666016 time spend to save output : 0.01949024200439453 total time spend for step 4 : 2.062575340270996 step5:final Wed Jan 14 18:14:00 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1403829085: ('0.03928086790716999',), 1403829083: ('0.03928086790716999',), 1403829081: ('0.03928086790716999',), 1403829078: ('0.03928086790716999',), 1403829077: ('0.03928086790716999',), 1403829071: ('0.03928086790716999',), 1403829068: ('0.03928086790716999',), 1403829065: ('0.03928086790716999',), 1403829063: ('0.03928086790716999',), 1403829060: ('0.03928086790716999',), 1403829058: ('0.03928086790716999',), 1403828979: ('0.03928086790716999',), 1403828946: ('0.03928086790716999',)} new output for save of step final : {1403829085: ('0.03928086790716999',), 1403829083: ('0.03928086790716999',), 1403829081: ('0.03928086790716999',), 1403829078: ('0.03928086790716999',), 1403829077: ('0.03928086790716999',), 1403829071: ('0.03928086790716999',), 1403829068: ('0.03928086790716999',), 1403829065: ('0.03928086790716999',), 1403829063: ('0.03928086790716999',), 1403829060: ('0.03928086790716999',), 1403829058: ('0.03928086790716999',), 1403828979: ('0.03928086790716999',), 1403828946: ('0.03928086790716999',)} [1403829085, 1403829083, 1403829081, 1403829078, 1403829077, 1403829071, 1403829068, 1403829065, 1403829063, 1403829060, 1403829058, 1403828979, 1403828946] Looping around the photos to save general results len do output : 13 /1403829085.Didn't retrieve data . /1403829083.Didn't retrieve data . /1403829081.Didn't retrieve data . /1403829078.Didn't retrieve data . /1403829077.Didn't retrieve data . /1403829071.Didn't retrieve data . /1403829068.Didn't retrieve data . /1403829065.Didn't retrieve data . /1403829063.Didn't retrieve data . /1403829060.Didn't retrieve data . /1403829058.Didn't retrieve data . /1403828979.Didn't retrieve data . /1403828946.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829085', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829083', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829081', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829078', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829077', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829071', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829068', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829065', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829063', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829060', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829058', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403828979', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403828946', None, None, None, None, None, '4330231') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 39 time used for this insertion : 0.018280506134033203 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.16757583618164062 time spend to save output : 0.018878459930419922 total time spend for step 5 : 0.18645429611206055 step6:blur_detection Wed Jan 14 18:14:00 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1768410626_2474464_1403829085_804b31ca3f9839adc45489de68657045.jpg resize: (2160, 3840) 1403829085 -6.875321672334845 treat image : temp/1768410626_2474464_1403829083_be7d9982c744284c4646b21f01a0038a.jpg resize: (2160, 3840) 1403829083 -7.056479627640919 treat image : temp/1768410626_2474464_1403829081_9bccd9a29c6d5fa632073fbdfe4f328b.jpg resize: (2160, 3840) 1403829081 -6.929359286189145 treat image : temp/1768410626_2474464_1403829078_85809804bbe94726ae089a4ea1aa57af.jpg resize: (2160, 3840) 1403829078 -7.08070270045453 treat image : temp/1768410626_2474464_1403829077_2ae3827fdec73cbfdf7ea539b177381e.jpg resize: (2160, 3840) 1403829077 -7.034403949699653 treat image : temp/1768410626_2474464_1403829071_d7d09675a6a39c5d64c0b3f8c5dfdad6.jpg resize: (2160, 3840) 1403829071 -6.806904590240676 treat image : temp/1768410626_2474464_1403829068_14498c70a403b22e0a899a334b939818.jpg resize: (2160, 3840) 1403829068 -6.920615107999294 treat image : temp/1768410626_2474464_1403829065_2fec9bae7714dd7e40a9927559bb3cf1.jpg resize: (2160, 3840) 1403829065 -6.856376504212466 treat image : temp/1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd.jpg resize: (2160, 3840) 1403829063 -6.9476028088447945 treat image : temp/1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc.jpg resize: (2160, 3840) 1403829060 -4.273859708438187 treat image : temp/1768410626_2474464_1403829058_a1c11552d7290f30e8ba4a863beae50e.jpg resize: (2160, 3840) 1403829058 -7.001622892789759 treat image : temp/1768410626_2474464_1403828979_f579e16ab1e4c055ba134ae0fb4382ae.jpg resize: (2160, 3840) 1403828979 -7.046115454857877 treat image : temp/1768410626_2474464_1403828946_699a8ba46dd5d6d7034a62b8c11fe62a.jpg resize: (2160, 3840) 1403828946 -6.752567440050383 treat image : temp/1768410626_2474464_1403829085_804b31ca3f9839adc45489de68657045_rle_crop_4099739210_0.png resize: (232, 190) 1403831854 -4.677800678884035 treat image : temp/1768410626_2474464_1403829085_804b31ca3f9839adc45489de68657045_rle_crop_4099739214_0.png resize: (340, 503) 1403831855 -6.010973014858822 treat image : temp/1768410626_2474464_1403829083_be7d9982c744284c4646b21f01a0038a_rle_crop_4099739217_0.png resize: (273, 272) 1403831856 -3.6239651533941526 treat image : temp/1768410626_2474464_1403829081_9bccd9a29c6d5fa632073fbdfe4f328b_rle_crop_4099739221_0.png resize: (350, 232) 1403831857 -4.164060065295538 treat image : temp/1768410626_2474464_1403829081_9bccd9a29c6d5fa632073fbdfe4f328b_rle_crop_4099739222_0.png resize: (210, 100) 1403831858 -5.003417652631473 treat image : temp/1768410626_2474464_1403829078_85809804bbe94726ae089a4ea1aa57af_rle_crop_4099739223_0.png resize: (499, 516) 1403831859 -2.532179267083838 treat image : temp/1768410626_2474464_1403829078_85809804bbe94726ae089a4ea1aa57af_rle_crop_4099739224_0.png resize: (173, 260) 1403831860 -3.3779511236564574 treat image : temp/1768410626_2474464_1403829077_2ae3827fdec73cbfdf7ea539b177381e_rle_crop_4099739229_0.png resize: (174, 161) 1403831861 -5.3326275153160205 treat image : temp/1768410626_2474464_1403829077_2ae3827fdec73cbfdf7ea539b177381e_rle_crop_4099739230_0.png resize: (116, 180) 1403831862 -4.036587632210435 treat image : temp/1768410626_2474464_1403829077_2ae3827fdec73cbfdf7ea539b177381e_rle_crop_4099739232_0.png resize: (170, 275) 1403831863 -2.743429095897831 treat image : temp/1768410626_2474464_1403829077_2ae3827fdec73cbfdf7ea539b177381e_rle_crop_4099739233_0.png resize: (244, 324) 1403831864 -5.3644668834051865 treat image : temp/1768410626_2474464_1403829077_2ae3827fdec73cbfdf7ea539b177381e_rle_crop_4099739234_0.png resize: (127, 289) 1403831865 -2.0078261550779 treat image : temp/1768410626_2474464_1403829077_2ae3827fdec73cbfdf7ea539b177381e_rle_crop_4099739235_0.png resize: (109, 187) 1403831866 -4.882743585384482 treat image : temp/1768410626_2474464_1403829071_d7d09675a6a39c5d64c0b3f8c5dfdad6_rle_crop_4099739237_0.png resize: (428, 279) 1403831867 -4.594212864112107 treat image : temp/1768410626_2474464_1403829071_d7d09675a6a39c5d64c0b3f8c5dfdad6_rle_crop_4099739239_0.png resize: (223, 188) 1403831868 -3.218830565831615 treat image : temp/1768410626_2474464_1403829071_d7d09675a6a39c5d64c0b3f8c5dfdad6_rle_crop_4099739242_0.png resize: (155, 200) 1403831869 -4.3921024880118 treat image : temp/1768410626_2474464_1403829068_14498c70a403b22e0a899a334b939818_rle_crop_4099739244_0.png resize: (382, 165) 1403831870 -4.101552520967858 treat image : temp/1768410626_2474464_1403829068_14498c70a403b22e0a899a334b939818_rle_crop_4099739248_0.png resize: (826, 927) 1403831871 -5.53715043195379 treat image : temp/1768410626_2474464_1403829065_2fec9bae7714dd7e40a9927559bb3cf1_rle_crop_4099739249_0.png resize: (316, 519) 1403831872 -4.127199069561491 treat image : temp/1768410626_2474464_1403829065_2fec9bae7714dd7e40a9927559bb3cf1_rle_crop_4099739252_0.png resize: (232, 220) 1403831873 -4.111994062090862 treat image : temp/1768410626_2474464_1403829065_2fec9bae7714dd7e40a9927559bb3cf1_rle_crop_4099739254_0.png resize: (117, 78) 1403831874 -4.033527679631236 treat image : temp/1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739255_0.png resize: (208, 254) 1403831875 -4.596901939397951 treat image : temp/1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739258_0.png resize: (412, 511) 1403831876 -4.837511024553785 treat image : temp/1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739259_0.png resize: (226, 320) 1403831877 -2.530020135633441 treat image : temp/1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739260_0.png resize: (160, 175) 1403831878 -4.754088531226115 treat image : temp/1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739261_0.png resize: (72, 168) 1403831879 -3.7496266123512765 treat image : temp/1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739262_0.png resize: (417, 284) 1403831880 -4.770423808809216 treat image : temp/1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739264_0.png resize: (132, 195) 1403831881 -2.921844884443503 treat image : temp/1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739268_0.png resize: (194, 243) 1403831882 -4.737312768426923 treat image : temp/1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739269_0.png resize: (276, 329) 1403831883 -4.435422532143093 treat image : temp/1768410626_2474464_1403829058_a1c11552d7290f30e8ba4a863beae50e_rle_crop_4099739278_0.png resize: (335, 440) 1403831884 -5.099698109253044 treat image : temp/1768410626_2474464_1403828979_f579e16ab1e4c055ba134ae0fb4382ae_rle_crop_4099739281_0.png resize: (135, 175) 1403831885 -3.2515597714846467 treat image : temp/1768410626_2474464_1403829085_804b31ca3f9839adc45489de68657045_rle_crop_4099739213_0.png resize: (163, 127) 1403831891 -3.9309757932447513 treat image : temp/1768410626_2474464_1403829083_be7d9982c744284c4646b21f01a0038a_rle_crop_4099739215_0.png resize: (303, 305) 1403831892 -4.030091930777027 treat image : temp/1768410626_2474464_1403829083_be7d9982c744284c4646b21f01a0038a_rle_crop_4099739218_0.png resize: (218, 176) 1403831893 -3.7315978968752517 treat image : temp/1768410626_2474464_1403829078_85809804bbe94726ae089a4ea1aa57af_rle_crop_4099739225_0.png resize: (395, 394) 1403831894 -4.788762914930938 treat image : temp/1768410626_2474464_1403829077_2ae3827fdec73cbfdf7ea539b177381e_rle_crop_4099739236_0.png resize: (150, 215) 1403831895 -2.2222288487406243 treat image : temp/1768410626_2474464_1403829071_d7d09675a6a39c5d64c0b3f8c5dfdad6_rle_crop_4099739238_0.png resize: (234, 368) 1403831896 -1.9633354148169786 treat image : temp/1768410626_2474464_1403829071_d7d09675a6a39c5d64c0b3f8c5dfdad6_rle_crop_4099739241_0.png resize: (111, 91) 1403831897 -1.8627664373230879 treat image : temp/1768410626_2474464_1403829068_14498c70a403b22e0a899a334b939818_rle_crop_4099739243_0.png resize: (274, 202) 1403831898 -3.026165498049048 treat image : temp/1768410626_2474464_1403829065_2fec9bae7714dd7e40a9927559bb3cf1_rle_crop_4099739253_0.png resize: (218, 200) 1403831899 -3.7049569639824016 treat image : temp/1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739257_0.png resize: (193, 230) 1403831900 -4.298201780322335 treat image : temp/1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739263_0.png resize: (180, 207) 1403831901 -2.3273666125681856 treat image : temp/1768410626_2474464_1403829058_a1c11552d7290f30e8ba4a863beae50e_rle_crop_4099739280_0.png resize: (298, 308) 1403831902 -4.038870792158437 treat image : temp/1768410626_2474464_1403828979_f579e16ab1e4c055ba134ae0fb4382ae_rle_crop_4099739282_0.png resize: (171, 140) 1403831903 -2.8325789011983113 treat image : temp/1768410626_2474464_1403828979_f579e16ab1e4c055ba134ae0fb4382ae_rle_crop_4099739285_0.png resize: (215, 310) 1403831904 -3.715127760397036 treat image : temp/1768410626_2474464_1403829071_d7d09675a6a39c5d64c0b3f8c5dfdad6_rle_crop_4099739240_0.png resize: (204, 156) 1403831911 -4.928700916530902 treat image : temp/1768410626_2474464_1403829068_14498c70a403b22e0a899a334b939818_rle_crop_4099739245_0.png resize: (290, 168) 1403831912 -5.693657412318914 treat image : temp/1768410626_2474464_1403829068_14498c70a403b22e0a899a334b939818_rle_crop_4099739247_0.png resize: (110, 134) 1403831913 -4.810457754339687 treat image : temp/1768410626_2474464_1403829065_2fec9bae7714dd7e40a9927559bb3cf1_rle_crop_4099739250_0.png resize: (173, 93) 1403831914 -4.898482464827067 treat image : temp/1768410626_2474464_1403829065_2fec9bae7714dd7e40a9927559bb3cf1_rle_crop_4099739251_0.png resize: (193, 250) 1403831915 -4.377074972625514 treat image : temp/1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739267_0.png resize: (246, 189) 1403831916 -4.889285049616575 treat image : temp/1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739270_0.png resize: (168, 207) 1403831917 -3.6201098108689584 treat image : temp/1768410626_2474464_1403829058_a1c11552d7290f30e8ba4a863beae50e_rle_crop_4099739277_0.png resize: (184, 141) 1403831918 -4.514078264528903 treat image : temp/1768410626_2474464_1403829085_804b31ca3f9839adc45489de68657045_rle_crop_4099739209_0.png resize: (148, 308) 1403832023 -4.686897336147118 treat image : temp/1768410626_2474464_1403829085_804b31ca3f9839adc45489de68657045_rle_crop_4099739211_0.png resize: (185, 446) 1403832025 -2.6098351198082907 treat image : temp/1768410626_2474464_1403829085_804b31ca3f9839adc45489de68657045_rle_crop_4099739212_0.png resize: (122, 225) 1403832026 -4.315062620971757 treat image : temp/1768410626_2474464_1403829083_be7d9982c744284c4646b21f01a0038a_rle_crop_4099739219_0.png resize: (106, 136) 1403832027 -4.609420866845851 treat image : temp/1768410626_2474464_1403829081_9bccd9a29c6d5fa632073fbdfe4f328b_rle_crop_4099739220_0.png resize: (233, 354) 1403832029 -4.781409103286647 treat image : temp/1768410626_2474464_1403829078_85809804bbe94726ae089a4ea1aa57af_rle_crop_4099739226_0.png resize: (223, 303) 1403832030 -4.388637604199978 treat image : temp/1768410626_2474464_1403829078_85809804bbe94726ae089a4ea1aa57af_rle_crop_4099739227_0.png resize: (419, 450) 1403832031 -5.506520527012746 treat image : temp/1768410626_2474464_1403829078_85809804bbe94726ae089a4ea1aa57af_rle_crop_4099739228_0.png resize: (195, 187) 1403832033 -5.2082553430360115 treat image : temp/1768410626_2474464_1403829077_2ae3827fdec73cbfdf7ea539b177381e_rle_crop_4099739231_0.png resize: (442, 196) 1403832034 -4.631160999023594 treat image : temp/1768410626_2474464_1403829068_14498c70a403b22e0a899a334b939818_rle_crop_4099739246_0.png resize: (338, 510) 1403832035 -5.548884900449773 treat image : temp/1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739265_0.png resize: (222, 225) 1403832037 -4.1826486473129005 treat image : temp/1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739266_0.png resize: (216, 281) 1403832038 -4.416311734826288 treat image : temp/1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739272_0.png resize: (465, 304) 1403832039 -5.280660321689278 treat image : temp/1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739273_0.png resize: (314, 191) 1403832041 -5.358804043743641 treat image : temp/1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739274_0.png resize: (289, 119) 1403832042 -4.021570185174962 treat image : temp/1768410626_2474464_1403829058_a1c11552d7290f30e8ba4a863beae50e_rle_crop_4099739275_0.png resize: (150, 204) 1403832044 -5.249968230845422 treat image : temp/1768410626_2474464_1403829058_a1c11552d7290f30e8ba4a863beae50e_rle_crop_4099739276_0.png resize: (253, 318) 1403832045 -5.023478978532484 treat image : temp/1768410626_2474464_1403829058_a1c11552d7290f30e8ba4a863beae50e_rle_crop_4099739279_0.png resize: (283, 339) 1403832046 -4.479188114027436 treat image : temp/1768410626_2474464_1403828979_f579e16ab1e4c055ba134ae0fb4382ae_rle_crop_4099739283_0.png resize: (561, 399) 1403832048 -4.556428135246149 treat image : temp/1768410626_2474464_1403828979_f579e16ab1e4c055ba134ae0fb4382ae_rle_crop_4099739284_0.png resize: (403, 552) 1403832049 -4.9204963826039565 treat image : temp/1768410626_2474464_1403828979_f579e16ab1e4c055ba134ae0fb4382ae_rle_crop_4099739286_0.png resize: (240, 169) 1403832050 -5.01199595533564 treat image : temp/1768410626_2474464_1403828979_f579e16ab1e4c055ba134ae0fb4382ae_rle_crop_4099739287_0.png resize: (407, 381) 1403832052 -5.542040716990234 treat image : temp/1768410626_2474464_1403828979_f579e16ab1e4c055ba134ae0fb4382ae_rle_crop_4099739288_0.png resize: (213, 256) 1403832053 -4.303651321186983 treat image : temp/1768410626_2474464_1403829083_be7d9982c744284c4646b21f01a0038a_rle_crop_4099739216_0.png resize: (194, 281) 1403832091 -4.583474130391198 treat image : temp/1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739256_0.png resize: (137, 156) 1403832093 -5.212616148841326 treat image : temp/1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739271_0.png resize: (108, 109) 1403832094 -3.973811294925354 treat image : temp/1768410626_2474464_1403828946_699a8ba46dd5d6d7034a62b8c11fe62a_rle_crop_4099739289_0.png resize: (247, 256) 1403832095 -5.28189404787405 treat image : temp/1768410626_2474464_1403828946_699a8ba46dd5d6d7034a62b8c11fe62a_rle_crop_4099739290_0.png resize: (219, 180) 1403832097 -2.4564425500495823 treat image : temp/1768410626_2474464_1403828946_699a8ba46dd5d6d7034a62b8c11fe62a_rle_crop_4099739291_0.png resize: (133, 126) 1403832098 -3.4635764648427454 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 96 time used for this insertion : 0.01977682113647461 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 96 time used for this insertion : 0.02074885368347168 save missing photos in datou_result : time spend for datou_step_exec : 50.233691453933716 time spend to save output : 0.04699087142944336 total time spend for step 6 : 50.28068232536316 step7:brightness Wed Jan 14 18:14:51 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1768410626_2474464_1403829085_804b31ca3f9839adc45489de68657045.jpg treat image : temp/1768410626_2474464_1403829083_be7d9982c744284c4646b21f01a0038a.jpg treat image : temp/1768410626_2474464_1403829081_9bccd9a29c6d5fa632073fbdfe4f328b.jpg treat image : temp/1768410626_2474464_1403829078_85809804bbe94726ae089a4ea1aa57af.jpg treat image : temp/1768410626_2474464_1403829077_2ae3827fdec73cbfdf7ea539b177381e.jpg treat image : temp/1768410626_2474464_1403829071_d7d09675a6a39c5d64c0b3f8c5dfdad6.jpg treat image : temp/1768410626_2474464_1403829068_14498c70a403b22e0a899a334b939818.jpg treat image : temp/1768410626_2474464_1403829065_2fec9bae7714dd7e40a9927559bb3cf1.jpg treat image : temp/1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd.jpg treat image : temp/1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc.jpg treat image : temp/1768410626_2474464_1403829058_a1c11552d7290f30e8ba4a863beae50e.jpg treat image : temp/1768410626_2474464_1403828979_f579e16ab1e4c055ba134ae0fb4382ae.jpg treat image : temp/1768410626_2474464_1403828946_699a8ba46dd5d6d7034a62b8c11fe62a.jpg treat image : temp/1768410626_2474464_1403829085_804b31ca3f9839adc45489de68657045_rle_crop_4099739210_0.png treat image : temp/1768410626_2474464_1403829085_804b31ca3f9839adc45489de68657045_rle_crop_4099739214_0.png treat image : temp/1768410626_2474464_1403829083_be7d9982c744284c4646b21f01a0038a_rle_crop_4099739217_0.png treat image : temp/1768410626_2474464_1403829081_9bccd9a29c6d5fa632073fbdfe4f328b_rle_crop_4099739221_0.png treat image : temp/1768410626_2474464_1403829081_9bccd9a29c6d5fa632073fbdfe4f328b_rle_crop_4099739222_0.png treat image : temp/1768410626_2474464_1403829078_85809804bbe94726ae089a4ea1aa57af_rle_crop_4099739223_0.png treat image : temp/1768410626_2474464_1403829078_85809804bbe94726ae089a4ea1aa57af_rle_crop_4099739224_0.png treat image : temp/1768410626_2474464_1403829077_2ae3827fdec73cbfdf7ea539b177381e_rle_crop_4099739229_0.png treat image : temp/1768410626_2474464_1403829077_2ae3827fdec73cbfdf7ea539b177381e_rle_crop_4099739230_0.png treat image : temp/1768410626_2474464_1403829077_2ae3827fdec73cbfdf7ea539b177381e_rle_crop_4099739232_0.png treat image : temp/1768410626_2474464_1403829077_2ae3827fdec73cbfdf7ea539b177381e_rle_crop_4099739233_0.png treat image : temp/1768410626_2474464_1403829077_2ae3827fdec73cbfdf7ea539b177381e_rle_crop_4099739234_0.png treat image : temp/1768410626_2474464_1403829077_2ae3827fdec73cbfdf7ea539b177381e_rle_crop_4099739235_0.png treat image : temp/1768410626_2474464_1403829071_d7d09675a6a39c5d64c0b3f8c5dfdad6_rle_crop_4099739237_0.png treat image : temp/1768410626_2474464_1403829071_d7d09675a6a39c5d64c0b3f8c5dfdad6_rle_crop_4099739239_0.png treat image : temp/1768410626_2474464_1403829071_d7d09675a6a39c5d64c0b3f8c5dfdad6_rle_crop_4099739242_0.png treat image : temp/1768410626_2474464_1403829068_14498c70a403b22e0a899a334b939818_rle_crop_4099739244_0.png treat image : temp/1768410626_2474464_1403829068_14498c70a403b22e0a899a334b939818_rle_crop_4099739248_0.png treat image : temp/1768410626_2474464_1403829065_2fec9bae7714dd7e40a9927559bb3cf1_rle_crop_4099739249_0.png treat image : temp/1768410626_2474464_1403829065_2fec9bae7714dd7e40a9927559bb3cf1_rle_crop_4099739252_0.png treat image : temp/1768410626_2474464_1403829065_2fec9bae7714dd7e40a9927559bb3cf1_rle_crop_4099739254_0.png treat image : temp/1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739255_0.png treat image : temp/1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739258_0.png treat image : temp/1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739259_0.png treat image : temp/1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739260_0.png treat image : temp/1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739261_0.png treat image : temp/1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739262_0.png treat image : temp/1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739264_0.png treat image : temp/1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739268_0.png treat image : temp/1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739269_0.png treat image : temp/1768410626_2474464_1403829058_a1c11552d7290f30e8ba4a863beae50e_rle_crop_4099739278_0.png treat image : temp/1768410626_2474464_1403828979_f579e16ab1e4c055ba134ae0fb4382ae_rle_crop_4099739281_0.png treat image : temp/1768410626_2474464_1403829085_804b31ca3f9839adc45489de68657045_rle_crop_4099739213_0.png treat image : temp/1768410626_2474464_1403829083_be7d9982c744284c4646b21f01a0038a_rle_crop_4099739215_0.png treat image : temp/1768410626_2474464_1403829083_be7d9982c744284c4646b21f01a0038a_rle_crop_4099739218_0.png treat image : temp/1768410626_2474464_1403829078_85809804bbe94726ae089a4ea1aa57af_rle_crop_4099739225_0.png treat image : temp/1768410626_2474464_1403829077_2ae3827fdec73cbfdf7ea539b177381e_rle_crop_4099739236_0.png treat image : temp/1768410626_2474464_1403829071_d7d09675a6a39c5d64c0b3f8c5dfdad6_rle_crop_4099739238_0.png treat image : temp/1768410626_2474464_1403829071_d7d09675a6a39c5d64c0b3f8c5dfdad6_rle_crop_4099739241_0.png treat image : temp/1768410626_2474464_1403829068_14498c70a403b22e0a899a334b939818_rle_crop_4099739243_0.png treat image : temp/1768410626_2474464_1403829065_2fec9bae7714dd7e40a9927559bb3cf1_rle_crop_4099739253_0.png treat image : temp/1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739257_0.png treat image : temp/1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739263_0.png treat image : temp/1768410626_2474464_1403829058_a1c11552d7290f30e8ba4a863beae50e_rle_crop_4099739280_0.png treat image : temp/1768410626_2474464_1403828979_f579e16ab1e4c055ba134ae0fb4382ae_rle_crop_4099739282_0.png treat image : temp/1768410626_2474464_1403828979_f579e16ab1e4c055ba134ae0fb4382ae_rle_crop_4099739285_0.png treat image : temp/1768410626_2474464_1403829071_d7d09675a6a39c5d64c0b3f8c5dfdad6_rle_crop_4099739240_0.png treat image : temp/1768410626_2474464_1403829068_14498c70a403b22e0a899a334b939818_rle_crop_4099739245_0.png treat image : temp/1768410626_2474464_1403829068_14498c70a403b22e0a899a334b939818_rle_crop_4099739247_0.png treat image : temp/1768410626_2474464_1403829065_2fec9bae7714dd7e40a9927559bb3cf1_rle_crop_4099739250_0.png treat image : temp/1768410626_2474464_1403829065_2fec9bae7714dd7e40a9927559bb3cf1_rle_crop_4099739251_0.png treat image : temp/1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739267_0.png treat image : temp/1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739270_0.png treat image : temp/1768410626_2474464_1403829058_a1c11552d7290f30e8ba4a863beae50e_rle_crop_4099739277_0.png treat image : temp/1768410626_2474464_1403829085_804b31ca3f9839adc45489de68657045_rle_crop_4099739209_0.png treat image : temp/1768410626_2474464_1403829085_804b31ca3f9839adc45489de68657045_rle_crop_4099739211_0.png treat image : temp/1768410626_2474464_1403829085_804b31ca3f9839adc45489de68657045_rle_crop_4099739212_0.png treat image : temp/1768410626_2474464_1403829083_be7d9982c744284c4646b21f01a0038a_rle_crop_4099739219_0.png treat image : temp/1768410626_2474464_1403829081_9bccd9a29c6d5fa632073fbdfe4f328b_rle_crop_4099739220_0.png treat image : temp/1768410626_2474464_1403829078_85809804bbe94726ae089a4ea1aa57af_rle_crop_4099739226_0.png treat image : temp/1768410626_2474464_1403829078_85809804bbe94726ae089a4ea1aa57af_rle_crop_4099739227_0.png treat image : temp/1768410626_2474464_1403829078_85809804bbe94726ae089a4ea1aa57af_rle_crop_4099739228_0.png treat image : temp/1768410626_2474464_1403829077_2ae3827fdec73cbfdf7ea539b177381e_rle_crop_4099739231_0.png treat image : temp/1768410626_2474464_1403829068_14498c70a403b22e0a899a334b939818_rle_crop_4099739246_0.png treat image : temp/1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739265_0.png treat image : temp/1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739266_0.png treat image : temp/1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739272_0.png treat image : temp/1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739273_0.png treat image : temp/1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739274_0.png treat image : temp/1768410626_2474464_1403829058_a1c11552d7290f30e8ba4a863beae50e_rle_crop_4099739275_0.png treat image : temp/1768410626_2474464_1403829058_a1c11552d7290f30e8ba4a863beae50e_rle_crop_4099739276_0.png treat image : temp/1768410626_2474464_1403829058_a1c11552d7290f30e8ba4a863beae50e_rle_crop_4099739279_0.png treat image : temp/1768410626_2474464_1403828979_f579e16ab1e4c055ba134ae0fb4382ae_rle_crop_4099739283_0.png treat image : temp/1768410626_2474464_1403828979_f579e16ab1e4c055ba134ae0fb4382ae_rle_crop_4099739284_0.png treat image : temp/1768410626_2474464_1403828979_f579e16ab1e4c055ba134ae0fb4382ae_rle_crop_4099739286_0.png treat image : temp/1768410626_2474464_1403828979_f579e16ab1e4c055ba134ae0fb4382ae_rle_crop_4099739287_0.png treat image : temp/1768410626_2474464_1403828979_f579e16ab1e4c055ba134ae0fb4382ae_rle_crop_4099739288_0.png treat image : temp/1768410626_2474464_1403829083_be7d9982c744284c4646b21f01a0038a_rle_crop_4099739216_0.png treat image : temp/1768410626_2474464_1403829063_08d5fe3e5294abc22935811b060296cd_rle_crop_4099739256_0.png treat image : temp/1768410626_2474464_1403829060_5b095cbb99e7b9b7dbccba17152859cc_rle_crop_4099739271_0.png treat image : temp/1768410626_2474464_1403828946_699a8ba46dd5d6d7034a62b8c11fe62a_rle_crop_4099739289_0.png treat image : temp/1768410626_2474464_1403828946_699a8ba46dd5d6d7034a62b8c11fe62a_rle_crop_4099739290_0.png treat image : temp/1768410626_2474464_1403828946_699a8ba46dd5d6d7034a62b8c11fe62a_rle_crop_4099739291_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 96 time used for this insertion : 0.022446393966674805 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 96 time used for this insertion : 0.02297830581665039 save missing photos in datou_result : time spend for datou_step_exec : 11.193219423294067 time spend to save output : 0.050885677337646484 total time spend for step 7 : 11.244105100631714 step8:velours_tree Wed Jan 14 18:15:02 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.2133646011352539 time spend to save output : 4.673004150390625e-05 total time spend for step 8 : 0.2134113311767578 step9:send_mail_cod Wed Jan 14 18:15:02 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P30115050_14-01-2026_18_15_02.pdf 30115206 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette301152061768410902 30115208 imagette301152081768410904 30115209 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette301152091768410904 30115210 imagette301152101768410904 30115211 imagette301152111768410904 30115212 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette301152121768410904 30115213 imagette301152131768410906 30115214 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette301152141768410906 30115215 imagette301152151768410907 30115216 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette301152161768410907 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=30115050 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/30115206,30115207,30115208,30115209,30115210,30115211,30115212,30115213,30115214,30115215,30115216?tags=carton,environnement,flou,metal,pet_fonce,mal_croppe,papier,pehd,autre,background,pet_clair your option no_mail is active, we will not send the real mail to your client args[1403829085] : ((1403829085, -6.875321672334845, 492609224), (1403829085, -0.21612435133099886, 496442774), '0.03928086790716999') We are sending mail with results at report@fotonower.com args[1403829083] : ((1403829083, -7.056479627640919, 492609224), (1403829083, -0.32884066793752986, 496442774), '0.03928086790716999') We are sending mail with results at report@fotonower.com args[1403829081] : ((1403829081, -6.929359286189145, 492609224), (1403829081, -0.31986505650580654, 496442774), '0.03928086790716999') We are sending mail with results at report@fotonower.com args[1403829078] : ((1403829078, -7.08070270045453, 492609224), (1403829078, -0.1427351554496001, 496442774), '0.03928086790716999') We are sending mail with results at report@fotonower.com args[1403829077] : ((1403829077, -7.034403949699653, 492609224), (1403829077, -0.17283545153950533, 496442774), '0.03928086790716999') We are sending mail with results at report@fotonower.com args[1403829071] : ((1403829071, -6.806904590240676, 492609224), (1403829071, -0.30933678858956704, 496442774), '0.03928086790716999') We are sending mail with results at report@fotonower.com args[1403829068] : ((1403829068, -6.920615107999294, 492609224), (1403829068, -0.27992836598671195, 496442774), '0.03928086790716999') We are sending mail with results at report@fotonower.com args[1403829065] : ((1403829065, -6.856376504212466, 492609224), (1403829065, -0.3224220719531463, 496442774), '0.03928086790716999') We are sending mail with results at report@fotonower.com args[1403829063] : ((1403829063, -6.9476028088447945, 492609224), (1403829063, -0.1620545496797894, 496442774), '0.03928086790716999') We are sending mail with results at report@fotonower.com args[1403829060] : ((1403829060, -4.273859708438187, 492609224), (1403829060, -1.9318671738859647, 501862349), '0.03928086790716999') We are sending mail with results at report@fotonower.com args[1403829058] : ((1403829058, -7.001622892789759, 492609224), (1403829058, -0.24459495335398734, 496442774), '0.03928086790716999') We are sending mail with results at report@fotonower.com args[1403828979] : ((1403828979, -7.046115454857877, 492609224), (1403828979, -0.29145480287647535, 496442774), '0.03928086790716999') We are sending mail with results at report@fotonower.com args[1403828946] : ((1403828946, -6.752567440050383, 492609224), (1403828946, -0.40565632827357867, 496442774), '0.03928086790716999') We are sending mail with results at report@fotonower.com refus_total : 0.03928086790716999 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=30115050 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30115050_14-01-2026_18_15_02.pdf results_Auto_P30115050_14-01-2026_18_15_02.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30115050_14-01-2026_18_15_02.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','30115050','results_Auto_P30115050_14-01-2026_18_15_02.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30115050_14-01-2026_18_15_02.pdf','pdf','','0.89','0.03928086790716999') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1403829085, 1403829083, 1403829081, 1403829078, 1403829077, 1403829071, 1403829068, 1403829065, 1403829063, 1403829060, 1403829058, 1403828979, 1403828946] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829085', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829083', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829081', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829078', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829077', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829071', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829068', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829065', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829063', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829060', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829058', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403828979', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403828946', None, None, None, None, None, '4330231') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.015888214111328125 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.980701684951782 time spend to save output : 0.01610589027404785 total time spend for step 9 : 9.99680757522583 step10:split_time_score Wed Jan 14 18:15:12 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('17', 13),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 14012026 30115050 Nombre de photos uploadées : 13 / 23040 (0%) 14012026 30115050 Nombre de photos taguées (types de déchets): 0 / 13 (0%) 14012026 30115050 Nombre de photos taguées (volume) : 0 / 13 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0006513595581054688 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.26653027534484863 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.028029619381751546 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30110198_14-01-2026_07_13_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30110198 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30110198 AND mptpi.`type`=3594 To do Qualite : 0.013961913080293925 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30112558_14-01-2026_12_42_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30112558 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30112558 AND mptpi.`type`=3726 To do Qualite : 0.04003344425154322 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30112562_14-01-2026_12_42_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30112562 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30112562 AND mptpi.`type`=3594 To do Qualite : 0.17142773437500003 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30114051_14-01-2026_15_43_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30114051 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30114051 AND mptpi.`type`=3594 To do Qualite : 0.09132668687638623 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30113482_14-01-2026_14_08_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30113482 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30113482 AND mptpi.`type`=3726 To do Qualite : 0.08412550106460114 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30113484_14-01-2026_14_08_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30113484 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30113484 AND mptpi.`type`=3726 To do Qualite : 0.0341205780064702 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30113820_14-01-2026_15_13_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30113820 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30113820 AND mptpi.`type`=3726 To do Qualite : 0.03066582146375122 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30114828_14-01-2026_17_06_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30114828 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30114828 AND mptpi.`type`=3726 To do Qualite : 0.03818297079693347 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30114829_14-01-2026_17_07_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30114829 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30114829 AND mptpi.`type`=3726 To do Qualite : 0.03928086790716999 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30115050_14-01-2026_18_15_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30115050 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30115050 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'14012026': {'nb_upload': 13, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1403829085, 1403829083, 1403829081, 1403829078, 1403829077, 1403829071, 1403829068, 1403829065, 1403829063, 1403829060, 1403829058, 1403828979, 1403828946] Looping around the photos to save general results len do output : 1 /30115050Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829085', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829083', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829081', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829078', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829077', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829071', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829068', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829065', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829063', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829060', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403829058', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403828979', None, None, None, None, None, '4330231') ('3318', None, None, None, None, None, None, None, '4330231') ('3318', '30115050', '1403828946', None, None, None, None, None, '4330231') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 14 time used for this insertion : 0.01671314239501953 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.2070751190185547 time spend to save output : 0.016927719116210938 total time spend for step 10 : 1.2240028381347656 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 13 set_done_treatment 123.25user 130.79system 4:49.20elapsed 87%CPU (0avgtext+0avgdata 5136072maxresident)k 623080inputs+120112outputs (7650major+12489389minor)pagefaults 0swaps