python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1378827 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['4327249'] with mtr_portfolio_ids : ['30060714'] and first list_photo_ids : [] new path : /proc/1378827/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 12 ; length of list_pids : 12 ; length of list_args : 12 time to download the photos : 2.2080442905426025 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu Jan 8 21:40:30 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5316 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2026-01-08 21:40:33.556524: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2026-01-08 21:40:33.586448: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2026-01-08 21:40:33.589151: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f7ce4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2026-01-08 21:40:33.589204: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2026-01-08 21:40:33.594170: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2026-01-08 21:40:33.812273: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x48d32b0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2026-01-08 21:40:33.812323: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2026-01-08 21:40:33.813783: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-08 21:40:33.814154: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-08 21:40:33.817100: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-08 21:40:33.820595: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-08 21:40:33.821062: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-08 21:40:33.825279: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-08 21:40:33.826718: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-08 21:40:33.866386: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-08 21:40:33.867742: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-08 21:40:33.868123: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-08 21:40:33.868837: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-08 21:40:33.868856: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-08 21:40:33.868866: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-08 21:40:33.870595: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4854 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2026-01-08 21:40:34.273921: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-08 21:40:34.274798: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-08 21:40:34.274837: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-08 21:40:34.274869: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-08 21:40:34.274898: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-08 21:40:34.274930: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-08 21:40:34.274959: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-08 21:40:34.274992: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-08 21:40:34.276639: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-08 21:40:34.278572: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-01-08 21:40:34.278609: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-01-08 21:40:34.278624: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-08 21:40:34.278639: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-01-08 21:40:34.278653: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-01-08 21:40:34.278667: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-01-08 21:40:34.278681: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-01-08 21:40:34.278695: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-01-08 21:40:34.279672: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-01-08 21:40:34.279709: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-01-08 21:40:34.279718: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-01-08 21:40:34.279726: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-01-08 21:40:34.280762: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 4854 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2026-01-08 21:40:47.017815: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-01-08 21:40:47.198522: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 12 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 15 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 13 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 16 Detection mask done ! Trying to reset tf kernel 1379489 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 27 tf kernel not reseted sub process len(results) : 12 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 12 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5316 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [408, 936, 852, 1542] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.004415273666381836 nb_pixel_total : 180917 time to create 1 rle with new method : 0.010257959365844727 length of segment : 436 DEBUG bbox = [6, 468, 192, 858] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007305145263671875 nb_pixel_total : 47375 time to create 1 rle with old method : 0.05024838447570801 length of segment : 181 DEBUG bbox = [1746, 1350, 2154, 2586] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.015644550323486328 nb_pixel_total : 297153 time to create 1 rle with new method : 0.019619464874267578 length of segment : 376 DEBUG bbox = [54, 192, 480, 390] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008738040924072266 nb_pixel_total : 46502 time to create 1 rle with old method : 0.05021214485168457 length of segment : 389 DEBUG bbox = [738, 1812, 978, 1980] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004978179931640625 nb_pixel_total : 31448 time to create 1 rle with old method : 0.03431415557861328 length of segment : 221 DEBUG bbox = [408, 2328, 690, 2598] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007846355438232422 nb_pixel_total : 45163 time to create 1 rle with old method : 0.04860687255859375 length of segment : 287 DEBUG bbox = [720, 3060, 1008, 3330] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007274150848388672 nb_pixel_total : 43860 time to create 1 rle with old method : 0.04870271682739258 length of segment : 268 DEBUG bbox = [1632, 3030, 1800, 3144] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002677440643310547 nb_pixel_total : 10371 time to create 1 rle with old method : 0.011646509170532227 length of segment : 155 DEBUG bbox = [708, 42, 1176, 576] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0021028518676757812 nb_pixel_total : 129987 time to create 1 rle with old method : 0.14043593406677246 length of segment : 383 DEBUG bbox = [1794, 1962, 2058, 2106] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004773139953613281 nb_pixel_total : 26324 time to create 1 rle with old method : 0.028881311416625977 length of segment : 262 DEBUG bbox = [276, 2208, 558, 2490] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007739067077636719 nb_pixel_total : 42818 time to create 1 rle with old method : 0.048494577407836914 length of segment : 229 DEBUG bbox = [1314, 864, 1734, 1212] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001367330551147461 nb_pixel_total : 68596 time to create 1 rle with old method : 0.08225345611572266 length of segment : 415 DEBUG bbox = [1980, 630, 2154, 828] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003972053527832031 nb_pixel_total : 14413 time to create 1 rle with old method : 0.016188859939575195 length of segment : 170 DEBUG bbox = [1728, 2838, 2136, 3114] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011048316955566406 nb_pixel_total : 70535 time to create 1 rle with old method : 0.07814598083496094 length of segment : 351 DEBUG bbox = [180, 1590, 426, 1950] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007774829864501953 nb_pixel_total : 41355 time to create 1 rle with old method : 0.0460209846496582 length of segment : 214 DEBUG bbox = [1068, 2634, 1470, 2964] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012662410736083984 nb_pixel_total : 65031 time to create 1 rle with old method : 0.07185673713684082 length of segment : 437 DEBUG bbox = [1554, 1572, 1800, 2052] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008351802825927734 nb_pixel_total : 43784 time to create 1 rle with old method : 0.04764223098754883 length of segment : 193 DEBUG bbox = [396, 2748, 600, 2946] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003921985626220703 nb_pixel_total : 27639 time to create 1 rle with old method : 0.029931068420410156 length of segment : 190 DEBUG bbox = [648, 2832, 798, 2988] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00024175643920898438 nb_pixel_total : 15319 time to create 1 rle with old method : 0.01687765121459961 length of segment : 141 DEBUG bbox = [864, 288, 1140, 618] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007445812225341797 nb_pixel_total : 58104 time to create 1 rle with old method : 0.06587600708007812 length of segment : 313 DEBUG bbox = [1872, 1200, 2160, 1710] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013294219970703125 nb_pixel_total : 112789 time to create 1 rle with old method : 0.11926007270812988 length of segment : 275 DEBUG bbox = [264, 150, 630, 480] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009489059448242188 nb_pixel_total : 64617 time to create 1 rle with old method : 0.07418155670166016 length of segment : 358 DEBUG bbox = [1434, 2772, 1956, 3300] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002295970916748047 nb_pixel_total : 155707 time to create 1 rle with new method : 0.008797645568847656 length of segment : 456 DEBUG bbox = [324, 354, 714, 714] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010914802551269531 nb_pixel_total : 72292 time to create 1 rle with old method : 0.07686877250671387 length of segment : 514 DEBUG bbox = [2016, 1374, 2160, 1590] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0003070831298828125 nb_pixel_total : 17414 time to create 1 rle with old method : 0.019304513931274414 length of segment : 133 DEBUG bbox = [258, 1212, 552, 1620] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009756088256835938 nb_pixel_total : 79839 time to create 1 rle with old method : 0.08419275283813477 length of segment : 266 DEBUG bbox = [222, 618, 708, 834] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010569095611572266 nb_pixel_total : 45578 time to create 1 rle with old method : 0.05107522010803223 length of segment : 435 DEBUG bbox = [330, 96, 684, 348] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008535385131835938 nb_pixel_total : 46615 time to create 1 rle with old method : 0.05095791816711426 length of segment : 303 DEBUG bbox = [1626, 1566, 1800, 1806] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00042891502380371094 nb_pixel_total : 22393 time to create 1 rle with old method : 0.02615809440612793 length of segment : 166 DEBUG bbox = [78, 2892, 582, 3294] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0018072128295898438 nb_pixel_total : 90334 time to create 1 rle with old method : 0.09707880020141602 length of segment : 653 DEBUG bbox = [630, 576, 1038, 1158] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002195596694946289 nb_pixel_total : 146833 time to create 1 rle with old method : 0.15484046936035156 length of segment : 456 DEBUG bbox = [372, 2556, 660, 2880] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007946491241455078 nb_pixel_total : 36867 time to create 1 rle with old method : 0.039620161056518555 length of segment : 328 DEBUG bbox = [54, 738, 726, 1374] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00450587272644043 nb_pixel_total : 259600 time to create 1 rle with new method : 0.01684737205505371 length of segment : 629 DEBUG bbox = [36, 294, 222, 486] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004544258117675781 nb_pixel_total : 22807 time to create 1 rle with old method : 0.02421092987060547 length of segment : 189 DEBUG bbox = [1860, 1626, 1968, 1770] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0001842975616455078 nb_pixel_total : 5651 time to create 1 rle with old method : 0.006435871124267578 length of segment : 84 DEBUG bbox = [1464, 1632, 1902, 2022] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0034475326538085938 nb_pixel_total : 60692 time to create 1 rle with old method : 0.0642244815826416 length of segment : 364 DEBUG bbox = [1626, 1218, 2052, 1476] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002508878707885742 nb_pixel_total : 60006 time to create 1 rle with old method : 0.06296873092651367 length of segment : 403 DEBUG bbox = [1458, 1380, 2136, 1788] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0035762786865234375 nb_pixel_total : 162285 time to create 1 rle with new method : 0.011298894882202148 length of segment : 620 DEBUG bbox = [2028, 1932, 2160, 2214] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004963874816894531 nb_pixel_total : 26479 time to create 1 rle with old method : 0.028181076049804688 length of segment : 126 DEBUG bbox = [1890, 2082, 2040, 2220] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005669593811035156 nb_pixel_total : 9872 time to create 1 rle with old method : 0.010700225830078125 length of segment : 125 DEBUG bbox = [636, 198, 888, 318] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009179115295410156 nb_pixel_total : 16419 time to create 1 rle with old method : 0.018668413162231445 length of segment : 247 DEBUG bbox = [84, 966, 318, 1290] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0017771720886230469 nb_pixel_total : 47523 time to create 1 rle with old method : 0.05138516426086426 length of segment : 218 DEBUG bbox = [510, 252, 882, 474] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015988349914550781 nb_pixel_total : 40125 time to create 1 rle with old method : 0.04288434982299805 length of segment : 313 DEBUG bbox = [2022, 648, 2154, 810] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00036835670471191406 nb_pixel_total : 15278 time to create 1 rle with old method : 0.017229795455932617 length of segment : 131 DEBUG bbox = [72, 192, 888, 306] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0020494461059570312 nb_pixel_total : 35115 time to create 1 rle with old method : 0.03800320625305176 length of segment : 851 DEBUG bbox = [1842, 2364, 2118, 2682] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016598701477050781 nb_pixel_total : 52117 time to create 1 rle with old method : 0.05459785461425781 length of segment : 312 DEBUG bbox = [1800, 1290, 2100, 1506] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005936622619628906 nb_pixel_total : 29195 time to create 1 rle with old method : 0.03542661666870117 length of segment : 281 DEBUG bbox = [606, 3144, 912, 3264] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004353523254394531 nb_pixel_total : 23747 time to create 1 rle with old method : 0.02536940574645996 length of segment : 302 DEBUG bbox = [528, 804, 876, 918] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004749298095703125 nb_pixel_total : 27712 time to create 1 rle with old method : 0.03165626525878906 length of segment : 326 DEBUG bbox = [720, 48, 924, 252] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004334449768066406 nb_pixel_total : 31030 time to create 1 rle with old method : 0.03557991981506348 length of segment : 203 DEBUG bbox = [1800, 2922, 1986, 3150] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00040078163146972656 nb_pixel_total : 22730 time to create 1 rle with old method : 0.02471923828125 length of segment : 162 DEBUG bbox = [1242, 288, 1404, 450] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002989768981933594 nb_pixel_total : 19433 time to create 1 rle with old method : 0.022202014923095703 length of segment : 162 DEBUG bbox = [18, 1668, 468, 2190] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0019156932830810547 nb_pixel_total : 102907 time to create 1 rle with old method : 0.10942292213439941 length of segment : 388 DEBUG bbox = [1146, 1398, 1608, 1608] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016429424285888672 nb_pixel_total : 47822 time to create 1 rle with old method : 0.05018424987792969 length of segment : 399 DEBUG bbox = [228, 2682, 534, 2922] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0012061595916748047 nb_pixel_total : 28771 time to create 1 rle with old method : 0.03030085563659668 length of segment : 345 DEBUG bbox = [48, 930, 192, 1092] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004811286926269531 nb_pixel_total : 10789 time to create 1 rle with old method : 0.011685371398925781 length of segment : 119 DEBUG bbox = [240, 1278, 498, 1548] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011327266693115234 nb_pixel_total : 42716 time to create 1 rle with old method : 0.04592108726501465 length of segment : 249 DEBUG bbox = [1878, 2886, 2094, 3138] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009102821350097656 nb_pixel_total : 33199 time to create 1 rle with old method : 0.03476715087890625 length of segment : 213 DEBUG bbox = [990, 3072, 1230, 3312] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0010137557983398438 nb_pixel_total : 43611 time to create 1 rle with old method : 0.04984164237976074 length of segment : 226 DEBUG bbox = [36, 840, 198, 948] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0002841949462890625 nb_pixel_total : 10591 time to create 1 rle with old method : 0.012085676193237305 length of segment : 142 DEBUG bbox = [858, 2568, 1002, 2706] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00043201446533203125 nb_pixel_total : 11410 time to create 1 rle with old method : 0.013339996337890625 length of segment : 121 DEBUG bbox = [642, 1680, 810, 1860] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005407333374023438 nb_pixel_total : 17370 time to create 1 rle with old method : 0.019796371459960938 length of segment : 166 DEBUG bbox = [1818, 1722, 1974, 2010] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007219314575195312 nb_pixel_total : 25904 time to create 1 rle with old method : 0.03010845184326172 length of segment : 164 DEBUG bbox = [378, 1926, 708, 2250] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0015277862548828125 nb_pixel_total : 57134 time to create 1 rle with old method : 0.06122136116027832 length of segment : 305 DEBUG bbox = [1602, 1002, 1788, 1224] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007276535034179688 nb_pixel_total : 24784 time to create 1 rle with old method : 0.026389360427856445 length of segment : 197 DEBUG bbox = [2052, 498, 2154, 798] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.00048470497131347656 nb_pixel_total : 19182 time to create 1 rle with old method : 0.027431249618530273 length of segment : 94 DEBUG bbox = [1770, 1122, 2160, 1488] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0020494461059570312 nb_pixel_total : 68760 time to create 1 rle with old method : 0.07283878326416016 length of segment : 362 DEBUG bbox = [6, 1278, 168, 1698] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001051187515258789 nb_pixel_total : 54837 time to create 1 rle with old method : 0.0596013069152832 length of segment : 150 DEBUG bbox = [1872, 636, 2100, 804] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007486343383789062 nb_pixel_total : 22572 time to create 1 rle with old method : 0.023474931716918945 length of segment : 191 DEBUG bbox = [858, 450, 1050, 582] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005471706390380859 nb_pixel_total : 11793 time to create 1 rle with old method : 0.013541698455810547 length of segment : 178 DEBUG bbox = [1392, 1200, 2076, 1596] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0032095909118652344 nb_pixel_total : 146254 time to create 1 rle with old method : 0.15146470069885254 length of segment : 616 DEBUG bbox = [1080, 2034, 1314, 2214] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007832050323486328 nb_pixel_total : 21863 time to create 1 rle with old method : 0.023898601531982422 length of segment : 194 DEBUG bbox = [624, 1908, 1176, 2190] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.002270221710205078 nb_pixel_total : 92954 time to create 1 rle with old method : 0.09788274765014648 length of segment : 528 DEBUG bbox = [216, 3330, 516, 3588] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0013010501861572266 nb_pixel_total : 47273 time to create 1 rle with old method : 0.04912137985229492 length of segment : 290 DEBUG bbox = [258, 1440, 558, 1674] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0011615753173828125 nb_pixel_total : 36174 time to create 1 rle with old method : 0.03961062431335449 length of segment : 301 DEBUG bbox = [1050, 906, 1236, 1122] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0007131099700927734 nb_pixel_total : 27670 time to create 1 rle with old method : 0.03202033042907715 length of segment : 182 DEBUG bbox = [204, 780, 462, 1194] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.001352548599243164 nb_pixel_total : 43725 time to create 1 rle with old method : 0.04811286926269531 length of segment : 260 DEBUG bbox = [1602, 1596, 1842, 1794] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0009605884552001953 nb_pixel_total : 30819 time to create 1 rle with old method : 0.0354304313659668 length of segment : 214 DEBUG bbox = [414, 1512, 972, 2148] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.005173683166503906 nb_pixel_total : 171229 time to create 1 rle with new method : 0.012769222259521484 length of segment : 549 DEBUG bbox = [984, 2718, 1182, 2892] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0008006095886230469 nb_pixel_total : 17255 time to create 1 rle with old method : 0.018489360809326172 length of segment : 189 DEBUG bbox = [708, 2334, 894, 2538] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0005402565002441406 nb_pixel_total : 16982 time to create 1 rle with old method : 0.018465518951416016 length of segment : 152 DEBUG bbox = [1212, 462, 1344, 600] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0004832744598388672 nb_pixel_total : 10379 time to create 1 rle with old method : 0.011972665786743164 length of segment : 118 DEBUG bbox = [534, 2910, 714, 3090] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0006871223449707031 nb_pixel_total : 19141 time to create 1 rle with old method : 0.020529985427856445 length of segment : 138 DEBUG bbox = [1872, 1506, 2118, 2010] DEBUG masks shape = (2160, 3840) time for calcul the mask position with numpy : 0.0016796588897705078 nb_pixel_total : 49293 time to create 1 rle with old method : 0.053705692291259766 length of segment : 318 time spent for convertir_results : 7.196544647216797 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 84 chid ids of type : 3594 Number RLEs to save : 24060 save missing photos in datou_result : time spend for datou_step_exec : 79.41220116615295 time spend to save output : 2.0826127529144287 total time spend for step 1 : 81.49481391906738 step2:crop_condition Thu Jan 8 21:41:51 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 12 ! batch 1 Loaded 84 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 35 About to insert : list_path_to_insert length 35 new photo from crops ! About to upload 35 photos upload in portfolio : 3736932 init cache_photo without model_param we have 35 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767904923_1378827 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011734_67f53d109aa604dc01bb099382f19939_rle_crop_4094275127_0.png', 0, 596, 432, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011734_67f53d109aa604dc01bb099382f19939_rle_crop_4094275132_0.png', 0, 258, 264, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275134_0.png', 0, 92, 154, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275135_0.png', 0, 501, 381, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275136_0.png', 0, 131, 262, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275139_0.png', 0, 190, 170, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275141_0.png', 0, 318, 214, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275142_0.png', 0, 309, 382, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011656_28dcedbb6f0ea1279b23a93a7f70afb0_rle_crop_4094275143_0.png', 0, 407, 193, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011656_28dcedbb6f0ea1279b23a93a7f70afb0_rle_crop_4094275144_0.png', 0, 196, 190, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011656_28dcedbb6f0ea1279b23a93a7f70afb0_rle_crop_4094275145_0.png', 0, 150, 134, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011610_d13956ba51bbcf4e96ec54b5f99a7b36_rle_crop_4094275149_0.png', 0, 506, 456, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011610_d13956ba51bbcf4e96ec54b5f99a7b36_rle_crop_4094275150_0.png', 0, 348, 354, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011610_d13956ba51bbcf4e96ec54b5f99a7b36_rle_crop_4094275151_0.png', 0, 194, 132, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e_rle_crop_4094275153_0.png', 0, 199, 435, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e_rle_crop_4094275157_0.png', 0, 572, 375, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e_rle_crop_4094275158_0.png', 0, 317, 263, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e_rle_crop_4094275159_0.png', 0, 623, 602, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e_rle_crop_4094275161_0.png', 0, 104, 79, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275162_0.png', 0, 346, 350, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275165_0.png', 0, 272, 125, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275166_0.png', 0, 114, 125, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275171_0.png', 0, 111, 696, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011487_98fdffab7ffb9cc11f5a54266afff405_rle_crop_4094275173_0.png', 0, 206, 281, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011487_98fdffab7ffb9cc11f5a54266afff405_rle_crop_4094275174_0.png', 0, 115, 302, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011487_98fdffab7ffb9cc11f5a54266afff405_rle_crop_4094275175_0.png', 0, 110, 325, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011487_98fdffab7ffb9cc11f5a54266afff405_rle_crop_4094275177_0.png', 0, 210, 162, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011484_63f42e8b3c3f59c89166dac9bf41f817_rle_crop_4094275180_0.png', 0, 193, 396, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011474_1012e837242b3bbcfe17e5f1524a6891_rle_crop_4094275189_0.png', 0, 283, 142, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011474_1012e837242b3bbcfe17e5f1524a6891_rle_crop_4094275190_0.png', 0, 306, 298, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011474_1012e837242b3bbcfe17e5f1524a6891_rle_crop_4094275191_0.png', 0, 219, 181, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011472_f3235929bba3922f2719422a5dff4333_rle_crop_4094275199_0.png', 0, 262, 514, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011470_6746b6ff239ba5d9576e6e89361bc271_rle_crop_4094275202_0.png', 0, 207, 182, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011469_8dfcec389f6ea7f358592d63aae11d50_rle_crop_4094275204_0.png', 0, 196, 214, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904929), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011469_8dfcec389f6ea7f358592d63aae11d50_rle_crop_4094275210_0.png', 0, 371, 241, 0, 1767904929,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 35 photos in the portfolio 3736932 time of upload the photos Elapsed time : 10.502854108810425 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! About to upload 11 photos upload in portfolio : 3736932 init cache_photo without model_param we have 11 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767904937_1378827 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904939), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011734_67f53d109aa604dc01bb099382f19939_rle_crop_4094275130_0.png', 0, 181, 380, 0, 1767904939,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904939), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275133_0.png', 0, 239, 268, 0, 1767904939,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904939), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275138_0.png', 0, 285, 413, 0, 1767904939,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904939), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e_rle_crop_4094275156_0.png', 0, 333, 491, 0, 1767904939,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904939), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275167_0.png', 0, 100, 247, 0, 1767904939,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904939), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011484_63f42e8b3c3f59c89166dac9bf41f817_rle_crop_4094275181_0.png', 0, 214, 279, 0, 1767904939,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904939), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011484_63f42e8b3c3f59c89166dac9bf41f817_rle_crop_4094275187_0.png', 0, 134, 117, 0, 1767904939,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904939), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011474_1012e837242b3bbcfe17e5f1524a6891_rle_crop_4094275188_0.png', 0, 155, 166, 0, 1767904939,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904939), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011472_f3235929bba3922f2719422a5dff4333_rle_crop_4094275196_0.png', 0, 119, 178, 0, 1767904939,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904939), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011472_f3235929bba3922f2719422a5dff4333_rle_crop_4094275198_0.png', 0, 168, 189, 0, 1767904939,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904939), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011469_8dfcec389f6ea7f358592d63aae11d50_rle_crop_4094275206_0.png', 0, 151, 189, 0, 1767904939,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 11 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.7179183959960938 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767904942_1378827 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904943), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011487_98fdffab7ffb9cc11f5a54266afff405_rle_crop_4094275176_0.png', 0, 189, 201, 0, 1767904943,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904943), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011487_98fdffab7ffb9cc11f5a54266afff405_rle_crop_4094275178_0.png', 0, 132, 162, 0, 1767904943,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904943), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011469_8dfcec389f6ea7f358592d63aae11d50_rle_crop_4094275207_0.png', 0, 172, 147, 0, 1767904943,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904943), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011469_8dfcec389f6ea7f358592d63aae11d50_rle_crop_4094275208_0.png', 0, 124, 118, 0, 1767904943,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0987269878387451 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 30 About to insert : list_path_to_insert length 30 new photo from crops ! About to upload 30 photos upload in portfolio : 3736932 init cache_photo without model_param we have 30 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767904955_1378827 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011734_67f53d109aa604dc01bb099382f19939_rle_crop_4094275128_0.png', 0, 354, 175, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011734_67f53d109aa604dc01bb099382f19939_rle_crop_4094275129_0.png', 0, 1106, 374, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275137_0.png', 0, 265, 220, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275140_0.png', 0, 273, 351, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011656_28dcedbb6f0ea1279b23a93a7f70afb0_rle_crop_4094275147_0.png', 0, 491, 273, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011656_28dcedbb6f0ea1279b23a93a7f70afb0_rle_crop_4094275148_0.png', 0, 286, 321, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011610_d13956ba51bbcf4e96ec54b5f99a7b36_rle_crop_4094275152_0.png', 0, 389, 263, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e_rle_crop_4094275154_0.png', 0, 245, 303, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e_rle_crop_4094275155_0.png', 0, 217, 159, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e_rle_crop_4094275160_0.png', 0, 173, 176, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275163_0.png', 0, 221, 403, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275164_0.png', 0, 315, 620, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275168_0.png', 0, 318, 199, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275169_0.png', 0, 202, 312, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275172_0.png', 0, 273, 261, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011487_98fdffab7ffb9cc11f5a54266afff405_rle_crop_4094275179_0.png', 0, 464, 388, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011484_63f42e8b3c3f59c89166dac9bf41f817_rle_crop_4094275182_0.png', 0, 152, 119, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011484_63f42e8b3c3f59c89166dac9bf41f817_rle_crop_4094275183_0.png', 0, 231, 242, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011484_63f42e8b3c3f59c89166dac9bf41f817_rle_crop_4094275184_0.png', 0, 221, 213, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011484_63f42e8b3c3f59c89166dac9bf41f817_rle_crop_4094275186_0.png', 0, 92, 142, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011474_1012e837242b3bbcfe17e5f1524a6891_rle_crop_4094275192_0.png', 0, 288, 93, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011472_f3235929bba3922f2719422a5dff4333_rle_crop_4094275193_0.png', 0, 316, 361, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011472_f3235929bba3922f2719422a5dff4333_rle_crop_4094275194_0.png', 0, 418, 148, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011472_f3235929bba3922f2719422a5dff4333_rle_crop_4094275195_0.png', 0, 133, 189, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011472_f3235929bba3922f2719422a5dff4333_rle_crop_4094275197_0.png', 0, 354, 589, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011470_6746b6ff239ba5d9576e6e89361bc271_rle_crop_4094275200_0.png', 0, 239, 290, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011470_6746b6ff239ba5d9576e6e89361bc271_rle_crop_4094275201_0.png', 0, 197, 281, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011470_6746b6ff239ba5d9576e6e89361bc271_rle_crop_4094275203_0.png', 0, 378, 168, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011469_8dfcec389f6ea7f358592d63aae11d50_rle_crop_4094275205_0.png', 0, 574, 514, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904960), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011469_8dfcec389f6ea7f358592d63aae11d50_rle_crop_4094275209_0.png', 0, 165, 138, 0, 1767904960,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 30 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.0358726978302 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767904966_1378827 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904967), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011656_28dcedbb6f0ea1279b23a93a7f70afb0_rle_crop_4094275146_0.png', 0, 326, 262, 0, 1767904967,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904967), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275170_0.png', 0, 151, 131, 0, 1767904967,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904967), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011484_63f42e8b3c3f59c89166dac9bf41f817_rle_crop_4094275185_0.png', 0, 211, 221, 0, 1767904967,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.2772905826568604 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1767904970_1378827 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1767904970), 0.0, 0.0, 14, '', 0, 0, '1767904828_1378827_1403011734_67f53d109aa604dc01bb099382f19939_rle_crop_4094275131_0.png', 0, 162, 221, 0, 1767904970,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.710139274597168 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1403011734, 1403011705, 1403011656, 1403011610, 1403011551, 1403011493, 1403011487, 1403011484, 1403011474, 1403011472, 1403011470, 1403011469] Looping around the photos to save general results len do output : 84 /1403018803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1403018910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011734', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011705', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011656', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011610', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011551', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011493', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011487', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011484', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011474', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011472', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011470', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011469', None, None, None, None, None, '4327249') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 264 time used for this insertion : 0.06812381744384766 save_final save missing photos in datou_result : time spend for datou_step_exec : 58.63477301597595 time spend to save output : 0.07152009010314941 total time spend for step 2 : 58.7062931060791 step3:rle_unique_nms_with_priority Thu Jan 8 21:42:50 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 84 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 6 nb_hashtags : 4 time to prepare the origin masks : 4.6301047801971436 time for calcul the mask position with numpy : 0.3334312438964844 nb_pixel_total : 7645842 time to create 1 rle with new method : 0.7183783054351807 time for calcul the mask position with numpy : 0.023962974548339844 nb_pixel_total : 45163 time to create 1 rle with old method : 0.04793834686279297 time for calcul the mask position with numpy : 0.024204730987548828 nb_pixel_total : 31448 time to create 1 rle with old method : 0.03355669975280762 time for calcul the mask position with numpy : 0.024327754974365234 nb_pixel_total : 46502 time to create 1 rle with old method : 0.048722267150878906 time for calcul the mask position with numpy : 0.026538610458374023 nb_pixel_total : 297153 time to create 1 rle with new method : 0.9486899375915527 time for calcul the mask position with numpy : 0.02418231964111328 nb_pixel_total : 47375 time to create 1 rle with old method : 0.04971814155578613 time for calcul the mask position with numpy : 0.024640321731567383 nb_pixel_total : 180917 time to create 1 rle with new method : 0.899613618850708 create new chi : 3.313246965408325 time to delete rle : 0.047988176345825195 batch 1 Loaded 13 chid ids of type : 3594 ++++++Number RLEs to save : 5940 TO DO : save crop sub photo not yet done ! save time : 0.6330499649047852 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 5.978121042251587 time for calcul the mask position with numpy : 0.49619579315185547 nb_pixel_total : 7781110 time to create 1 rle with new method : 1.6416757106781006 time for calcul the mask position with numpy : 0.02397608757019043 nb_pixel_total : 65031 time to create 1 rle with old method : 0.06856703758239746 time for calcul the mask position with numpy : 0.023499488830566406 nb_pixel_total : 41355 time to create 1 rle with old method : 0.042944908142089844 time for calcul the mask position with numpy : 0.024161815643310547 nb_pixel_total : 70535 time to create 1 rle with old method : 0.07432794570922852 time for calcul the mask position with numpy : 0.024913787841796875 nb_pixel_total : 14413 time to create 1 rle with old method : 0.01541900634765625 time for calcul the mask position with numpy : 0.02394390106201172 nb_pixel_total : 68596 time to create 1 rle with old method : 0.07419466972351074 time for calcul the mask position with numpy : 0.027217626571655273 nb_pixel_total : 42818 time to create 1 rle with old method : 0.04784417152404785 time for calcul the mask position with numpy : 0.02639174461364746 nb_pixel_total : 26324 time to create 1 rle with old method : 0.028688669204711914 time for calcul the mask position with numpy : 0.02500772476196289 nb_pixel_total : 129987 time to create 1 rle with old method : 0.13741064071655273 time for calcul the mask position with numpy : 0.024366378784179688 nb_pixel_total : 10371 time to create 1 rle with old method : 0.01100015640258789 time for calcul the mask position with numpy : 0.023900270462036133 nb_pixel_total : 43860 time to create 1 rle with old method : 0.047974586486816406 create new chi : 2.976288318634033 time to delete rle : 0.001428842544555664 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++Number RLEs to save : 7928 TO DO : save crop sub photo not yet done ! save time : 0.847663402557373 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 4.115591526031494 time for calcul the mask position with numpy : 0.8275113105773926 nb_pixel_total : 7972148 time to create 1 rle with new method : 0.7607481479644775 time for calcul the mask position with numpy : 0.04036569595336914 nb_pixel_total : 64617 time to create 1 rle with old method : 0.06913280487060547 time for calcul the mask position with numpy : 0.040061235427856445 nb_pixel_total : 112789 time to create 1 rle with old method : 0.12523174285888672 time for calcul the mask position with numpy : 0.03760218620300293 nb_pixel_total : 58104 time to create 1 rle with old method : 0.06190657615661621 time for calcul the mask position with numpy : 0.028800010681152344 nb_pixel_total : 15319 time to create 1 rle with old method : 0.01669025421142578 time for calcul the mask position with numpy : 0.0270230770111084 nb_pixel_total : 27639 time to create 1 rle with old method : 0.03144359588623047 time for calcul the mask position with numpy : 0.025208234786987305 nb_pixel_total : 43784 time to create 1 rle with old method : 0.049050331115722656 create new chi : 2.184020519256592 time to delete rle : 0.0012090206146240234 batch 1 Loaded 13 chid ids of type : 3594 ++++++++Number RLEs to save : 5100 TO DO : save crop sub photo not yet done ! save time : 0.7138259410858154 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 3.0799944400787354 time for calcul the mask position with numpy : 0.7419803142547607 nb_pixel_total : 7969148 time to create 1 rle with new method : 0.6611113548278809 time for calcul the mask position with numpy : 0.032700300216674805 nb_pixel_total : 79839 time to create 1 rle with old method : 0.11554765701293945 time for calcul the mask position with numpy : 0.04068708419799805 nb_pixel_total : 17414 time to create 1 rle with old method : 0.01893925666809082 time for calcul the mask position with numpy : 0.03410196304321289 nb_pixel_total : 72292 time to create 1 rle with old method : 0.0802755355834961 time for calcul the mask position with numpy : 0.025772809982299805 nb_pixel_total : 155707 time to create 1 rle with new method : 0.9321861267089844 create new chi : 2.7549591064453125 time to delete rle : 0.0008351802825927734 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 4898 TO DO : save crop sub photo not yet done ! save time : 0.7969276905059814 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 5.315752029418945 time for calcul the mask position with numpy : 0.625068187713623 nb_pixel_total : 7617722 time to create 1 rle with new method : 0.8609161376953125 time for calcul the mask position with numpy : 0.02476358413696289 nb_pixel_total : 5651 time to create 1 rle with old method : 0.006472349166870117 time for calcul the mask position with numpy : 0.0255124568939209 nb_pixel_total : 22807 time to create 1 rle with old method : 0.02584052085876465 time for calcul the mask position with numpy : 0.029123544692993164 nb_pixel_total : 259600 time to create 1 rle with new method : 0.7698116302490234 time for calcul the mask position with numpy : 0.03349900245666504 nb_pixel_total : 36867 time to create 1 rle with old method : 0.04133796691894531 time for calcul the mask position with numpy : 0.044747114181518555 nb_pixel_total : 146833 time to create 1 rle with old method : 0.16393184661865234 time for calcul the mask position with numpy : 0.04461812973022461 nb_pixel_total : 90334 time to create 1 rle with old method : 0.10096478462219238 time for calcul the mask position with numpy : 0.03733968734741211 nb_pixel_total : 22393 time to create 1 rle with old method : 0.024972915649414062 time for calcul the mask position with numpy : 0.038941383361816406 nb_pixel_total : 46615 time to create 1 rle with old method : 0.05159306526184082 time for calcul the mask position with numpy : 0.025098323822021484 nb_pixel_total : 45578 time to create 1 rle with old method : 0.05068230628967285 create new chi : 3.100029945373535 time to delete rle : 0.0013730525970458984 batch 1 Loaded 19 chid ids of type : 3594 +++++++++++++Number RLEs to save : 8646 TO DO : save crop sub photo not yet done ! save time : 0.9350430965423584 nb_obj : 11 nb_hashtags : 4 time to prepare the origin masks : 7.015555381774902 time for calcul the mask position with numpy : 0.8776662349700928 nb_pixel_total : 7783580 time to create 1 rle with new method : 0.7643473148345947 time for calcul the mask position with numpy : 0.02277064323425293 nb_pixel_total : 52117 time to create 1 rle with old method : 0.05564475059509277 time for calcul the mask position with numpy : 0.023953914642333984 nb_pixel_total : 23177 time to create 1 rle with old method : 0.02529597282409668 time for calcul the mask position with numpy : 0.023290157318115234 nb_pixel_total : 15278 time to create 1 rle with old method : 0.0162813663482666 time for calcul the mask position with numpy : 0.023852825164794922 nb_pixel_total : 40125 time to create 1 rle with old method : 0.042168617248535156 time for calcul the mask position with numpy : 0.024485111236572266 nb_pixel_total : 47523 time to create 1 rle with old method : 0.0499730110168457 time for calcul the mask position with numpy : 0.023287057876586914 nb_pixel_total : 16419 time to create 1 rle with old method : 0.017483234405517578 time for calcul the mask position with numpy : 0.024604320526123047 nb_pixel_total : 9872 time to create 1 rle with old method : 0.010702848434448242 time for calcul the mask position with numpy : 0.02705240249633789 nb_pixel_total : 26479 time to create 1 rle with old method : 0.032122135162353516 time for calcul the mask position with numpy : 0.026844263076782227 nb_pixel_total : 159132 time to create 1 rle with new method : 0.8746695518493652 time for calcul the mask position with numpy : 0.024397850036621094 nb_pixel_total : 60006 time to create 1 rle with old method : 0.06385064125061035 time for calcul the mask position with numpy : 0.02382946014404297 nb_pixel_total : 60692 time to create 1 rle with old method : 0.06560659408569336 create new chi : 3.230905055999756 time to delete rle : 0.0013742446899414062 batch 1 Loaded 23 chid ids of type : 3594 ++++++++++++Number RLEs to save : 8965 TO DO : save crop sub photo not yet done ! save time : 1.0236637592315674 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 4.745493173599243 time for calcul the mask position with numpy : 0.5055160522460938 nb_pixel_total : 8037646 time to create 1 rle with new method : 0.8213601112365723 time for calcul the mask position with numpy : 0.02495121955871582 nb_pixel_total : 102907 time to create 1 rle with old method : 0.10747408866882324 time for calcul the mask position with numpy : 0.023348569869995117 nb_pixel_total : 19433 time to create 1 rle with old method : 0.020383834838867188 time for calcul the mask position with numpy : 0.02406144142150879 nb_pixel_total : 22730 time to create 1 rle with old method : 0.023969650268554688 time for calcul the mask position with numpy : 0.024068355560302734 nb_pixel_total : 31030 time to create 1 rle with old method : 0.0330963134765625 time for calcul the mask position with numpy : 0.024059057235717773 nb_pixel_total : 27712 time to create 1 rle with old method : 0.0297853946685791 time for calcul the mask position with numpy : 0.02379631996154785 nb_pixel_total : 23747 time to create 1 rle with old method : 0.02493882179260254 time for calcul the mask position with numpy : 0.023033618927001953 nb_pixel_total : 29195 time to create 1 rle with old method : 0.030523061752319336 create new chi : 1.8067820072174072 time to delete rle : 0.0008220672607421875 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 5808 TO DO : save crop sub photo not yet done ! save time : 0.7817769050598145 nb_obj : 8 nb_hashtags : 4 time to prepare the origin masks : 6.871848106384277 time for calcul the mask position with numpy : 0.6933660507202148 nb_pixel_total : 8065491 time to create 1 rle with new method : 0.8574693202972412 time for calcul the mask position with numpy : 0.028516292572021484 nb_pixel_total : 11410 time to create 1 rle with old method : 0.012198686599731445 time for calcul the mask position with numpy : 0.02296733856201172 nb_pixel_total : 10591 time to create 1 rle with old method : 0.011235713958740234 time for calcul the mask position with numpy : 0.023705005645751953 nb_pixel_total : 43611 time to create 1 rle with old method : 0.04545307159423828 time for calcul the mask position with numpy : 0.024526119232177734 nb_pixel_total : 33199 time to create 1 rle with old method : 0.03667426109313965 time for calcul the mask position with numpy : 0.02477717399597168 nb_pixel_total : 42716 time to create 1 rle with old method : 0.04476189613342285 time for calcul the mask position with numpy : 0.024280548095703125 nb_pixel_total : 10789 time to create 1 rle with old method : 0.011428356170654297 time for calcul the mask position with numpy : 0.023971080780029297 nb_pixel_total : 28771 time to create 1 rle with old method : 0.03197646141052246 time for calcul the mask position with numpy : 0.024157047271728516 nb_pixel_total : 47822 time to create 1 rle with old method : 0.05082869529724121 create new chi : 2.034496784210205 time to delete rle : 0.0007708072662353516 batch 1 Loaded 17 chid ids of type : 3594 ++++++++++Number RLEs to save : 5788 TO DO : save crop sub photo not yet done ! save time : 0.8830509185791016 nb_obj : 5 nb_hashtags : 3 time to prepare the origin masks : 3.685598373413086 time for calcul the mask position with numpy : 0.7139143943786621 nb_pixel_total : 8150026 time to create 1 rle with new method : 0.9524869918823242 time for calcul the mask position with numpy : 0.0263979434967041 nb_pixel_total : 19182 time to create 1 rle with old method : 0.021951913833618164 time for calcul the mask position with numpy : 0.026937007904052734 nb_pixel_total : 24784 time to create 1 rle with old method : 0.029370784759521484 time for calcul the mask position with numpy : 0.02675175666809082 nb_pixel_total : 57134 time to create 1 rle with old method : 0.06386399269104004 time for calcul the mask position with numpy : 0.026317834854125977 nb_pixel_total : 25904 time to create 1 rle with old method : 0.0293731689453125 time for calcul the mask position with numpy : 0.02489757537841797 nb_pixel_total : 17370 time to create 1 rle with old method : 0.019232511520385742 create new chi : 2.0065855979919434 time to delete rle : 0.0006868839263916016 batch 1 Loaded 11 chid ids of type : 3594 ++++++Number RLEs to save : 4012 TO DO : save crop sub photo not yet done ! save time : 0.37418127059936523 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 4.674283742904663 time for calcul the mask position with numpy : 0.687842607498169 nb_pixel_total : 7875407 time to create 1 rle with new method : 0.8440279960632324 time for calcul the mask position with numpy : 0.025507688522338867 nb_pixel_total : 92954 time to create 1 rle with old method : 0.10384869575500488 time for calcul the mask position with numpy : 0.02497076988220215 nb_pixel_total : 21863 time to create 1 rle with old method : 0.024765729904174805 time for calcul the mask position with numpy : 0.027820587158203125 nb_pixel_total : 146214 time to create 1 rle with old method : 0.15987014770507812 time for calcul the mask position with numpy : 0.02531266212463379 nb_pixel_total : 11793 time to create 1 rle with old method : 0.012882709503173828 time for calcul the mask position with numpy : 0.024571895599365234 nb_pixel_total : 22572 time to create 1 rle with old method : 0.025285720825195312 time for calcul the mask position with numpy : 0.025417804718017578 nb_pixel_total : 54837 time to create 1 rle with old method : 0.08713316917419434 time for calcul the mask position with numpy : 0.025169849395751953 nb_pixel_total : 68760 time to create 1 rle with old method : 0.07339930534362793 create new chi : 2.2417490482330322 time to delete rle : 0.0010204315185546875 batch 1 Loaded 15 chid ids of type : 3594 +++++++Number RLEs to save : 6576 TO DO : save crop sub photo not yet done ! save time : 0.6593561172485352 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 2.7262468338012695 time for calcul the mask position with numpy : 0.701610803604126 nb_pixel_total : 8139558 time to create 1 rle with new method : 0.9254653453826904 time for calcul the mask position with numpy : 0.02497243881225586 nb_pixel_total : 43725 time to create 1 rle with old method : 0.04933524131774902 time for calcul the mask position with numpy : 0.024366140365600586 nb_pixel_total : 27670 time to create 1 rle with old method : 0.031046390533447266 time for calcul the mask position with numpy : 0.026101350784301758 nb_pixel_total : 36174 time to create 1 rle with old method : 0.04046916961669922 time for calcul the mask position with numpy : 0.026219844818115234 nb_pixel_total : 47273 time to create 1 rle with old method : 0.052855491638183594 create new chi : 1.9479258060455322 time to delete rle : 0.0006051063537597656 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 4226 TO DO : save crop sub photo not yet done ! save time : 0.5208616256713867 nb_obj : 7 nb_hashtags : 4 time to prepare the origin masks : 6.419893026351929 time for calcul the mask position with numpy : 0.6470074653625488 nb_pixel_total : 7979302 time to create 1 rle with new method : 1.0083816051483154 time for calcul the mask position with numpy : 0.024764299392700195 nb_pixel_total : 49293 time to create 1 rle with old method : 0.05563163757324219 time for calcul the mask position with numpy : 0.026258468627929688 nb_pixel_total : 19141 time to create 1 rle with old method : 0.02160334587097168 time for calcul the mask position with numpy : 0.025584697723388672 nb_pixel_total : 10379 time to create 1 rle with old method : 0.011749029159545898 time for calcul the mask position with numpy : 0.026407957077026367 nb_pixel_total : 16982 time to create 1 rle with old method : 0.019291400909423828 time for calcul the mask position with numpy : 0.029100894927978516 nb_pixel_total : 17255 time to create 1 rle with old method : 0.022511005401611328 time for calcul the mask position with numpy : 0.026935100555419922 nb_pixel_total : 171229 time to create 1 rle with new method : 0.8334877490997314 time for calcul the mask position with numpy : 0.026720046997070312 nb_pixel_total : 30819 time to create 1 rle with old method : 0.04365229606628418 create new chi : 2.9254415035247803 time to delete rle : 0.0017082691192626953 batch 1 Loaded 15 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 5516 TO DO : save crop sub photo not yet done ! save time : 0.608130931854248 map_output_result : {1403011734: (0.0, 'Should be the crop_list due to order', 0), 1403011705: (0.0, 'Should be the crop_list due to order', 0), 1403011656: (0.0, 'Should be the crop_list due to order', 0), 1403011610: (0.0, 'Should be the crop_list due to order', 0), 1403011551: (0.0, 'Should be the crop_list due to order', 0), 1403011493: (0.0, 'Should be the crop_list due to order', 0), 1403011487: (0.0, 'Should be the crop_list due to order', 0), 1403011484: (0.0, 'Should be the crop_list due to order', 0), 1403011474: (0.0, 'Should be the crop_list due to order', 0), 1403011472: (0.0, 'Should be the crop_list due to order', 0), 1403011470: (0.0, 'Should be the crop_list due to order', 0), 1403011469: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1403011734, 1403011705, 1403011656, 1403011610, 1403011551, 1403011493, 1403011487, 1403011484, 1403011474, 1403011472, 1403011470, 1403011469] Looping around the photos to save general results len do output : 12 /1403011734.Didn't retrieve data . /1403011705.Didn't retrieve data . /1403011656.Didn't retrieve data . /1403011610.Didn't retrieve data . /1403011551.Didn't retrieve data . /1403011493.Didn't retrieve data . /1403011487.Didn't retrieve data . /1403011484.Didn't retrieve data . /1403011474.Didn't retrieve data . /1403011472.Didn't retrieve data . /1403011470.Didn't retrieve data . /1403011469.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011734', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011705', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011656', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011610', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011551', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011493', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011487', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011484', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011474', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011472', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011470', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011469', None, None, None, None, None, '4327249') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.029195070266723633 save_final save missing photos in datou_result : time spend for datou_step_exec : 100.25576090812683 time spend to save output : 0.029750585556030273 total time spend for step 3 : 100.28551149368286 step4:ventilate_hashtags_in_portfolio Thu Jan 8 21:44:30 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 30060714 get user id for portfolio 30060714 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30060714 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','autre','papier','background','mal_croppe','carton','pet_clair','pehd','flou','environnement','metal')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30060714 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','autre','papier','background','mal_croppe','carton','pet_clair','pehd','flou','environnement','metal')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30060714 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','autre','papier','background','mal_croppe','carton','pet_clair','pehd','flou','environnement','metal')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/30060780,30060781,30060782,30060783,30060784,30060785,30060786,30060787,30060788,30060789,30060790?tags=pet_fonce,autre,papier,background,mal_croppe,carton,pet_clair,pehd,flou,environnement,metal Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1403011734, 1403011705, 1403011656, 1403011610, 1403011551, 1403011493, 1403011487, 1403011484, 1403011474, 1403011472, 1403011470, 1403011469] Looping around the photos to save general results len do output : 1 /30060714. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011734', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011705', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011656', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011610', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011551', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011493', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011487', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011484', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011474', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011472', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011470', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011469', None, None, None, None, None, '4327249') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.0393366813659668 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.848198413848877 time spend to save output : 0.03963661193847656 total time spend for step 4 : 4.8878350257873535 step5:final Thu Jan 8 21:44:35 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1403011734: ('0.04537016943158437',), 1403011705: ('0.04537016943158437',), 1403011656: ('0.04537016943158437',), 1403011610: ('0.04537016943158437',), 1403011551: ('0.04537016943158437',), 1403011493: ('0.04537016943158437',), 1403011487: ('0.04537016943158437',), 1403011484: ('0.04537016943158437',), 1403011474: ('0.04537016943158437',), 1403011472: ('0.04537016943158437',), 1403011470: ('0.04537016943158437',), 1403011469: ('0.04537016943158437',)} new output for save of step final : {1403011734: ('0.04537016943158437',), 1403011705: ('0.04537016943158437',), 1403011656: ('0.04537016943158437',), 1403011610: ('0.04537016943158437',), 1403011551: ('0.04537016943158437',), 1403011493: ('0.04537016943158437',), 1403011487: ('0.04537016943158437',), 1403011484: ('0.04537016943158437',), 1403011474: ('0.04537016943158437',), 1403011472: ('0.04537016943158437',), 1403011470: ('0.04537016943158437',), 1403011469: ('0.04537016943158437',)} [1403011734, 1403011705, 1403011656, 1403011610, 1403011551, 1403011493, 1403011487, 1403011484, 1403011474, 1403011472, 1403011470, 1403011469] Looping around the photos to save general results len do output : 12 /1403011734.Didn't retrieve data . /1403011705.Didn't retrieve data . /1403011656.Didn't retrieve data . /1403011610.Didn't retrieve data . /1403011551.Didn't retrieve data . /1403011493.Didn't retrieve data . /1403011487.Didn't retrieve data . /1403011484.Didn't retrieve data . /1403011474.Didn't retrieve data . /1403011472.Didn't retrieve data . /1403011470.Didn't retrieve data . /1403011469.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011734', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011705', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011656', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011610', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011551', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011493', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011487', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011484', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011474', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011472', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011470', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011469', None, None, None, None, None, '4327249') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 36 time used for this insertion : 0.040015220642089844 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.3642592430114746 time spend to save output : 0.040665388107299805 total time spend for step 5 : 0.4049246311187744 step6:blur_detection Thu Jan 8 21:44:36 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1767904828_1378827_1403011734_67f53d109aa604dc01bb099382f19939.jpg resize: (2160, 3840) 1403011734 -6.198098808385203 treat image : temp/1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb.jpg resize: (2160, 3840) 1403011705 -7.011639988119646 treat image : temp/1767904828_1378827_1403011656_28dcedbb6f0ea1279b23a93a7f70afb0.jpg resize: (2160, 3840) 1403011656 -7.0981557969169975 treat image : temp/1767904828_1378827_1403011610_d13956ba51bbcf4e96ec54b5f99a7b36.jpg resize: (2160, 3840) 1403011610 -7.0570607754101715 treat image : temp/1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e.jpg resize: (2160, 3840) 1403011551 -7.179043668419904 treat image : temp/1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486.jpg resize: (2160, 3840) 1403011493 -7.028292513569549 treat image : temp/1767904828_1378827_1403011487_98fdffab7ffb9cc11f5a54266afff405.jpg resize: (2160, 3840) 1403011487 -7.058928937193768 treat image : temp/1767904828_1378827_1403011484_63f42e8b3c3f59c89166dac9bf41f817.jpg resize: (2160, 3840) 1403011484 -6.973120669484747 treat image : temp/1767904828_1378827_1403011474_1012e837242b3bbcfe17e5f1524a6891.jpg resize: (2160, 3840) 1403011474 -7.070752774699552 treat image : temp/1767904828_1378827_1403011472_f3235929bba3922f2719422a5dff4333.jpg resize: (2160, 3840) 1403011472 -6.970182022134896 treat image : temp/1767904828_1378827_1403011470_6746b6ff239ba5d9576e6e89361bc271.jpg resize: (2160, 3840) 1403011470 -7.012787065868315 treat image : temp/1767904828_1378827_1403011469_8dfcec389f6ea7f358592d63aae11d50.jpg resize: (2160, 3840) 1403011469 -7.064450880373982 treat image : temp/1767904828_1378827_1403011734_67f53d109aa604dc01bb099382f19939_rle_crop_4094275127_0.png resize: (432, 596) 1403018803 -4.555080106898382 treat image : temp/1767904828_1378827_1403011734_67f53d109aa604dc01bb099382f19939_rle_crop_4094275132_0.png resize: (264, 258) 1403018805 -4.250976735713475 treat image : temp/1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275134_0.png resize: (154, 92) 1403018806 -4.10933554543005 treat image : temp/1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275135_0.png resize: (381, 501) 1403018807 -5.610007791576731 treat image : temp/1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275136_0.png resize: (262, 131) 1403018808 -4.556817481896842 treat image : temp/1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275139_0.png resize: (170, 190) 1403018809 -4.252203594563233 treat image : temp/1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275141_0.png resize: (214, 318) 1403018811 -4.077926303527342 treat image : temp/1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275142_0.png resize: (382, 309) 1403018812 -4.548462524139105 treat image : temp/1767904828_1378827_1403011656_28dcedbb6f0ea1279b23a93a7f70afb0_rle_crop_4094275143_0.png resize: (193, 407) 1403018813 -3.279451556298046 treat image : temp/1767904828_1378827_1403011656_28dcedbb6f0ea1279b23a93a7f70afb0_rle_crop_4094275144_0.png resize: (190, 196) 1403018814 -3.3493826307956103 treat image : temp/1767904828_1378827_1403011656_28dcedbb6f0ea1279b23a93a7f70afb0_rle_crop_4094275145_0.png resize: (134, 150) 1403018815 -3.714680409279016 treat image : temp/1767904828_1378827_1403011610_d13956ba51bbcf4e96ec54b5f99a7b36_rle_crop_4094275149_0.png resize: (456, 506) 1403018816 -5.395522146191 treat image : temp/1767904828_1378827_1403011610_d13956ba51bbcf4e96ec54b5f99a7b36_rle_crop_4094275150_0.png resize: (354, 348) 1403018817 -4.6486003644854375 treat image : temp/1767904828_1378827_1403011610_d13956ba51bbcf4e96ec54b5f99a7b36_rle_crop_4094275151_0.png resize: (132, 194) 1403018818 -3.9969198508099057 treat image : temp/1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e_rle_crop_4094275153_0.png resize: (435, 199) 1403018819 -4.183977942460392 treat image : temp/1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e_rle_crop_4094275157_0.png resize: (375, 572) 1403018820 -5.075656088567139 treat image : temp/1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e_rle_crop_4094275158_0.png resize: (263, 317) 1403018821 -4.0738741410280435 treat image : temp/1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e_rle_crop_4094275159_0.png resize: (602, 623) 1403018822 -2.987302635499215 treat image : temp/1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e_rle_crop_4094275161_0.png resize: (79, 104) 1403018823 -4.401871524011692 treat image : temp/1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275162_0.png resize: (350, 346) 1403018824 -4.907900347866568 treat image : temp/1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275165_0.png resize: (125, 272) 1403018825 -4.366160601438931 treat image : temp/1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275166_0.png resize: (125, 114) 1403018826 -2.8908324876314277 treat image : temp/1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275171_0.png resize: (696, 111) 1403018827 -3.9676320538903838 treat image : temp/1767904828_1378827_1403011487_98fdffab7ffb9cc11f5a54266afff405_rle_crop_4094275173_0.png resize: (281, 206) 1403018828 -4.604502593428219 treat image : temp/1767904828_1378827_1403011487_98fdffab7ffb9cc11f5a54266afff405_rle_crop_4094275174_0.png resize: (302, 115) 1403018829 -3.5319822191208603 treat image : temp/1767904828_1378827_1403011487_98fdffab7ffb9cc11f5a54266afff405_rle_crop_4094275175_0.png resize: (325, 110) 1403018830 -4.253725046318587 treat image : temp/1767904828_1378827_1403011487_98fdffab7ffb9cc11f5a54266afff405_rle_crop_4094275177_0.png resize: (162, 210) 1403018831 -2.7136995585862342 treat image : temp/1767904828_1378827_1403011484_63f42e8b3c3f59c89166dac9bf41f817_rle_crop_4094275180_0.png resize: (396, 193) 1403018832 -4.243519939984868 treat image : temp/1767904828_1378827_1403011474_1012e837242b3bbcfe17e5f1524a6891_rle_crop_4094275189_0.png resize: (142, 283) 1403018833 -4.907179595848348 treat image : temp/1767904828_1378827_1403011474_1012e837242b3bbcfe17e5f1524a6891_rle_crop_4094275190_0.png resize: (298, 306) 1403018834 -4.239368734689408 treat image : temp/1767904828_1378827_1403011474_1012e837242b3bbcfe17e5f1524a6891_rle_crop_4094275191_0.png resize: (181, 219) 1403018835 -4.328525358411581 treat image : temp/1767904828_1378827_1403011472_f3235929bba3922f2719422a5dff4333_rle_crop_4094275199_0.png resize: (514, 262) 1403018836 -4.68664222349064 treat image : temp/1767904828_1378827_1403011470_6746b6ff239ba5d9576e6e89361bc271_rle_crop_4094275202_0.png resize: (182, 207) 1403018837 -4.280925005888228 treat image : temp/1767904828_1378827_1403011469_8dfcec389f6ea7f358592d63aae11d50_rle_crop_4094275204_0.png resize: (214, 196) 1403018838 -4.960710333425424 treat image : temp/1767904828_1378827_1403011469_8dfcec389f6ea7f358592d63aae11d50_rle_crop_4094275210_0.png resize: (241, 371) 1403018839 -5.620855012762022 treat image : temp/1767904828_1378827_1403011734_67f53d109aa604dc01bb099382f19939_rle_crop_4094275130_0.png resize: (380, 181) 1403018846 -4.647944392774035 treat image : temp/1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275133_0.png resize: (268, 239) 1403018847 -3.428257890522522 treat image : temp/1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275138_0.png resize: (413, 285) 1403018848 -4.192833185475774 treat image : temp/1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e_rle_crop_4094275156_0.png resize: (491, 333) 1403018849 -4.556029016525776 treat image : temp/1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275167_0.png resize: (247, 100) 1403018850 -3.5734585459466937 treat image : temp/1767904828_1378827_1403011484_63f42e8b3c3f59c89166dac9bf41f817_rle_crop_4094275181_0.png resize: (279, 214) 1403018851 -4.327414236262154 treat image : temp/1767904828_1378827_1403011484_63f42e8b3c3f59c89166dac9bf41f817_rle_crop_4094275187_0.png resize: (117, 134) 1403018852 -1.9360003345935386 treat image : temp/1767904828_1378827_1403011474_1012e837242b3bbcfe17e5f1524a6891_rle_crop_4094275188_0.png resize: (166, 155) 1403018853 -1.752818765687142 treat image : temp/1767904828_1378827_1403011472_f3235929bba3922f2719422a5dff4333_rle_crop_4094275196_0.png resize: (178, 119) 1403018854 -2.599442860963527 treat image : temp/1767904828_1378827_1403011472_f3235929bba3922f2719422a5dff4333_rle_crop_4094275198_0.png resize: (189, 168) 1403018855 -4.6687387326154095 treat image : temp/1767904828_1378827_1403011469_8dfcec389f6ea7f358592d63aae11d50_rle_crop_4094275206_0.png resize: (189, 151) 1403018856 -3.464023634135293 treat image : temp/1767904828_1378827_1403011487_98fdffab7ffb9cc11f5a54266afff405_rle_crop_4094275176_0.png resize: (201, 189) 1403018857 -4.889409326151522 treat image : temp/1767904828_1378827_1403011487_98fdffab7ffb9cc11f5a54266afff405_rle_crop_4094275178_0.png resize: (162, 132) 1403018859 -3.8270851716531795 treat image : temp/1767904828_1378827_1403011469_8dfcec389f6ea7f358592d63aae11d50_rle_crop_4094275207_0.png resize: (147, 172) 1403018860 -4.926302522294486 treat image : temp/1767904828_1378827_1403011469_8dfcec389f6ea7f358592d63aae11d50_rle_crop_4094275208_0.png resize: (118, 124) 1403018861 -5.149509537202746 treat image : temp/1767904828_1378827_1403011734_67f53d109aa604dc01bb099382f19939_rle_crop_4094275128_0.png resize: (175, 354) 1403018865 -4.235487345975421 treat image : temp/1767904828_1378827_1403011734_67f53d109aa604dc01bb099382f19939_rle_crop_4094275129_0.png resize: (374, 1106) 1403018866 -1.3940264159723008 treat image : temp/1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275137_0.png resize: (220, 265) 1403018867 -4.056548584063537 treat image : temp/1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275140_0.png resize: (351, 273) 1403018868 -3.5778410580706095 treat image : temp/1767904828_1378827_1403011656_28dcedbb6f0ea1279b23a93a7f70afb0_rle_crop_4094275147_0.png resize: (273, 491) 1403018869 -4.226886905106454 treat image : temp/1767904828_1378827_1403011656_28dcedbb6f0ea1279b23a93a7f70afb0_rle_crop_4094275148_0.png resize: (321, 286) 1403018870 -5.556480612071852 treat image : temp/1767904828_1378827_1403011610_d13956ba51bbcf4e96ec54b5f99a7b36_rle_crop_4094275152_0.png resize: (263, 389) 1403018871 -5.6534238582015375 treat image : temp/1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e_rle_crop_4094275154_0.png resize: (303, 245) 1403018872 -4.954643506587698 treat image : temp/1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e_rle_crop_4094275155_0.png resize: (159, 217) 1403018873 -5.287898752049222 treat image : temp/1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e_rle_crop_4094275160_0.png resize: (176, 173) 1403018874 -4.899087831209124 treat image : temp/1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275163_0.png resize: (403, 221) 1403018875 -6.202461026859002 treat image : temp/1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275164_0.png resize: (620, 315) 1403018876 -6.532619636249097 treat image : temp/1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275168_0.png resize: (199, 318) 1403018877 -4.541503749306704 treat image : temp/1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275169_0.png resize: (312, 202) 1403018878 -5.261831367720416 treat image : temp/1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275172_0.png resize: (261, 273) 1403018879 -4.79261823305796 treat image : temp/1767904828_1378827_1403011487_98fdffab7ffb9cc11f5a54266afff405_rle_crop_4094275179_0.png resize: (388, 464) 1403018880 -4.22452597351851 treat image : temp/1767904828_1378827_1403011484_63f42e8b3c3f59c89166dac9bf41f817_rle_crop_4094275182_0.png resize: (119, 152) 1403018881 -3.462646511609409 treat image : temp/1767904828_1378827_1403011484_63f42e8b3c3f59c89166dac9bf41f817_rle_crop_4094275183_0.png resize: (242, 231) 1403018882 -4.771594082072718 treat image : temp/1767904828_1378827_1403011484_63f42e8b3c3f59c89166dac9bf41f817_rle_crop_4094275184_0.png resize: (213, 221) 1403018883 -5.757009061243673 treat image : temp/1767904828_1378827_1403011484_63f42e8b3c3f59c89166dac9bf41f817_rle_crop_4094275186_0.png resize: (142, 92) 1403018884 -3.524647058489223 treat image : temp/1767904828_1378827_1403011474_1012e837242b3bbcfe17e5f1524a6891_rle_crop_4094275192_0.png resize: (93, 288) 1403018885 -3.311546261635634 treat image : temp/1767904828_1378827_1403011472_f3235929bba3922f2719422a5dff4333_rle_crop_4094275193_0.png resize: (361, 316) 1403018886 -4.251072768370478 treat image : temp/1767904828_1378827_1403011472_f3235929bba3922f2719422a5dff4333_rle_crop_4094275194_0.png resize: (148, 418) 1403018887 -3.262014950962941 treat image : temp/1767904828_1378827_1403011472_f3235929bba3922f2719422a5dff4333_rle_crop_4094275195_0.png resize: (189, 133) 1403018888 -2.7854148018351044 treat image : temp/1767904828_1378827_1403011472_f3235929bba3922f2719422a5dff4333_rle_crop_4094275197_0.png resize: (589, 354) 1403018889 -5.699179273326056 treat image : temp/1767904828_1378827_1403011470_6746b6ff239ba5d9576e6e89361bc271_rle_crop_4094275200_0.png resize: (290, 239) 1403018890 -4.888122654609249 treat image : temp/1767904828_1378827_1403011470_6746b6ff239ba5d9576e6e89361bc271_rle_crop_4094275201_0.png resize: (281, 197) 1403018891 -4.3279685402285395 treat image : temp/1767904828_1378827_1403011470_6746b6ff239ba5d9576e6e89361bc271_rle_crop_4094275203_0.png resize: (168, 378) 1403018892 -5.175307113675446 treat image : temp/1767904828_1378827_1403011469_8dfcec389f6ea7f358592d63aae11d50_rle_crop_4094275205_0.png resize: (514, 574) 1403018893 -3.422891493742751 treat image : temp/1767904828_1378827_1403011469_8dfcec389f6ea7f358592d63aae11d50_rle_crop_4094275209_0.png resize: (138, 165) 1403018895 -3.787520238243818 treat image : temp/1767904828_1378827_1403011656_28dcedbb6f0ea1279b23a93a7f70afb0_rle_crop_4094275146_0.png resize: (262, 326) 1403018897 -5.228213016869013 treat image : temp/1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275170_0.png resize: (131, 151) 1403018899 -4.556853957744803 treat image : temp/1767904828_1378827_1403011484_63f42e8b3c3f59c89166dac9bf41f817_rle_crop_4094275185_0.png resize: (221, 211) 1403018900 -4.45603926455116 treat image : temp/1767904828_1378827_1403011734_67f53d109aa604dc01bb099382f19939_rle_crop_4094275131_0.png resize: (221, 162) 1403018910 -4.404003163447419 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 96 time used for this insertion : 0.042700767517089844 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 96 time used for this insertion : 0.03996682167053223 save missing photos in datou_result : time spend for datou_step_exec : 53.74082970619202 time spend to save output : 0.09934258460998535 total time spend for step 6 : 53.840172290802 step7:brightness Thu Jan 8 21:45:29 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1767904828_1378827_1403011734_67f53d109aa604dc01bb099382f19939.jpg treat image : temp/1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb.jpg treat image : temp/1767904828_1378827_1403011656_28dcedbb6f0ea1279b23a93a7f70afb0.jpg treat image : temp/1767904828_1378827_1403011610_d13956ba51bbcf4e96ec54b5f99a7b36.jpg treat image : temp/1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e.jpg treat image : temp/1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486.jpg treat image : temp/1767904828_1378827_1403011487_98fdffab7ffb9cc11f5a54266afff405.jpg treat image : temp/1767904828_1378827_1403011484_63f42e8b3c3f59c89166dac9bf41f817.jpg treat image : temp/1767904828_1378827_1403011474_1012e837242b3bbcfe17e5f1524a6891.jpg treat image : temp/1767904828_1378827_1403011472_f3235929bba3922f2719422a5dff4333.jpg treat image : temp/1767904828_1378827_1403011470_6746b6ff239ba5d9576e6e89361bc271.jpg treat image : temp/1767904828_1378827_1403011469_8dfcec389f6ea7f358592d63aae11d50.jpg treat image : temp/1767904828_1378827_1403011734_67f53d109aa604dc01bb099382f19939_rle_crop_4094275127_0.png treat image : temp/1767904828_1378827_1403011734_67f53d109aa604dc01bb099382f19939_rle_crop_4094275132_0.png treat image : temp/1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275134_0.png treat image : temp/1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275135_0.png treat image : temp/1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275136_0.png treat image : temp/1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275139_0.png treat image : temp/1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275141_0.png treat image : temp/1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275142_0.png treat image : temp/1767904828_1378827_1403011656_28dcedbb6f0ea1279b23a93a7f70afb0_rle_crop_4094275143_0.png treat image : temp/1767904828_1378827_1403011656_28dcedbb6f0ea1279b23a93a7f70afb0_rle_crop_4094275144_0.png treat image : temp/1767904828_1378827_1403011656_28dcedbb6f0ea1279b23a93a7f70afb0_rle_crop_4094275145_0.png treat image : temp/1767904828_1378827_1403011610_d13956ba51bbcf4e96ec54b5f99a7b36_rle_crop_4094275149_0.png treat image : temp/1767904828_1378827_1403011610_d13956ba51bbcf4e96ec54b5f99a7b36_rle_crop_4094275150_0.png treat image : temp/1767904828_1378827_1403011610_d13956ba51bbcf4e96ec54b5f99a7b36_rle_crop_4094275151_0.png treat image : temp/1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e_rle_crop_4094275153_0.png treat image : temp/1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e_rle_crop_4094275157_0.png treat image : temp/1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e_rle_crop_4094275158_0.png treat image : temp/1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e_rle_crop_4094275159_0.png treat image : temp/1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e_rle_crop_4094275161_0.png treat image : temp/1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275162_0.png treat image : temp/1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275165_0.png treat image : temp/1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275166_0.png treat image : temp/1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275171_0.png treat image : temp/1767904828_1378827_1403011487_98fdffab7ffb9cc11f5a54266afff405_rle_crop_4094275173_0.png treat image : temp/1767904828_1378827_1403011487_98fdffab7ffb9cc11f5a54266afff405_rle_crop_4094275174_0.png treat image : temp/1767904828_1378827_1403011487_98fdffab7ffb9cc11f5a54266afff405_rle_crop_4094275175_0.png treat image : temp/1767904828_1378827_1403011487_98fdffab7ffb9cc11f5a54266afff405_rle_crop_4094275177_0.png treat image : temp/1767904828_1378827_1403011484_63f42e8b3c3f59c89166dac9bf41f817_rle_crop_4094275180_0.png treat image : temp/1767904828_1378827_1403011474_1012e837242b3bbcfe17e5f1524a6891_rle_crop_4094275189_0.png treat image : temp/1767904828_1378827_1403011474_1012e837242b3bbcfe17e5f1524a6891_rle_crop_4094275190_0.png treat image : temp/1767904828_1378827_1403011474_1012e837242b3bbcfe17e5f1524a6891_rle_crop_4094275191_0.png treat image : temp/1767904828_1378827_1403011472_f3235929bba3922f2719422a5dff4333_rle_crop_4094275199_0.png treat image : temp/1767904828_1378827_1403011470_6746b6ff239ba5d9576e6e89361bc271_rle_crop_4094275202_0.png treat image : temp/1767904828_1378827_1403011469_8dfcec389f6ea7f358592d63aae11d50_rle_crop_4094275204_0.png treat image : temp/1767904828_1378827_1403011469_8dfcec389f6ea7f358592d63aae11d50_rle_crop_4094275210_0.png treat image : temp/1767904828_1378827_1403011734_67f53d109aa604dc01bb099382f19939_rle_crop_4094275130_0.png treat image : temp/1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275133_0.png treat image : temp/1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275138_0.png treat image : temp/1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e_rle_crop_4094275156_0.png treat image : temp/1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275167_0.png treat image : temp/1767904828_1378827_1403011484_63f42e8b3c3f59c89166dac9bf41f817_rle_crop_4094275181_0.png treat image : temp/1767904828_1378827_1403011484_63f42e8b3c3f59c89166dac9bf41f817_rle_crop_4094275187_0.png treat image : temp/1767904828_1378827_1403011474_1012e837242b3bbcfe17e5f1524a6891_rle_crop_4094275188_0.png treat image : temp/1767904828_1378827_1403011472_f3235929bba3922f2719422a5dff4333_rle_crop_4094275196_0.png treat image : temp/1767904828_1378827_1403011472_f3235929bba3922f2719422a5dff4333_rle_crop_4094275198_0.png treat image : temp/1767904828_1378827_1403011469_8dfcec389f6ea7f358592d63aae11d50_rle_crop_4094275206_0.png treat image : temp/1767904828_1378827_1403011487_98fdffab7ffb9cc11f5a54266afff405_rle_crop_4094275176_0.png treat image : temp/1767904828_1378827_1403011487_98fdffab7ffb9cc11f5a54266afff405_rle_crop_4094275178_0.png treat image : temp/1767904828_1378827_1403011469_8dfcec389f6ea7f358592d63aae11d50_rle_crop_4094275207_0.png treat image : temp/1767904828_1378827_1403011469_8dfcec389f6ea7f358592d63aae11d50_rle_crop_4094275208_0.png treat image : temp/1767904828_1378827_1403011734_67f53d109aa604dc01bb099382f19939_rle_crop_4094275128_0.png treat image : temp/1767904828_1378827_1403011734_67f53d109aa604dc01bb099382f19939_rle_crop_4094275129_0.png treat image : temp/1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275137_0.png treat image : temp/1767904828_1378827_1403011705_b834df3f3be3f0b0f365bf64295a75cb_rle_crop_4094275140_0.png treat image : temp/1767904828_1378827_1403011656_28dcedbb6f0ea1279b23a93a7f70afb0_rle_crop_4094275147_0.png treat image : temp/1767904828_1378827_1403011656_28dcedbb6f0ea1279b23a93a7f70afb0_rle_crop_4094275148_0.png treat image : temp/1767904828_1378827_1403011610_d13956ba51bbcf4e96ec54b5f99a7b36_rle_crop_4094275152_0.png treat image : temp/1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e_rle_crop_4094275154_0.png treat image : temp/1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e_rle_crop_4094275155_0.png treat image : temp/1767904828_1378827_1403011551_df6c1d84f11a3d8a64c5eedc8bae7f1e_rle_crop_4094275160_0.png treat image : temp/1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275163_0.png treat image : temp/1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275164_0.png treat image : temp/1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275168_0.png treat image : temp/1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275169_0.png treat image : temp/1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275172_0.png treat image : temp/1767904828_1378827_1403011487_98fdffab7ffb9cc11f5a54266afff405_rle_crop_4094275179_0.png treat image : temp/1767904828_1378827_1403011484_63f42e8b3c3f59c89166dac9bf41f817_rle_crop_4094275182_0.png treat image : temp/1767904828_1378827_1403011484_63f42e8b3c3f59c89166dac9bf41f817_rle_crop_4094275183_0.png treat image : temp/1767904828_1378827_1403011484_63f42e8b3c3f59c89166dac9bf41f817_rle_crop_4094275184_0.png treat image : temp/1767904828_1378827_1403011484_63f42e8b3c3f59c89166dac9bf41f817_rle_crop_4094275186_0.png treat image : temp/1767904828_1378827_1403011474_1012e837242b3bbcfe17e5f1524a6891_rle_crop_4094275192_0.png treat image : temp/1767904828_1378827_1403011472_f3235929bba3922f2719422a5dff4333_rle_crop_4094275193_0.png treat image : temp/1767904828_1378827_1403011472_f3235929bba3922f2719422a5dff4333_rle_crop_4094275194_0.png treat image : temp/1767904828_1378827_1403011472_f3235929bba3922f2719422a5dff4333_rle_crop_4094275195_0.png treat image : temp/1767904828_1378827_1403011472_f3235929bba3922f2719422a5dff4333_rle_crop_4094275197_0.png treat image : temp/1767904828_1378827_1403011470_6746b6ff239ba5d9576e6e89361bc271_rle_crop_4094275200_0.png treat image : temp/1767904828_1378827_1403011470_6746b6ff239ba5d9576e6e89361bc271_rle_crop_4094275201_0.png treat image : temp/1767904828_1378827_1403011470_6746b6ff239ba5d9576e6e89361bc271_rle_crop_4094275203_0.png treat image : temp/1767904828_1378827_1403011469_8dfcec389f6ea7f358592d63aae11d50_rle_crop_4094275205_0.png treat image : temp/1767904828_1378827_1403011469_8dfcec389f6ea7f358592d63aae11d50_rle_crop_4094275209_0.png treat image : temp/1767904828_1378827_1403011656_28dcedbb6f0ea1279b23a93a7f70afb0_rle_crop_4094275146_0.png treat image : temp/1767904828_1378827_1403011493_d778ea6331fb024bf161c2f6dfc56486_rle_crop_4094275170_0.png treat image : temp/1767904828_1378827_1403011484_63f42e8b3c3f59c89166dac9bf41f817_rle_crop_4094275185_0.png treat image : temp/1767904828_1378827_1403011734_67f53d109aa604dc01bb099382f19939_rle_crop_4094275131_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 96 time used for this insertion : 0.030968666076660156 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 96 time used for this insertion : 0.033635854721069336 save missing photos in datou_result : time spend for datou_step_exec : 13.081958532333374 time spend to save output : 0.07661604881286621 total time spend for step 7 : 13.15857458114624 step8:velours_tree Thu Jan 8 21:45:43 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.12612581253051758 time spend to save output : 4.5299530029296875e-05 total time spend for step 8 : 0.12617111206054688 step9:send_mail_cod Thu Jan 8 21:45:43 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P30060714_08-01-2026_21_45_43.pdf 30060780 change filename to text .imagette300607801767905143 30060781 change filename to text .change filename to text .change filename to text .imagette300607811767905143 30060782 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette300607821767905143 30060783 imagette300607831767905145 30060784 imagette300607841767905145 30060785 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette300607851767905145 30060786 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette300607861767905146 30060787 imagette300607871767905148 30060788 imagette300607881767905148 30060790 change filename to text .change filename to text .change filename to text .change filename to text .imagette300607901767905148 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=30060714 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/30060780,30060781,30060782,30060783,30060784,30060785,30060786,30060787,30060788,30060789,30060790?tags=pet_fonce,autre,papier,background,mal_croppe,carton,pet_clair,pehd,flou,environnement,metal your option no_mail is active, we will not send the real mail to your client args[1403011734] : ((1403011734, -6.198098808385203, 492609224), (1403011734, -0.46285720117536777, 496442774), '0.04537016943158437') We are sending mail with results at report@fotonower.com args[1403011705] : ((1403011705, -7.011639988119646, 492609224), (1403011705, -0.23426686785341774, 496442774), '0.04537016943158437') We are sending mail with results at report@fotonower.com args[1403011656] : ((1403011656, -7.0981557969169975, 492609224), (1403011656, -0.26012314036647627, 496442774), '0.04537016943158437') We are sending mail with results at report@fotonower.com args[1403011610] : ((1403011610, -7.0570607754101715, 492609224), (1403011610, -0.14167351407480988, 496442774), '0.04537016943158437') We are sending mail with results at report@fotonower.com args[1403011551] : ((1403011551, -7.179043668419904, 492609224), (1403011551, -0.14114271741983844, 496442774), '0.04537016943158437') We are sending mail with results at report@fotonower.com args[1403011493] : ((1403011493, -7.028292513569549, 492609224), (1403011493, -0.23374899033437388, 496442774), '0.04537016943158437') We are sending mail with results at report@fotonower.com args[1403011487] : ((1403011487, -7.058928937193768, 492609224), (1403011487, -0.19001033128007705, 496442774), '0.04537016943158437') We are sending mail with results at report@fotonower.com args[1403011484] : ((1403011484, -6.973120669484747, 492609224), (1403011484, -0.174498481294202, 496442774), '0.04537016943158437') We are sending mail with results at report@fotonower.com args[1403011474] : ((1403011474, -7.070752774699552, 492609224), (1403011474, -0.24778680588615878, 496442774), '0.04537016943158437') We are sending mail with results at report@fotonower.com args[1403011472] : ((1403011472, -6.970182022134896, 492609224), (1403011472, -0.22468910310616616, 496442774), '0.04537016943158437') We are sending mail with results at report@fotonower.com args[1403011470] : ((1403011470, -7.012787065868315, 492609224), (1403011470, -0.28927889217866054, 496442774), '0.04537016943158437') We are sending mail with results at report@fotonower.com args[1403011469] : ((1403011469, -7.064450880373982, 492609224), (1403011469, -0.22898514230665706, 496442774), '0.04537016943158437') We are sending mail with results at report@fotonower.com refus_total : 0.04537016943158437 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=30060714 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30060714_08-01-2026_21_45_43.pdf results_Auto_P30060714_08-01-2026_21_45_43.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30060714_08-01-2026_21_45_43.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','30060714','results_Auto_P30060714_08-01-2026_21_45_43.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30060714_08-01-2026_21_45_43.pdf','pdf','','0.74','0.04537016943158437') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1403011734, 1403011705, 1403011656, 1403011610, 1403011551, 1403011493, 1403011487, 1403011484, 1403011474, 1403011472, 1403011470, 1403011469] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011734', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011705', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011656', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011610', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011551', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011493', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011487', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011484', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011474', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011472', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011470', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011469', None, None, None, None, None, '4327249') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.04009532928466797 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.65253758430481 time spend to save output : 0.04030299186706543 total time spend for step 9 : 8.692840576171875 step10:split_time_score Thu Jan 8 21:45:51 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('17', 12),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 08012026 30060714 Nombre de photos uploadées : 12 / 23040 (0%) 08012026 30060714 Nombre de photos taguées (types de déchets): 0 / 12 (0%) 08012026 30060714 Nombre de photos taguées (volume) : 0 / 12 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.245208740234375e-06 ???????????? elapsed_time : fill_and_build_computed_from_old_data 0.0007863044738769531 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 1.1267921924591064 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.029702539035622238 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30048068_08-01-2026_08_51_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30048068 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30048068 AND mptpi.`type`=3726 To do Qualite : 0.11672209016325788 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30049626_08-01-2026_08_05_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30049626 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30049626 AND mptpi.`type`=3726 To do Qualite : 0.04099056638770181 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30054134_08-01-2026_10_14_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30054134 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30054134 AND mptpi.`type`=3594 To do Qualite : 0.10084885685300166 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30058697_08-01-2026_18_13_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30058697 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30058697 AND mptpi.`type`=3726 To do Qualite : 0.016294597537456098 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30057509_08-01-2026_17_32_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30057509 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30057509 AND mptpi.`type`=3726 To do Qualite : 0.012848181879976486 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30058709_08-01-2026_19_45_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30058709 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30058709 AND mptpi.`type`=3726 To do Qualite : 0.032826731641252015 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30059605_08-01-2026_18_38_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30059605 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30059605 AND mptpi.`type`=3726 To do Qualite : 0.04419696181035841 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30059607_08-01-2026_18_38_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30059607 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30059607 AND mptpi.`type`=3726 To do Qualite : 0.04537016943158437 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30060714_08-01-2026_21_45_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30060714 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30060714 AND mptpi.`type`=3594 To do Qualite : 0.01527273708668144 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P30060718_08-01-2026_21_42_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30060718 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30060718 AND mptpi.`type`=3726 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'08012026': {'nb_upload': 12, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1403011734, 1403011705, 1403011656, 1403011610, 1403011551, 1403011493, 1403011487, 1403011484, 1403011474, 1403011472, 1403011470, 1403011469] Looping around the photos to save general results len do output : 1 /30060714Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011734', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011705', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011656', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011610', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011551', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011493', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011487', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011484', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011474', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011472', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011470', None, None, None, None, None, '4327249') ('3318', None, None, None, None, None, None, None, '4327249') ('3318', '30060714', '1403011469', None, None, None, None, None, '4327249') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 13 time used for this insertion : 0.04120492935180664 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.7046096324920654 time spend to save output : 0.04145526885986328 total time spend for step 10 : 3.7460649013519287 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 12 set_done_treatment 121.46user 157.60system 5:31.08elapsed 84%CPU (0avgtext+0avgdata 4925404maxresident)k 1753400inputs+111232outputs (5870major+12336501minor)pagefaults 0swaps