python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2857346 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Date 2026-02-28 17:50:27.750780 Current got : datou_id : 3318, datou_cur_ids : ['4354651'] with mtr_portfolio_ids : ['30574160'] and first list_photo_ids : [] new path : /proc/2857346/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 24 ; length of list_pids : 24 ; length of list_args : 24 time to download the photos : 3.971544027328491 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Sat Feb 28 17:50:31 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2026-02-28 17:50:34.412192: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2026-02-28 17:50:34.438406: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2026-02-28 17:50:34.439942: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f9a90000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2026-02-28 17:50:34.439982: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2026-02-28 17:50:34.442616: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2026-02-28 17:50:34.746653: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x2b5d07d0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2026-02-28 17:50:34.746693: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2026-02-28 17:50:34.748038: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-02-28 17:50:34.748416: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-02-28 17:50:34.755072: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-02-28 17:50:34.757146: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-02-28 17:50:34.757499: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-02-28 17:50:34.760191: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-02-28 17:50:34.761611: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-02-28 17:50:34.766714: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-02-28 17:50:34.768119: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-02-28 17:50:34.768179: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-02-28 17:50:34.768896: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-02-28 17:50:34.768910: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-02-28 17:50:34.768927: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-02-28 17:50:34.770208: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2026-02-28 17:50:35.012138: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-02-28 17:50:35.012215: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-02-28 17:50:35.012236: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-02-28 17:50:35.012254: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-02-28 17:50:35.012271: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-02-28 17:50:35.012289: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-02-28 17:50:35.012306: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-02-28 17:50:35.012324: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-02-28 17:50:35.013914: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-02-28 17:50:35.015370: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2026-02-28 17:50:35.015410: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2026-02-28 17:50:35.015432: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-02-28 17:50:35.015452: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2026-02-28 17:50:35.015472: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2026-02-28 17:50:35.015491: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2026-02-28 17:50:35.015510: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2026-02-28 17:50:35.015530: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2026-02-28 17:50:35.017099: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2026-02-28 17:50:35.017135: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2026-02-28 17:50:35.017146: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2026-02-28 17:50:35.017155: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2026-02-28 17:50:35.018805: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : [] file manque in s3 : ['mask_model.h5'] 2026-02-28 17:50:43.266397: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2026-02-28 17:50:43.449601: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 list_images length : 24 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 25.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 26.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 6 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 31.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 7 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 2 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 33.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 8 NEW PHOTO Processing 1 images image shape: (1080, 1920, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 1920.00000 nb d'objets trouves : 4 Detection mask done ! Trying to reset tf kernel 2857576 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4907 tf kernel not reseted sub process len(results) : 24 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 24 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5706 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] DEBUG bbox = [447, 1323, 558, 1443] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0002536773681640625 nb_pixel_total : 6622 time to create 1 rle with old method : 0.0075817108154296875 length of segment : 96 DEBUG bbox = [531, 1509, 1074, 1896] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.002073526382446289 nb_pixel_total : 120570 time to create 1 rle with old method : 0.13931870460510254 length of segment : 531 DEBUG bbox = [147, 1092, 264, 1197] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00016617774963378906 nb_pixel_total : 8761 time to create 1 rle with old method : 0.009772300720214844 length of segment : 113 DEBUG bbox = [483, 1131, 576, 1233] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00012040138244628906 nb_pixel_total : 5252 time to create 1 rle with old method : 0.005975961685180664 length of segment : 89 DEBUG bbox = [501, 1524, 1080, 1893] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0016045570373535156 nb_pixel_total : 106933 time to create 1 rle with old method : 0.1197047233581543 length of segment : 516 DEBUG bbox = [567, 1566, 1065, 1917] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0013027191162109375 nb_pixel_total : 104470 time to create 1 rle with old method : 0.11636567115783691 length of segment : 539 DEBUG bbox = [384, 1254, 507, 1392] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00019240379333496094 nb_pixel_total : 9536 time to create 1 rle with old method : 0.010907649993896484 length of segment : 105 DEBUG bbox = [123, 1725, 264, 1920] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0002167224884033203 nb_pixel_total : 8588 time to create 1 rle with old method : 0.00999140739440918 length of segment : 140 DEBUG bbox = [372, 1347, 537, 1437] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00017833709716796875 nb_pixel_total : 10940 time to create 1 rle with old method : 0.012306690216064453 length of segment : 160 DEBUG bbox = [387, 1032, 828, 1626] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0014171600341796875 nb_pixel_total : 60614 time to create 1 rle with old method : 0.06805062294006348 length of segment : 314 DEBUG bbox = [402, 1335, 537, 1434] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00016045570373535156 nb_pixel_total : 6581 time to create 1 rle with old method : 0.007437944412231445 length of segment : 105 DEBUG bbox = [438, 1728, 531, 1839] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00012922286987304688 nb_pixel_total : 4733 time to create 1 rle with old method : 0.005550384521484375 length of segment : 89 DEBUG bbox = [1020, 312, 1074, 420] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 8.7738037109375e-05 nb_pixel_total : 3971 time to create 1 rle with old method : 0.004895687103271484 length of segment : 56 DEBUG bbox = [432, 1326, 537, 1443] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00013446807861328125 nb_pixel_total : 6576 time to create 1 rle with old method : 0.007996797561645508 length of segment : 98 DEBUG bbox = [3, 81, 1053, 1413] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.021819114685058594 nb_pixel_total : 1185676 time to create 1 rle with new method : 0.0845329761505127 length of segment : 1429 DEBUG bbox = [0, 1359, 51, 1470] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00010776519775390625 nb_pixel_total : 3869 time to create 1 rle with old method : 0.004481077194213867 length of segment : 48 DEBUG bbox = [846, 324, 1065, 651] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0006327629089355469 nb_pixel_total : 49127 time to create 1 rle with old method : 0.05368828773498535 length of segment : 211 DEBUG bbox = [543, 1497, 1044, 1890] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0015530586242675781 nb_pixel_total : 108609 time to create 1 rle with old method : 0.12453651428222656 length of segment : 524 DEBUG bbox = [438, 1341, 537, 1437] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0001480579376220703 nb_pixel_total : 6628 time to create 1 rle with old method : 0.007636070251464844 length of segment : 95 DEBUG bbox = [432, 1341, 552, 1446] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00028967857360839844 nb_pixel_total : 6982 time to create 1 rle with old method : 0.008030891418457031 length of segment : 109 DEBUG bbox = [981, 1083, 1080, 1530] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0005671977996826172 nb_pixel_total : 26779 time to create 1 rle with old method : 0.03142046928405762 length of segment : 92 DEBUG bbox = [207, 987, 351, 1098] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00037789344787597656 nb_pixel_total : 11633 time to create 1 rle with old method : 0.01305842399597168 length of segment : 141 DEBUG bbox = [18, 1623, 96, 1719] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00018906593322753906 nb_pixel_total : 4905 time to create 1 rle with old method : 0.005642890930175781 length of segment : 72 DEBUG bbox = [531, 1539, 1080, 1896] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.002498149871826172 nb_pixel_total : 108917 time to create 1 rle with old method : 0.12049198150634766 length of segment : 529 DEBUG bbox = [141, 1209, 276, 1311] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00032520294189453125 nb_pixel_total : 7860 time to create 1 rle with old method : 0.008774042129516602 length of segment : 114 DEBUG bbox = [0, 1122, 102, 1278] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00029730796813964844 nb_pixel_total : 10721 time to create 1 rle with old method : 0.012165069580078125 length of segment : 112 DEBUG bbox = [474, 1509, 1080, 1899] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0026619434356689453 nb_pixel_total : 116655 time to create 1 rle with old method : 0.12754535675048828 length of segment : 555 DEBUG bbox = [426, 996, 570, 1131] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00045108795166015625 nb_pixel_total : 12474 time to create 1 rle with old method : 0.014353036880493164 length of segment : 130 DEBUG bbox = [441, 1317, 561, 1443] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0002205371856689453 nb_pixel_total : 7150 time to create 1 rle with old method : 0.008140325546264648 length of segment : 106 DEBUG bbox = [519, 1404, 621, 1587] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00023984909057617188 nb_pixel_total : 6620 time to create 1 rle with old method : 0.0077381134033203125 length of segment : 77 DEBUG bbox = [318, 984, 456, 1137] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0003592967987060547 nb_pixel_total : 14931 time to create 1 rle with old method : 0.0167539119720459 length of segment : 134 DEBUG bbox = [135, 1140, 360, 1260] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00024318695068359375 nb_pixel_total : 10231 time to create 1 rle with old method : 0.011652231216430664 length of segment : 193 DEBUG bbox = [282, 1653, 456, 1902] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0004987716674804688 nb_pixel_total : 27988 time to create 1 rle with old method : 0.031392812728881836 length of segment : 163 DEBUG bbox = [519, 1524, 1062, 1896] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.001567840576171875 nb_pixel_total : 115574 time to create 1 rle with old method : 0.12693476676940918 length of segment : 536 DEBUG bbox = [192, 1443, 420, 1596] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00034880638122558594 nb_pixel_total : 20504 time to create 1 rle with old method : 0.022901535034179688 length of segment : 250 DEBUG bbox = [525, 1521, 1065, 1911] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.002053499221801758 nb_pixel_total : 118907 time to create 1 rle with old method : 0.13269448280334473 length of segment : 552 DEBUG bbox = [741, 1050, 945, 1272] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0006628036499023438 nb_pixel_total : 27030 time to create 1 rle with old method : 0.030645132064819336 length of segment : 188 DEBUG bbox = [0, 0, 975, 1065] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.01670694351196289 nb_pixel_total : 754317 time to create 1 rle with new method : 0.06265473365783691 length of segment : 949 DEBUG bbox = [912, 1002, 1077, 1101] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.000396728515625 nb_pixel_total : 10644 time to create 1 rle with old method : 0.012882709503173828 length of segment : 161 DEBUG bbox = [6, 957, 159, 1032] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.00032711029052734375 nb_pixel_total : 6010 time to create 1 rle with old method : 0.007451295852661133 length of segment : 151 DEBUG bbox = [39, 1512, 150, 1692] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0003478527069091797 nb_pixel_total : 15071 time to create 1 rle with old method : 0.018625497817993164 length of segment : 107 DEBUG bbox = [555, 1533, 1068, 1911] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0021572113037109375 nb_pixel_total : 115177 time to create 1 rle with old method : 0.13427519798278809 length of segment : 524 DEBUG bbox = [0, 0, 1071, 1623] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.022764921188354492 nb_pixel_total : 1433492 time to create 1 rle with new method : 0.24166631698608398 length of segment : 1386 DEBUG bbox = [354, 1740, 528, 1905] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.0003991127014160156 nb_pixel_total : 16615 time to create 1 rle with old method : 0.01998448371887207 length of segment : 167 DEBUG bbox = [528, 1506, 1080, 1911] DEBUG masks shape = (1080, 1920) time for calcul the mask position with numpy : 0.002330780029296875 nb_pixel_total : 117373 time to create 1 rle with old method : 0.1309816837310791 length of segment : 532 time spent for convertir_results : 4.084050178527832 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 45 chid ids of type : 3594 Number RLEs to save : 13288 save missing photos in datou_result : time spend for datou_step_exec : 29.867816925048828 time spend to save output : 0.8103406429290771 total time spend for step 1 : 30.678157567977905 step2:crop_condition Sat Feb 28 17:51:02 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 24 ! batch 1 Loaded 45 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 3736932 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1772297463_2857346 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297465), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796516_35b3674c89d2d0f4ebcea119be9b6b72_rle_crop_4146308684_0.png', 0, 187, 140, 0, 1772297465,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297465), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796514_58ea2e9b13806bf6d278b9bd4526bb3e_rle_crop_4146308685_0.png', 0, 88, 160, 0, 1772297465,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297465), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796511_f4febd6c0d2b0cac8cc1444e0578ff27_rle_crop_4146308687_0.png', 0, 96, 105, 0, 1772297465,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297465), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796493_64ac639d63294f862559bb3823aefaa0_rle_crop_4146308696_0.png', 0, 98, 109, 0, 1772297465,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297465), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796465_7810cfc9566244f9e94d4a3445361a35_rle_crop_4146308708_0.png', 0, 111, 193, 0, 1772297465,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297465), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796227_070e705c0e823049196c9997859fa3a6_rle_crop_4146308716_0.png', 0, 74, 150, 0, 1772297465,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 6 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.9102163314819336 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 3736932 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1772297466_2857346 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297468), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796549_cd1e95ac70b85c2365b04bec90e13ee4_rle_crop_4146308677_0.png', 0, 100, 96, 0, 1772297468,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297468), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796546_59393ca7aa29fe20a19ceff03158b7c1_rle_crop_4146308680_0.png', 0, 95, 89, 0, 1772297468,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297468), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796516_35b3674c89d2d0f4ebcea119be9b6b72_rle_crop_4146308683_0.png', 0, 125, 105, 0, 1772297468,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297468), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796511_f4febd6c0d2b0cac8cc1444e0578ff27_rle_crop_4146308686_0.png', 0, 382, 304, 0, 1772297468,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297468), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796510_0f2074780ee65faf9e0cca587219f92a_rle_crop_4146308690_0.png', 0, 100, 98, 0, 1772297468,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297468), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796510_0f2074780ee65faf9e0cca587219f92a_rle_crop_4146308688_0.png', 0, 98, 89, 0, 1772297468,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297468), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796502_5e58bd4a999f9b7364b07ce861485b16_rle_crop_4146308695_0.png', 0, 95, 95, 0, 1772297468,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297468), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796484_0cc1aa67c55e3da8e06c321a20cbf4fd_rle_crop_4146308705_0.png', 0, 103, 106, 0, 1772297468,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297468), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796484_0cc1aa67c55e3da8e06c321a20cbf4fd_rle_crop_4146308706_0.png', 0, 162, 75, 0, 1772297468,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 9 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.179779529571533 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1772297469_2857346 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297469), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796510_0f2074780ee65faf9e0cca587219f92a_rle_crop_4146308689_0.png', 0, 108, 54, 0, 1772297469,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6278741359710693 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 29 About to insert : list_path_to_insert length 29 new photo from crops ! About to upload 29 photos upload in portfolio : 3736932 init cache_photo without model_param we have 29 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1772297488_2857346 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796549_cd1e95ac70b85c2365b04bec90e13ee4_rle_crop_4146308679_0.png', 0, 95, 113, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796549_cd1e95ac70b85c2365b04bec90e13ee4_rle_crop_4146308678_0.png', 0, 348, 526, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796546_59393ca7aa29fe20a19ceff03158b7c1_rle_crop_4146308681_0.png', 0, 341, 513, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796544_b5583b23046e0c11054389d127616492_rle_crop_4146308682_0.png', 0, 335, 495, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796510_0f2074780ee65faf9e0cca587219f92a_rle_crop_4146308691_0.png', 0, 1332, 1010, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796506_a49e99eeeaeeffde47040e5612146e6a_rle_crop_4146308692_0.png', 0, 97, 48, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796502_5e58bd4a999f9b7364b07ce861485b16_rle_crop_4146308693_0.png', 0, 308, 210, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796502_5e58bd4a999f9b7364b07ce861485b16_rle_crop_4146308694_0.png', 0, 355, 491, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796493_64ac639d63294f862559bb3823aefaa0_rle_crop_4146308698_0.png', 0, 107, 140, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796493_64ac639d63294f862559bb3823aefaa0_rle_crop_4146308697_0.png', 0, 401, 87, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796493_64ac639d63294f862559bb3823aefaa0_rle_crop_4146308699_0.png', 0, 85, 72, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796491_b9ac520d01b4d09806e3e52c113a2e39_rle_crop_4146308701_0.png', 0, 89, 113, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796491_b9ac520d01b4d09806e3e52c113a2e39_rle_crop_4146308700_0.png', 0, 336, 522, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796489_5c347a5da96ed4b63b58d54024532a22_rle_crop_4146308702_0.png', 0, 151, 96, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796486_776213efec0a2b9598c0ebb25658d6d4_rle_crop_4146308703_0.png', 0, 353, 552, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796484_0cc1aa67c55e3da8e06c321a20cbf4fd_rle_crop_4146308704_0.png', 0, 115, 123, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796470_025c0c7cc4b1a2a51ab25f29891eb94d_rle_crop_4146308707_0.png', 0, 151, 134, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796465_7810cfc9566244f9e94d4a3445361a35_rle_crop_4146308711_0.png', 0, 152, 211, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796465_7810cfc9566244f9e94d4a3445361a35_rle_crop_4146308710_0.png', 0, 349, 532, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796465_7810cfc9566244f9e94d4a3445361a35_rle_crop_4146308709_0.png', 0, 244, 158, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796459_d54624a2ecd61154cab2df6b456628c9_rle_crop_4146308712_0.png', 0, 356, 533, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796456_b8f08bbb04f9f82a63b44d3d5606aee5_rle_crop_4146308714_0.png', 0, 1032, 943, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796456_b8f08bbb04f9f82a63b44d3d5606aee5_rle_crop_4146308713_0.png', 0, 185, 186, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796227_070e705c0e823049196c9997859fa3a6_rle_crop_4146308719_0.png', 0, 1575, 1005, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796227_070e705c0e823049196c9997859fa3a6_rle_crop_4146308715_0.png', 0, 94, 155, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796227_070e705c0e823049196c9997859fa3a6_rle_crop_4146308717_0.png', 0, 176, 107, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796227_070e705c0e823049196c9997859fa3a6_rle_crop_4146308718_0.png', 0, 346, 508, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796227_070e705c0e823049196c9997859fa3a6_rle_crop_4146308720_0.png', 0, 140, 166, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1772297493), 0.0, 0.0, 14, '', 0, 0, '1772297427_2857346_1387796224_ff36dc8ec2f1e5965d1499bf4ca56681_rle_crop_4146308721_0.png', 0, 356, 526, 0, 1772297493,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 29 photos in the portfolio 3736932 time of upload the photos Elapsed time : 6.140105485916138 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1387796549, 1387796546, 1387796544, 1387796542, 1387796516, 1387796514, 1387796511, 1387796510, 1387796506, 1387796502, 1387796493, 1387796491, 1387796489, 1387796486, 1387796484, 1387796480, 1387796471, 1387796470, 1387796465, 1387796462, 1387796459, 1387796456, 1387796227, 1387796224] Looping around the photos to save general results len do output : 45 /1410268511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1410268555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796549', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796546', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796544', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796542', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796516', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796514', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796511', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796510', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796506', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796502', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796493', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796491', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796489', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796486', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796484', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796480', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796471', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796470', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796465', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796462', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796459', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796456', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796227', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796224', None, None, None, None, None, '4354651') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 159 time used for this insertion : 0.021942853927612305 save_final save missing photos in datou_result : time spend for datou_step_exec : 31.818344593048096 time spend to save output : 0.02389812469482422 total time spend for step 2 : 31.84224271774292 step3:rle_unique_nms_with_priority Sat Feb 28 17:51:34 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 45 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.5877945423126221 time for calcul the mask position with numpy : 0.2679879665374756 nb_pixel_total : 1937647 time to create 1 rle with new method : 0.0991816520690918 time for calcul the mask position with numpy : 0.007330417633056641 nb_pixel_total : 8761 time to create 1 rle with old method : 0.009729623794555664 time for calcul the mask position with numpy : 0.007042407989501953 nb_pixel_total : 120570 time to create 1 rle with old method : 0.1345357894897461 time for calcul the mask position with numpy : 0.006162405014038086 nb_pixel_total : 6622 time to create 1 rle with old method : 0.007245302200317383 create new chi : 0.5491447448730469 time to delete rle : 0.024883747100830078 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2560 TO DO : save crop sub photo not yet done ! save time : 0.196746826171875 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.3322265148162842 time for calcul the mask position with numpy : 0.269073486328125 nb_pixel_total : 1961415 time to create 1 rle with new method : 0.4083878993988037 time for calcul the mask position with numpy : 0.0070514678955078125 nb_pixel_total : 106933 time to create 1 rle with old method : 0.12168073654174805 time for calcul the mask position with numpy : 0.0061228275299072266 nb_pixel_total : 5252 time to create 1 rle with old method : 0.006091117858886719 create new chi : 0.8216698169708252 time to delete rle : 0.0003542900085449219 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2290 TO DO : save crop sub photo not yet done ! save time : 0.17417144775390625 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03809785842895508 time for calcul the mask position with numpy : 0.07393765449523926 nb_pixel_total : 1969130 time to create 1 rle with new method : 0.19006800651550293 time for calcul the mask position with numpy : 0.006237030029296875 nb_pixel_total : 104470 time to create 1 rle with old method : 0.11455726623535156 create new chi : 0.387894868850708 time to delete rle : 0.0002887248992919922 batch 1 Loaded 3 chid ids of type : 3594 ++Number RLEs to save : 2158 TO DO : save crop sub photo not yet done ! save time : 0.1697092056274414 No data in photo_id : 1387796542 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.2295536994934082 time for calcul the mask position with numpy : 0.07503414154052734 nb_pixel_total : 2055476 time to create 1 rle with new method : 0.2058863639831543 time for calcul the mask position with numpy : 0.00592041015625 nb_pixel_total : 8588 time to create 1 rle with old method : 0.009467124938964844 time for calcul the mask position with numpy : 0.006115913391113281 nb_pixel_total : 9536 time to create 1 rle with old method : 0.010607242584228516 create new chi : 0.3226475715637207 time to delete rle : 0.00028705596923828125 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1570 TO DO : save crop sub photo not yet done ! save time : 0.14194774627685547 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03138899803161621 time for calcul the mask position with numpy : 0.16962456703186035 nb_pixel_total : 2062660 time to create 1 rle with new method : 0.07966351509094238 time for calcul the mask position with numpy : 0.005778074264526367 nb_pixel_total : 10940 time to create 1 rle with old method : 0.012298345565795898 create new chi : 0.27643513679504395 time to delete rle : 0.00022912025451660156 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1400 TO DO : save crop sub photo not yet done ! save time : 0.1210780143737793 nb_obj : 2 nb_hashtags : 2 time to prepare the origin masks : 0.17295360565185547 time for calcul the mask position with numpy : 0.07154631614685059 nb_pixel_total : 2006405 time to create 1 rle with new method : 0.19487810134887695 time for calcul the mask position with numpy : 0.005866050720214844 nb_pixel_total : 6581 time to create 1 rle with old method : 0.00751042366027832 time for calcul the mask position with numpy : 0.005920886993408203 nb_pixel_total : 60614 time to create 1 rle with old method : 0.06505107879638672 create new chi : 0.3603062629699707 time to delete rle : 0.00031185150146484375 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 1918 TO DO : save crop sub photo not yet done ! save time : 0.15322446823120117 nb_obj : 4 nb_hashtags : 3 time to prepare the origin masks : 0.24242758750915527 time for calcul the mask position with numpy : 0.0351252555847168 nb_pixel_total : 877631 time to create 1 rle with new method : 0.1942291259765625 time for calcul the mask position with numpy : 0.043520450592041016 nb_pixel_total : 1180689 time to create 1 rle with new method : 0.1863870620727539 time for calcul the mask position with numpy : 0.005977153778076172 nb_pixel_total : 6576 time to create 1 rle with old method : 0.007264852523803711 time for calcul the mask position with numpy : 0.00579833984375 nb_pixel_total : 3971 time to create 1 rle with old method : 0.004456281661987305 time for calcul the mask position with numpy : 0.006150722503662109 nb_pixel_total : 4733 time to create 1 rle with old method : 0.005494117736816406 create new chi : 0.5089321136474609 time to delete rle : 0.0006778240203857422 batch 1 Loaded 9 chid ids of type : 3594 ++++++Number RLEs to save : 4342 TO DO : save crop sub photo not yet done ! save time : 0.29328250885009766 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.033036231994628906 time for calcul the mask position with numpy : 0.019087791442871094 nb_pixel_total : 2069731 time to create 1 rle with new method : 0.0568084716796875 time for calcul the mask position with numpy : 0.00581812858581543 nb_pixel_total : 3869 time to create 1 rle with old method : 0.004437446594238281 create new chi : 0.0863645076751709 time to delete rle : 0.000202178955078125 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1176 TO DO : save crop sub photo not yet done ! save time : 0.11570429801940918 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.047467947006225586 time for calcul the mask position with numpy : 0.017400503158569336 nb_pixel_total : 1909236 time to create 1 rle with new method : 0.18551158905029297 time for calcul the mask position with numpy : 0.005881786346435547 nb_pixel_total : 6628 time to create 1 rle with old method : 0.007227182388305664 time for calcul the mask position with numpy : 0.00609588623046875 nb_pixel_total : 108609 time to create 1 rle with old method : 0.12187504768371582 time for calcul the mask position with numpy : 0.006044149398803711 nb_pixel_total : 49127 time to create 1 rle with old method : 0.05526995658874512 create new chi : 0.41489696502685547 time to delete rle : 0.0002651214599609375 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 2740 TO DO : save crop sub photo not yet done ! save time : 0.20449304580688477 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.08104991912841797 time for calcul the mask position with numpy : 0.32965922355651855 nb_pixel_total : 2023301 time to create 1 rle with new method : 0.09372234344482422 time for calcul the mask position with numpy : 0.005796670913696289 nb_pixel_total : 4905 time to create 1 rle with old method : 0.005476474761962891 time for calcul the mask position with numpy : 0.0057621002197265625 nb_pixel_total : 11633 time to create 1 rle with old method : 0.013104438781738281 time for calcul the mask position with numpy : 0.005751848220825195 nb_pixel_total : 26779 time to create 1 rle with old method : 0.030185461044311523 time for calcul the mask position with numpy : 0.005753278732299805 nb_pixel_total : 6982 time to create 1 rle with old method : 0.007662057876586914 create new chi : 0.5129392147064209 time to delete rle : 0.00032019615173339844 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 1908 TO DO : save crop sub photo not yet done ! save time : 0.15460824966430664 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.04130220413208008 time for calcul the mask position with numpy : 0.018233299255371094 nb_pixel_total : 1956823 time to create 1 rle with new method : 0.16449856758117676 time for calcul the mask position with numpy : 0.005785465240478516 nb_pixel_total : 7860 time to create 1 rle with old method : 0.00867915153503418 time for calcul the mask position with numpy : 0.006279706954956055 nb_pixel_total : 108917 time to create 1 rle with old method : 0.11986088752746582 create new chi : 0.3309745788574219 time to delete rle : 0.0003619194030761719 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 2366 TO DO : save crop sub photo not yet done ! save time : 0.1834251880645752 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03162217140197754 time for calcul the mask position with numpy : 1.0775485038757324 nb_pixel_total : 2062879 time to create 1 rle with new method : 0.07994794845581055 time for calcul the mask position with numpy : 0.005936622619628906 nb_pixel_total : 10721 time to create 1 rle with old method : 0.011684417724609375 create new chi : 1.1784780025482178 time to delete rle : 0.0002562999725341797 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1304 TO DO : save crop sub photo not yet done ! save time : 0.11423516273498535 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03828930854797363 time for calcul the mask position with numpy : 0.14229893684387207 nb_pixel_total : 1956945 time to create 1 rle with new method : 0.261491060256958 time for calcul the mask position with numpy : 0.006324291229248047 nb_pixel_total : 116655 time to create 1 rle with old method : 0.1282975673675537 create new chi : 0.5477604866027832 time to delete rle : 0.0003209114074707031 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2190 TO DO : save crop sub photo not yet done ! save time : 0.17164969444274902 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.1304636001586914 time for calcul the mask position with numpy : 0.16076111793518066 nb_pixel_total : 2047363 time to create 1 rle with new method : 0.19926691055297852 time for calcul the mask position with numpy : 0.006024360656738281 nb_pixel_total : 6613 time to create 1 rle with old method : 0.007286787033081055 time for calcul the mask position with numpy : 0.005759716033935547 nb_pixel_total : 7150 time to create 1 rle with old method : 0.008004903793334961 time for calcul the mask position with numpy : 0.005721092224121094 nb_pixel_total : 12474 time to create 1 rle with old method : 0.014137029647827148 create new chi : 0.41637325286865234 time to delete rle : 0.0003273487091064453 batch 1 Loaded 7 chid ids of type : 3594 +++Number RLEs to save : 1701 TO DO : save crop sub photo not yet done ! save time : 0.13927865028381348 No data in photo_id : 1387796480 No data in photo_id : 1387796471 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03184866905212402 time for calcul the mask position with numpy : 0.018351316452026367 nb_pixel_total : 2058669 time to create 1 rle with new method : 0.08718609809875488 time for calcul the mask position with numpy : 0.005867481231689453 nb_pixel_total : 14931 time to create 1 rle with old method : 0.01685476303100586 create new chi : 0.13506674766540527 time to delete rle : 0.00023508071899414062 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 1348 TO DO : save crop sub photo not yet done ! save time : 0.11226201057434082 nb_obj : 4 nb_hashtags : 2 time to prepare the origin masks : 0.16009879112243652 time for calcul the mask position with numpy : 0.1698458194732666 nb_pixel_total : 1899303 time to create 1 rle with new method : 0.23131632804870605 time for calcul the mask position with numpy : 0.0060880184173583984 nb_pixel_total : 20504 time to create 1 rle with old method : 0.023342370986938477 time for calcul the mask position with numpy : 0.006599903106689453 nb_pixel_total : 115574 time to create 1 rle with old method : 0.13443732261657715 time for calcul the mask position with numpy : 0.010369300842285156 nb_pixel_total : 27988 time to create 1 rle with old method : 0.0319371223449707 time for calcul the mask position with numpy : 0.01028299331665039 nb_pixel_total : 10231 time to create 1 rle with old method : 0.012131690979003906 create new chi : 0.6463103294372559 time to delete rle : 0.0006744861602783203 batch 1 Loaded 9 chid ids of type : 3594 ++++Number RLEs to save : 3364 TO DO : save crop sub photo not yet done ! save time : 0.237562894821167 No data in photo_id : 1387796462 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03874492645263672 time for calcul the mask position with numpy : 0.025310277938842773 nb_pixel_total : 1954693 time to create 1 rle with new method : 0.17819547653198242 time for calcul the mask position with numpy : 0.006548404693603516 nb_pixel_total : 118907 time to create 1 rle with old method : 0.1380748748779297 create new chi : 0.35974931716918945 time to delete rle : 0.0004754066467285156 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2184 TO DO : save crop sub photo not yet done ! save time : 0.17047810554504395 nb_obj : 2 nb_hashtags : 1 time to prepare the origin masks : 0.1523127555847168 time for calcul the mask position with numpy : 0.16575217247009277 nb_pixel_total : 1292253 time to create 1 rle with new method : 0.373337984085083 time for calcul the mask position with numpy : 0.01171112060546875 nb_pixel_total : 754317 time to create 1 rle with new method : 0.1034855842590332 time for calcul the mask position with numpy : 0.006936550140380859 nb_pixel_total : 27030 time to create 1 rle with old method : 0.030421018600463867 create new chi : 0.7071545124053955 time to delete rle : 0.0005652904510498047 batch 1 Loaded 5 chid ids of type : 3594 ++Number RLEs to save : 3354 TO DO : save crop sub photo not yet done ! save time : 0.23682475090026855 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 0.3831300735473633 time for calcul the mask position with numpy : 0.009596109390258789 nb_pixel_total : 488648 time to create 1 rle with new method : 0.23100781440734863 time for calcul the mask position with numpy : 0.006097078323364258 nb_pixel_total : 16615 time to create 1 rle with old method : 0.018814563751220703 time for calcul the mask position with numpy : 0.056687355041503906 nb_pixel_total : 1421435 time to create 1 rle with new method : 0.30211567878723145 time for calcul the mask position with numpy : 0.0072062015533447266 nb_pixel_total : 115177 time to create 1 rle with old method : 0.13028669357299805 time for calcul the mask position with numpy : 0.006360530853271484 nb_pixel_total : 15071 time to create 1 rle with old method : 0.017060041427612305 time for calcul the mask position with numpy : 0.006325483322143555 nb_pixel_total : 6010 time to create 1 rle with old method : 0.006915092468261719 time for calcul the mask position with numpy : 0.006432771682739258 nb_pixel_total : 10644 time to create 1 rle with old method : 0.012489557266235352 create new chi : 0.8320913314819336 time to delete rle : 0.0008575916290283203 batch 1 Loaded 13 chid ids of type : 3594 +++++++Number RLEs to save : 6069 TO DO : save crop sub photo not yet done ! save time : 0.3887441158294678 nb_obj : 1 nb_hashtags : 1 time to prepare the origin masks : 0.03884124755859375 time for calcul the mask position with numpy : 0.019124507904052734 nb_pixel_total : 1956227 time to create 1 rle with new method : 0.02988719940185547 time for calcul the mask position with numpy : 0.006700038909912109 nb_pixel_total : 117373 time to create 1 rle with old method : 0.14332222938537598 create new chi : 0.1993870735168457 time to delete rle : 0.00032591819763183594 batch 1 Loaded 3 chid ids of type : 3594 +Number RLEs to save : 2144 TO DO : save crop sub photo not yet done ! save time : 0.17003631591796875 map_output_result : {1387796549: (0.0, 'Should be the crop_list due to order', 0), 1387796546: (0.0, 'Should be the crop_list due to order', 0), 1387796544: (0.0, 'Should be the crop_list due to order', 0), 1387796542: (0.0, 'Should be the crop_list due to order', 0.0), 1387796516: (0.0, 'Should be the crop_list due to order', 0), 1387796514: (0.0, 'Should be the crop_list due to order', 0), 1387796511: (0.0, 'Should be the crop_list due to order', 0), 1387796510: (0.0, 'Should be the crop_list due to order', 0), 1387796506: (0.0, 'Should be the crop_list due to order', 0), 1387796502: (0.0, 'Should be the crop_list due to order', 0), 1387796493: (0.0, 'Should be the crop_list due to order', 0), 1387796491: (0.0, 'Should be the crop_list due to order', 0), 1387796489: (0.0, 'Should be the crop_list due to order', 0), 1387796486: (0.0, 'Should be the crop_list due to order', 0), 1387796484: (0.0, 'Should be the crop_list due to order', 0), 1387796480: (0.0, 'Should be the crop_list due to order', 0.0), 1387796471: (0.0, 'Should be the crop_list due to order', 0.0), 1387796470: (0.0, 'Should be the crop_list due to order', 0), 1387796465: (0.0, 'Should be the crop_list due to order', 0), 1387796462: (0.0, 'Should be the crop_list due to order', 0.0), 1387796459: (0.0, 'Should be the crop_list due to order', 0), 1387796456: (0.0, 'Should be the crop_list due to order', 0), 1387796227: (0.0, 'Should be the crop_list due to order', 0), 1387796224: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1387796549, 1387796546, 1387796544, 1387796542, 1387796516, 1387796514, 1387796511, 1387796510, 1387796506, 1387796502, 1387796493, 1387796491, 1387796489, 1387796486, 1387796484, 1387796480, 1387796471, 1387796470, 1387796465, 1387796462, 1387796459, 1387796456, 1387796227, 1387796224] Looping around the photos to save general results len do output : 24 /1387796549.Didn't retrieve data . /1387796546.Didn't retrieve data . /1387796544.Didn't retrieve data . /1387796542.Didn't retrieve data . /1387796516.Didn't retrieve data . /1387796514.Didn't retrieve data . /1387796511.Didn't retrieve data . /1387796510.Didn't retrieve data . /1387796506.Didn't retrieve data . /1387796502.Didn't retrieve data . /1387796493.Didn't retrieve data . /1387796491.Didn't retrieve data . /1387796489.Didn't retrieve data . /1387796486.Didn't retrieve data . /1387796484.Didn't retrieve data . /1387796480.Didn't retrieve data . /1387796471.Didn't retrieve data . /1387796470.Didn't retrieve data . /1387796465.Didn't retrieve data . /1387796462.Didn't retrieve data . /1387796459.Didn't retrieve data . /1387796456.Didn't retrieve data . /1387796227.Didn't retrieve data . /1387796224.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796549', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796546', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796544', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796542', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796516', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796514', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796511', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796510', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796506', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796502', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796493', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796491', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796489', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796486', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796484', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796480', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796471', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796470', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796465', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796462', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796459', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796456', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796227', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796224', None, None, None, None, None, '4354651') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 72 time used for this insertion : 0.013892412185668945 save_final save missing photos in datou_result : time spend for datou_step_exec : 16.720622539520264 time spend to save output : 0.014593124389648438 total time spend for step 3 : 16.735215663909912 step4:ventilate_hashtags_in_portfolio Sat Feb 28 17:51:51 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 30574160 get user id for portfolio 30574160 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30574160 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','autre','papier','pehd','mal_croppe','carton','pet_clair','flou','environnement','background','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30574160 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','autre','papier','pehd','mal_croppe','carton','pet_clair','flou','environnement','background','pet_fonce')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30574160 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('metal','autre','papier','pehd','mal_croppe','carton','pet_clair','flou','environnement','background','pet_fonce')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/30574734,30574735,30574736,30574737,30574738,30574739,30574740,30574741,30574742,30574743,30574744?tags=metal,autre,papier,pehd,mal_croppe,carton,pet_clair,flou,environnement,background,pet_fonce Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1387796549, 1387796546, 1387796544, 1387796542, 1387796516, 1387796514, 1387796511, 1387796510, 1387796506, 1387796502, 1387796493, 1387796491, 1387796489, 1387796486, 1387796484, 1387796480, 1387796471, 1387796470, 1387796465, 1387796462, 1387796459, 1387796456, 1387796227, 1387796224] Looping around the photos to save general results len do output : 1 /30574160. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796549', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796546', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796544', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796542', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796516', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796514', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796511', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796510', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796506', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796502', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796493', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796491', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796489', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796486', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796484', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796480', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796471', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796470', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796465', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796462', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796459', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796456', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796227', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796224', None, None, None, None, None, '4354651') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 25 time used for this insertion : 0.016749143600463867 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6543703079223633 time spend to save output : 0.017121553421020508 total time spend for step 4 : 1.6714918613433838 step5:final Sat Feb 28 17:51:52 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1387796549: ('0.09897370515046297',), 1387796546: ('0.09897370515046297',), 1387796544: ('0.09897370515046297',), 1387796542: ('0.09897370515046297',), 1387796516: ('0.09897370515046297',), 1387796514: ('0.09897370515046297',), 1387796511: ('0.09897370515046297',), 1387796510: ('0.09897370515046297',), 1387796506: ('0.09897370515046297',), 1387796502: ('0.09897370515046297',), 1387796493: ('0.09897370515046297',), 1387796491: ('0.09897370515046297',), 1387796489: ('0.09897370515046297',), 1387796486: ('0.09897370515046297',), 1387796484: ('0.09897370515046297',), 1387796480: ('0.09897370515046297',), 1387796471: ('0.09897370515046297',), 1387796470: ('0.09897370515046297',), 1387796465: ('0.09897370515046297',), 1387796462: ('0.09897370515046297',), 1387796459: ('0.09897370515046297',), 1387796456: ('0.09897370515046297',), 1387796227: ('0.09897370515046297',), 1387796224: ('0.09897370515046297',)} new output for save of step final : {1387796549: ('0.09897370515046297',), 1387796546: ('0.09897370515046297',), 1387796544: ('0.09897370515046297',), 1387796542: ('0.09897370515046297',), 1387796516: ('0.09897370515046297',), 1387796514: ('0.09897370515046297',), 1387796511: ('0.09897370515046297',), 1387796510: ('0.09897370515046297',), 1387796506: ('0.09897370515046297',), 1387796502: ('0.09897370515046297',), 1387796493: ('0.09897370515046297',), 1387796491: ('0.09897370515046297',), 1387796489: ('0.09897370515046297',), 1387796486: ('0.09897370515046297',), 1387796484: ('0.09897370515046297',), 1387796480: ('0.09897370515046297',), 1387796471: ('0.09897370515046297',), 1387796470: ('0.09897370515046297',), 1387796465: ('0.09897370515046297',), 1387796462: ('0.09897370515046297',), 1387796459: ('0.09897370515046297',), 1387796456: ('0.09897370515046297',), 1387796227: ('0.09897370515046297',), 1387796224: ('0.09897370515046297',)} [1387796549, 1387796546, 1387796544, 1387796542, 1387796516, 1387796514, 1387796511, 1387796510, 1387796506, 1387796502, 1387796493, 1387796491, 1387796489, 1387796486, 1387796484, 1387796480, 1387796471, 1387796470, 1387796465, 1387796462, 1387796459, 1387796456, 1387796227, 1387796224] Looping around the photos to save general results len do output : 24 /1387796549.Didn't retrieve data . /1387796546.Didn't retrieve data . /1387796544.Didn't retrieve data . /1387796542.Didn't retrieve data . /1387796516.Didn't retrieve data . /1387796514.Didn't retrieve data . /1387796511.Didn't retrieve data . /1387796510.Didn't retrieve data . /1387796506.Didn't retrieve data . /1387796502.Didn't retrieve data . /1387796493.Didn't retrieve data . /1387796491.Didn't retrieve data . /1387796489.Didn't retrieve data . /1387796486.Didn't retrieve data . /1387796484.Didn't retrieve data . /1387796480.Didn't retrieve data . /1387796471.Didn't retrieve data . /1387796470.Didn't retrieve data . /1387796465.Didn't retrieve data . /1387796462.Didn't retrieve data . /1387796459.Didn't retrieve data . /1387796456.Didn't retrieve data . /1387796227.Didn't retrieve data . /1387796224.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796549', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796546', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796544', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796542', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796516', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796514', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796511', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796510', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796506', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796502', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796493', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796491', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796489', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796486', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796484', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796480', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796471', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796470', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796465', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796462', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796459', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796456', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796227', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796224', None, None, None, None, None, '4354651') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 72 time used for this insertion : 0.018128156661987305 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.13506555557250977 time spend to save output : 0.019109010696411133 total time spend for step 5 : 0.1541745662689209 step6:blur_detection Sat Feb 28 17:51:52 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1772297427_2857346_1387796549_cd1e95ac70b85c2365b04bec90e13ee4.jpg resize: (1080, 1920) 1387796549 -2.3798670816049534 treat image : temp/1772297427_2857346_1387796546_59393ca7aa29fe20a19ceff03158b7c1.jpg resize: (1080, 1920) 1387796546 -2.1693324775447076 treat image : temp/1772297427_2857346_1387796544_b5583b23046e0c11054389d127616492.jpg resize: (1080, 1920) 1387796544 -2.482049736645468 treat image : temp/1772297427_2857346_1387796542_a7077f419d22627bf4193d8a070771a9.jpg resize: (1080, 1920) 1387796542 -2.558005552709186 treat image : temp/1772297427_2857346_1387796516_35b3674c89d2d0f4ebcea119be9b6b72.jpg resize: (1080, 1920) 1387796516 -2.1046069512267365 treat image : temp/1772297427_2857346_1387796514_58ea2e9b13806bf6d278b9bd4526bb3e.jpg resize: (1080, 1920) 1387796514 -2.617171407688342 treat image : temp/1772297427_2857346_1387796511_f4febd6c0d2b0cac8cc1444e0578ff27.jpg resize: (1080, 1920) 1387796511 -2.5713673231510183 treat image : temp/1772297427_2857346_1387796510_0f2074780ee65faf9e0cca587219f92a.jpg resize: (1080, 1920) 1387796510 -1.6957576432886248 treat image : temp/1772297427_2857346_1387796506_a49e99eeeaeeffde47040e5612146e6a.jpg resize: (1080, 1920) 1387796506 -2.267991569974328 treat image : temp/1772297427_2857346_1387796502_5e58bd4a999f9b7364b07ce861485b16.jpg resize: (1080, 1920) 1387796502 -2.5052008793913205 treat image : temp/1772297427_2857346_1387796493_64ac639d63294f862559bb3823aefaa0.jpg resize: (1080, 1920) 1387796493 0.004126431917049148 treat image : temp/1772297427_2857346_1387796491_b9ac520d01b4d09806e3e52c113a2e39.jpg resize: (1080, 1920) 1387796491 -1.9491058105632295 treat image : temp/1772297427_2857346_1387796489_5c347a5da96ed4b63b58d54024532a22.jpg resize: (1080, 1920) 1387796489 -2.860411766862574 treat image : temp/1772297427_2857346_1387796486_776213efec0a2b9598c0ebb25658d6d4.jpg resize: (1080, 1920) 1387796486 -1.9919872449799323 treat image : temp/1772297427_2857346_1387796484_0cc1aa67c55e3da8e06c321a20cbf4fd.jpg resize: (1080, 1920) 1387796484 -2.731334135060818 treat image : temp/1772297427_2857346_1387796480_1fc1318bddf3ea8b17288727df76278c.jpg resize: (1080, 1920) 1387796480 -2.0305838367184035 treat image : temp/1772297427_2857346_1387796471_51b4a5d946dba2f3a0c98506688a84fa.jpg resize: (1080, 1920) 1387796471 -2.0232656326189398 treat image : temp/1772297427_2857346_1387796470_025c0c7cc4b1a2a51ab25f29891eb94d.jpg resize: (1080, 1920) 1387796470 -1.8097593327120864 treat image : temp/1772297427_2857346_1387796465_7810cfc9566244f9e94d4a3445361a35.jpg resize: (1080, 1920) 1387796465 -2.924789702219055 treat image : temp/1772297427_2857346_1387796462_016bb9278e1a3bdce349ad187fb4ecaa.jpg resize: (1080, 1920) 1387796462 -2.2579791188146263 treat image : temp/1772297427_2857346_1387796459_d54624a2ecd61154cab2df6b456628c9.jpg resize: (1080, 1920) 1387796459 -1.944622470784805 treat image : temp/1772297427_2857346_1387796456_b8f08bbb04f9f82a63b44d3d5606aee5.jpg resize: (1080, 1920) 1387796456 -1.5256338257494917 treat image : temp/1772297427_2857346_1387796227_070e705c0e823049196c9997859fa3a6.jpg resize: (1080, 1920) 1387796227 1.2854276631290644 treat image : temp/1772297427_2857346_1387796224_ff36dc8ec2f1e5965d1499bf4ca56681.jpg resize: (1080, 1920) 1387796224 -2.7264302046116367 treat image : temp/1772297427_2857346_1387796516_35b3674c89d2d0f4ebcea119be9b6b72_rle_crop_4146308684_0.png resize: (140, 187) 1410268511 -1.84894562528548 treat image : temp/1772297427_2857346_1387796514_58ea2e9b13806bf6d278b9bd4526bb3e_rle_crop_4146308685_0.png resize: (160, 88) 1410268512 -0.8532202868836845 treat image : temp/1772297427_2857346_1387796511_f4febd6c0d2b0cac8cc1444e0578ff27_rle_crop_4146308687_0.png resize: (105, 96) 1410268513 -1.7604969702955584 treat image : temp/1772297427_2857346_1387796493_64ac639d63294f862559bb3823aefaa0_rle_crop_4146308696_0.png resize: (109, 98) 1410268514 -1.5686651743213522 treat image : temp/1772297427_2857346_1387796465_7810cfc9566244f9e94d4a3445361a35_rle_crop_4146308708_0.png resize: (193, 111) 1410268515 -3.61943062880292 treat image : temp/1772297427_2857346_1387796227_070e705c0e823049196c9997859fa3a6_rle_crop_4146308716_0.png resize: (150, 74) 1410268516 -0.7900141365915226 treat image : temp/1772297427_2857346_1387796549_cd1e95ac70b85c2365b04bec90e13ee4_rle_crop_4146308677_0.png resize: (96, 100) 1410268517 -1.2144739386162344 treat image : temp/1772297427_2857346_1387796546_59393ca7aa29fe20a19ceff03158b7c1_rle_crop_4146308680_0.png resize: (89, 95) 1410268518 -1.4072317674256418 treat image : temp/1772297427_2857346_1387796516_35b3674c89d2d0f4ebcea119be9b6b72_rle_crop_4146308683_0.png resize: (105, 125) 1410268519 -0.974963982454569 treat image : temp/1772297427_2857346_1387796511_f4febd6c0d2b0cac8cc1444e0578ff27_rle_crop_4146308686_0.png resize: (304, 382) 1410268520 -1.6781614727436107 treat image : temp/1772297427_2857346_1387796510_0f2074780ee65faf9e0cca587219f92a_rle_crop_4146308690_0.png resize: (98, 100) 1410268521 -1.5827459637556343 treat image : temp/1772297427_2857346_1387796510_0f2074780ee65faf9e0cca587219f92a_rle_crop_4146308688_0.png resize: (89, 98) 1410268522 -2.0434913912789527 treat image : temp/1772297427_2857346_1387796502_5e58bd4a999f9b7364b07ce861485b16_rle_crop_4146308695_0.png resize: (95, 95) 1410268523 -0.7764791821863912 treat image : temp/1772297427_2857346_1387796484_0cc1aa67c55e3da8e06c321a20cbf4fd_rle_crop_4146308705_0.png resize: (106, 103) 1410268524 -1.5788934977434375 treat image : temp/1772297427_2857346_1387796484_0cc1aa67c55e3da8e06c321a20cbf4fd_rle_crop_4146308706_0.png resize: (75, 162) 1410268525 -2.1260782950174666 treat image : temp/1772297427_2857346_1387796510_0f2074780ee65faf9e0cca587219f92a_rle_crop_4146308689_0.png resize: (54, 108) 1410268526 -2.9946113770010543 treat image : temp/1772297427_2857346_1387796549_cd1e95ac70b85c2365b04bec90e13ee4_rle_crop_4146308679_0.png resize: (113, 95) 1410268527 -1.6738657827442325 treat image : temp/1772297427_2857346_1387796549_cd1e95ac70b85c2365b04bec90e13ee4_rle_crop_4146308678_0.png resize: (526, 348) 1410268528 -0.02407557997703841 treat image : temp/1772297427_2857346_1387796546_59393ca7aa29fe20a19ceff03158b7c1_rle_crop_4146308681_0.png resize: (513, 341) 1410268529 0.11875862291409105 treat image : temp/1772297427_2857346_1387796544_b5583b23046e0c11054389d127616492_rle_crop_4146308682_0.png resize: (495, 335) 1410268530 -0.13557079436704753 treat image : temp/1772297427_2857346_1387796510_0f2074780ee65faf9e0cca587219f92a_rle_crop_4146308691_0.png resize: (1010, 1332) 1410268531 -1.982064160340613 treat image : temp/1772297427_2857346_1387796506_a49e99eeeaeeffde47040e5612146e6a_rle_crop_4146308692_0.png resize: (48, 97) 1410268532 -2.7288547507467618 treat image : temp/1772297427_2857346_1387796502_5e58bd4a999f9b7364b07ce861485b16_rle_crop_4146308693_0.png resize: (210, 308) 1410268533 -3.252906758708279 treat image : temp/1772297427_2857346_1387796502_5e58bd4a999f9b7364b07ce861485b16_rle_crop_4146308694_0.png resize: (491, 355) 1410268534 0.2800617372265727 treat image : temp/1772297427_2857346_1387796493_64ac639d63294f862559bb3823aefaa0_rle_crop_4146308698_0.png resize: (140, 107) 1410268535 0.05709070221082312 treat image : temp/1772297427_2857346_1387796493_64ac639d63294f862559bb3823aefaa0_rle_crop_4146308697_0.png resize: (87, 401) 1410268536 -3.0183939388128964 treat image : temp/1772297427_2857346_1387796493_64ac639d63294f862559bb3823aefaa0_rle_crop_4146308699_0.png resize: (72, 85) 1410268537 -1.3429071976262932 treat image : temp/1772297427_2857346_1387796491_b9ac520d01b4d09806e3e52c113a2e39_rle_crop_4146308701_0.png resize: (113, 89) 1410268538 -1.8310959788238312 treat image : temp/1772297427_2857346_1387796491_b9ac520d01b4d09806e3e52c113a2e39_rle_crop_4146308700_0.png resize: (522, 336) 1410268539 0.11399590861905155 treat image : temp/1772297427_2857346_1387796489_5c347a5da96ed4b63b58d54024532a22_rle_crop_4146308702_0.png resize: (96, 151) 1410268540 -3.327575989998958 treat image : temp/1772297427_2857346_1387796486_776213efec0a2b9598c0ebb25658d6d4_rle_crop_4146308703_0.png resize: (552, 353) 1410268541 0.340180231584993 treat image : temp/1772297427_2857346_1387796484_0cc1aa67c55e3da8e06c321a20cbf4fd_rle_crop_4146308704_0.png resize: (123, 115) 1410268542 -1.4229667450338925 treat image : temp/1772297427_2857346_1387796470_025c0c7cc4b1a2a51ab25f29891eb94d_rle_crop_4146308707_0.png resize: (134, 151) 1410268543 -2.6921762471055373 treat image : temp/1772297427_2857346_1387796465_7810cfc9566244f9e94d4a3445361a35_rle_crop_4146308711_0.png resize: (211, 152) 1410268544 -2.0195709158523063 treat image : temp/1772297427_2857346_1387796465_7810cfc9566244f9e94d4a3445361a35_rle_crop_4146308710_0.png resize: (532, 349) 1410268545 -0.05821751708352508 treat image : temp/1772297427_2857346_1387796465_7810cfc9566244f9e94d4a3445361a35_rle_crop_4146308709_0.png resize: (158, 244) 1410268546 -2.563680355760036 treat image : temp/1772297427_2857346_1387796459_d54624a2ecd61154cab2df6b456628c9_rle_crop_4146308712_0.png resize: (533, 356) 1410268547 -0.030593522465368055 treat image : temp/1772297427_2857346_1387796456_b8f08bbb04f9f82a63b44d3d5606aee5_rle_crop_4146308714_0.png resize: (943, 1032) 1410268548 0.44004696681984146 treat image : temp/1772297427_2857346_1387796456_b8f08bbb04f9f82a63b44d3d5606aee5_rle_crop_4146308713_0.png resize: (186, 185) 1410268549 -2.875364078328538 treat image : temp/1772297427_2857346_1387796227_070e705c0e823049196c9997859fa3a6_rle_crop_4146308719_0.png resize: (1005, 1575) 1410268550 -0.1273292985867318 treat image : temp/1772297427_2857346_1387796227_070e705c0e823049196c9997859fa3a6_rle_crop_4146308715_0.png resize: (155, 94) 1410268551 -1.6714625123820632 treat image : temp/1772297427_2857346_1387796227_070e705c0e823049196c9997859fa3a6_rle_crop_4146308717_0.png resize: (107, 176) 1410268552 -3.4827636456247264 treat image : temp/1772297427_2857346_1387796227_070e705c0e823049196c9997859fa3a6_rle_crop_4146308718_0.png resize: (508, 346) 1410268553 0.13305328749212392 treat image : temp/1772297427_2857346_1387796227_070e705c0e823049196c9997859fa3a6_rle_crop_4146308720_0.png resize: (166, 140) 1410268554 -2.294593637192696 treat image : temp/1772297427_2857346_1387796224_ff36dc8ec2f1e5965d1499bf4ca56681_rle_crop_4146308721_0.png resize: (526, 356) 1410268555 0.1556272976637557 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 69 time used for this insertion : 0.013010740280151367 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 69 time used for this insertion : 0.017299175262451172 save missing photos in datou_result : time spend for datou_step_exec : 21.33043360710144 time spend to save output : 0.035575151443481445 total time spend for step 6 : 21.366008758544922 step7:brightness Sat Feb 28 17:52:14 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1772297427_2857346_1387796549_cd1e95ac70b85c2365b04bec90e13ee4.jpg treat image : temp/1772297427_2857346_1387796546_59393ca7aa29fe20a19ceff03158b7c1.jpg treat image : temp/1772297427_2857346_1387796544_b5583b23046e0c11054389d127616492.jpg treat image : temp/1772297427_2857346_1387796542_a7077f419d22627bf4193d8a070771a9.jpg treat image : temp/1772297427_2857346_1387796516_35b3674c89d2d0f4ebcea119be9b6b72.jpg treat image : temp/1772297427_2857346_1387796514_58ea2e9b13806bf6d278b9bd4526bb3e.jpg treat image : temp/1772297427_2857346_1387796511_f4febd6c0d2b0cac8cc1444e0578ff27.jpg treat image : temp/1772297427_2857346_1387796510_0f2074780ee65faf9e0cca587219f92a.jpg treat image : temp/1772297427_2857346_1387796506_a49e99eeeaeeffde47040e5612146e6a.jpg treat image : temp/1772297427_2857346_1387796502_5e58bd4a999f9b7364b07ce861485b16.jpg treat image : temp/1772297427_2857346_1387796493_64ac639d63294f862559bb3823aefaa0.jpg treat image : temp/1772297427_2857346_1387796491_b9ac520d01b4d09806e3e52c113a2e39.jpg treat image : temp/1772297427_2857346_1387796489_5c347a5da96ed4b63b58d54024532a22.jpg treat image : temp/1772297427_2857346_1387796486_776213efec0a2b9598c0ebb25658d6d4.jpg treat image : temp/1772297427_2857346_1387796484_0cc1aa67c55e3da8e06c321a20cbf4fd.jpg treat image : temp/1772297427_2857346_1387796480_1fc1318bddf3ea8b17288727df76278c.jpg treat image : temp/1772297427_2857346_1387796471_51b4a5d946dba2f3a0c98506688a84fa.jpg treat image : temp/1772297427_2857346_1387796470_025c0c7cc4b1a2a51ab25f29891eb94d.jpg treat image : temp/1772297427_2857346_1387796465_7810cfc9566244f9e94d4a3445361a35.jpg treat image : temp/1772297427_2857346_1387796462_016bb9278e1a3bdce349ad187fb4ecaa.jpg treat image : temp/1772297427_2857346_1387796459_d54624a2ecd61154cab2df6b456628c9.jpg treat image : temp/1772297427_2857346_1387796456_b8f08bbb04f9f82a63b44d3d5606aee5.jpg treat image : temp/1772297427_2857346_1387796227_070e705c0e823049196c9997859fa3a6.jpg treat image : temp/1772297427_2857346_1387796224_ff36dc8ec2f1e5965d1499bf4ca56681.jpg treat image : temp/1772297427_2857346_1387796516_35b3674c89d2d0f4ebcea119be9b6b72_rle_crop_4146308684_0.png treat image : temp/1772297427_2857346_1387796514_58ea2e9b13806bf6d278b9bd4526bb3e_rle_crop_4146308685_0.png treat image : temp/1772297427_2857346_1387796511_f4febd6c0d2b0cac8cc1444e0578ff27_rle_crop_4146308687_0.png treat image : temp/1772297427_2857346_1387796493_64ac639d63294f862559bb3823aefaa0_rle_crop_4146308696_0.png treat image : temp/1772297427_2857346_1387796465_7810cfc9566244f9e94d4a3445361a35_rle_crop_4146308708_0.png treat image : temp/1772297427_2857346_1387796227_070e705c0e823049196c9997859fa3a6_rle_crop_4146308716_0.png treat image : temp/1772297427_2857346_1387796549_cd1e95ac70b85c2365b04bec90e13ee4_rle_crop_4146308677_0.png treat image : temp/1772297427_2857346_1387796546_59393ca7aa29fe20a19ceff03158b7c1_rle_crop_4146308680_0.png treat image : temp/1772297427_2857346_1387796516_35b3674c89d2d0f4ebcea119be9b6b72_rle_crop_4146308683_0.png treat image : temp/1772297427_2857346_1387796511_f4febd6c0d2b0cac8cc1444e0578ff27_rle_crop_4146308686_0.png treat image : temp/1772297427_2857346_1387796510_0f2074780ee65faf9e0cca587219f92a_rle_crop_4146308690_0.png treat image : temp/1772297427_2857346_1387796510_0f2074780ee65faf9e0cca587219f92a_rle_crop_4146308688_0.png treat image : temp/1772297427_2857346_1387796502_5e58bd4a999f9b7364b07ce861485b16_rle_crop_4146308695_0.png treat image : temp/1772297427_2857346_1387796484_0cc1aa67c55e3da8e06c321a20cbf4fd_rle_crop_4146308705_0.png treat image : temp/1772297427_2857346_1387796484_0cc1aa67c55e3da8e06c321a20cbf4fd_rle_crop_4146308706_0.png treat image : temp/1772297427_2857346_1387796510_0f2074780ee65faf9e0cca587219f92a_rle_crop_4146308689_0.png treat image : temp/1772297427_2857346_1387796549_cd1e95ac70b85c2365b04bec90e13ee4_rle_crop_4146308679_0.png treat image : temp/1772297427_2857346_1387796549_cd1e95ac70b85c2365b04bec90e13ee4_rle_crop_4146308678_0.png treat image : temp/1772297427_2857346_1387796546_59393ca7aa29fe20a19ceff03158b7c1_rle_crop_4146308681_0.png treat image : temp/1772297427_2857346_1387796544_b5583b23046e0c11054389d127616492_rle_crop_4146308682_0.png treat image : temp/1772297427_2857346_1387796510_0f2074780ee65faf9e0cca587219f92a_rle_crop_4146308691_0.png treat image : temp/1772297427_2857346_1387796506_a49e99eeeaeeffde47040e5612146e6a_rle_crop_4146308692_0.png treat image : temp/1772297427_2857346_1387796502_5e58bd4a999f9b7364b07ce861485b16_rle_crop_4146308693_0.png treat image : temp/1772297427_2857346_1387796502_5e58bd4a999f9b7364b07ce861485b16_rle_crop_4146308694_0.png treat image : temp/1772297427_2857346_1387796493_64ac639d63294f862559bb3823aefaa0_rle_crop_4146308698_0.png treat image : temp/1772297427_2857346_1387796493_64ac639d63294f862559bb3823aefaa0_rle_crop_4146308697_0.png treat image : temp/1772297427_2857346_1387796493_64ac639d63294f862559bb3823aefaa0_rle_crop_4146308699_0.png treat image : temp/1772297427_2857346_1387796491_b9ac520d01b4d09806e3e52c113a2e39_rle_crop_4146308701_0.png treat image : temp/1772297427_2857346_1387796491_b9ac520d01b4d09806e3e52c113a2e39_rle_crop_4146308700_0.png treat image : temp/1772297427_2857346_1387796489_5c347a5da96ed4b63b58d54024532a22_rle_crop_4146308702_0.png treat image : temp/1772297427_2857346_1387796486_776213efec0a2b9598c0ebb25658d6d4_rle_crop_4146308703_0.png treat image : temp/1772297427_2857346_1387796484_0cc1aa67c55e3da8e06c321a20cbf4fd_rle_crop_4146308704_0.png treat image : temp/1772297427_2857346_1387796470_025c0c7cc4b1a2a51ab25f29891eb94d_rle_crop_4146308707_0.png treat image : temp/1772297427_2857346_1387796465_7810cfc9566244f9e94d4a3445361a35_rle_crop_4146308711_0.png treat image : temp/1772297427_2857346_1387796465_7810cfc9566244f9e94d4a3445361a35_rle_crop_4146308710_0.png treat image : temp/1772297427_2857346_1387796465_7810cfc9566244f9e94d4a3445361a35_rle_crop_4146308709_0.png treat image : temp/1772297427_2857346_1387796459_d54624a2ecd61154cab2df6b456628c9_rle_crop_4146308712_0.png treat image : temp/1772297427_2857346_1387796456_b8f08bbb04f9f82a63b44d3d5606aee5_rle_crop_4146308714_0.png treat image : temp/1772297427_2857346_1387796456_b8f08bbb04f9f82a63b44d3d5606aee5_rle_crop_4146308713_0.png treat image : temp/1772297427_2857346_1387796227_070e705c0e823049196c9997859fa3a6_rle_crop_4146308719_0.png treat image : temp/1772297427_2857346_1387796227_070e705c0e823049196c9997859fa3a6_rle_crop_4146308715_0.png treat image : temp/1772297427_2857346_1387796227_070e705c0e823049196c9997859fa3a6_rle_crop_4146308717_0.png treat image : temp/1772297427_2857346_1387796227_070e705c0e823049196c9997859fa3a6_rle_crop_4146308718_0.png treat image : temp/1772297427_2857346_1387796227_070e705c0e823049196c9997859fa3a6_rle_crop_4146308720_0.png treat image : temp/1772297427_2857346_1387796224_ff36dc8ec2f1e5965d1499bf4ca56681_rle_crop_4146308721_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 69 time used for this insertion : 0.014558076858520508 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 69 time used for this insertion : 0.014055252075195312 save missing photos in datou_result : time spend for datou_step_exec : 5.700992107391357 time spend to save output : 0.03298592567443848 total time spend for step 7 : 5.733978033065796 step8:velours_tree Sat Feb 28 17:52:20 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.08251285552978516 time spend to save output : 3.409385681152344e-05 total time spend for step 8 : 0.08254694938659668 step9:send_mail_cod Sat Feb 28 17:52:20 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P30574160_28-02-2026_17_52_20.pdf 30574734 change filename to text .imagette305747341772297540 30574735 imagette305747351772297540 30574736 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette305747361772297540 30574737 imagette305747371772297540 30574738 imagette305747381772297540 30574739 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette305747391772297540 30574740 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette305747401772297541 30574741 imagette305747411772297543 30574743 imagette305747431772297543 30574744 imagette305747441772297543 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=30574160 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/30574734,30574735,30574736,30574737,30574738,30574739,30574740,30574741,30574742,30574743,30574744?tags=metal,autre,papier,pehd,mal_croppe,carton,pet_clair,flou,environnement,background,pet_fonce your option no_mail is active, we will not send the real mail to your client args[1387796549] : ((1387796549, -2.3798670816049534, 492609224), (1387796549, 0.5268256862948415, 2107752395), '0.09897370515046297') We are sending mail with results at report@fotonower.com args[1387796546] : ((1387796546, -2.1693324775447076, 492609224), (1387796546, 0.4769538242086116, 2107752395), '0.09897370515046297') We are sending mail with results at report@fotonower.com args[1387796544] : ((1387796544, -2.482049736645468, 492609224), (1387796544, 0.5645489345090989, 2107752395), '0.09897370515046297') We are sending mail with results at report@fotonower.com args[1387796542] : ((1387796542, -2.558005552709186, 492609224), (1387796542, 0.5826757202322178, 2107752395), '0.09897370515046297') We are sending mail with results at report@fotonower.com args[1387796516] : ((1387796516, -2.1046069512267365, 492609224), (1387796516, 0.5477947440400116, 2107752395), '0.09897370515046297') We are sending mail with results at report@fotonower.com args[1387796514] : ((1387796514, -2.617171407688342, 492609224), (1387796514, 0.4561102974102106, 2107752395), '0.09897370515046297') We are sending mail with results at report@fotonower.com args[1387796511] : ((1387796511, -2.5713673231510183, 492609224), (1387796511, 0.3540367982489321, 2107752395), '0.09897370515046297') We are sending mail with results at report@fotonower.com args[1387796510] : ((1387796510, -1.6957576432886248, 492688767), (1387796510, 0.4413023033628622, 2107752395), '0.09897370515046297') We are sending mail with results at report@fotonower.com args[1387796506] : ((1387796506, -2.267991569974328, 492609224), (1387796506, 0.7081379510281214, 2107752395), '0.09897370515046297') We are sending mail with results at report@fotonower.com args[1387796502] : ((1387796502, -2.5052008793913205, 492609224), (1387796502, 0.7257296427973221, 2107752395), '0.09897370515046297') We are sending mail with results at report@fotonower.com args[1387796493] : ((1387796493, 0.004126431917049148, 492688767), (1387796493, 0.5252502101044751, 2107752395), '0.09897370515046297') We are sending mail with results at report@fotonower.com args[1387796491] : ((1387796491, -1.9491058105632295, 492688767), (1387796491, 0.6329644226005439, 2107752395), '0.09897370515046297') We are sending mail with results at report@fotonower.com args[1387796489] : ((1387796489, -2.860411766862574, 492609224), (1387796489, 0.5777282327624934, 2107752395), '0.09897370515046297') We are sending mail with results at report@fotonower.com args[1387796486] : ((1387796486, -1.9919872449799323, 492688767), (1387796486, 0.6777512173967201, 2107752395), '0.09897370515046297') We are sending mail with results at report@fotonower.com args[1387796484] : ((1387796484, -2.731334135060818, 492609224), (1387796484, 0.5826477194283363, 2107752395), '0.09897370515046297') We are sending mail with results at report@fotonower.com args[1387796480] : ((1387796480, -2.0305838367184035, 492609224), (1387796480, 0.5956368038427589, 2107752395), '0.09897370515046297') We are sending mail with results at report@fotonower.com args[1387796471] : ((1387796471, -2.0232656326189398, 492609224), (1387796471, 0.41310315878592563, 2107752395), '0.09897370515046297') We are sending mail with results at report@fotonower.com args[1387796470] : ((1387796470, -1.8097593327120864, 492688767), (1387796470, 0.5933494489187005, 2107752395), '0.09897370515046297') We are sending mail with results at report@fotonower.com args[1387796465] : ((1387796465, -2.924789702219055, 492609224), (1387796465, 0.5659934859010902, 2107752395), '0.09897370515046297') We are sending mail with results at report@fotonower.com args[1387796462] : ((1387796462, -2.2579791188146263, 492609224), (1387796462, 0.48983131923265627, 2107752395), '0.09897370515046297') We are sending mail with results at report@fotonower.com args[1387796459] : ((1387796459, -1.944622470784805, 492688767), (1387796459, 0.4405043607732043, 2107752395), '0.09897370515046297') We are sending mail with results at report@fotonower.com args[1387796456] : ((1387796456, -1.5256338257494917, 492688767), (1387796456, 0.7015415433692153, 2107752395), '0.09897370515046297') We are sending mail with results at report@fotonower.com args[1387796227] : ((1387796227, 1.2854276631290644, 492688767), (1387796227, 0.577073477956396, 2107752395), '0.09897370515046297') We are sending mail with results at report@fotonower.com args[1387796224] : ((1387796224, -2.7264302046116367, 492609224), (1387796224, 0.7093253439140073, 2107752395), '0.09897370515046297') We are sending mail with results at report@fotonower.com refus_total : 0.09897370515046297 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=30574160 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/media.fotonower.com/results_Auto_P30574160_28-02-2026_17_52_20.pdf results_Auto_P30574160_28-02-2026_17_52_20.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/media.fotonower.com/results_Auto_P30574160_28-02-2026_17_52_20.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','30574160','results_Auto_P30574160_28-02-2026_17_52_20.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/media.fotonower.com/results_Auto_P30574160_28-02-2026_17_52_20.pdf','pdf','','0.49','0.09897370515046297') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1387796549, 1387796546, 1387796544, 1387796542, 1387796516, 1387796514, 1387796511, 1387796510, 1387796506, 1387796502, 1387796493, 1387796491, 1387796489, 1387796486, 1387796484, 1387796480, 1387796471, 1387796470, 1387796465, 1387796462, 1387796459, 1387796456, 1387796227, 1387796224] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796549', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796546', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796544', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796542', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796516', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796514', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796511', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796510', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796506', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796502', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796493', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796491', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796489', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796486', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796484', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796480', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796471', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796470', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796465', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796462', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796459', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796456', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796227', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796224', None, None, None, None, None, '4354651') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.018071413040161133 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.148967742919922 time spend to save output : 0.018430709838867188 total time spend for step 9 : 9.167398452758789 step10:split_time_score Sat Feb 28 17:52:29 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 24),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 06102025 30574160 Nombre de photos uploadées : 24 / 23040 (0%) 06102025 30574160 Nombre de photos taguées (types de déchets): 0 / 24 (0%) 06102025 30574160 Nombre de photos taguées (volume) : 0 / 24 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ???????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0009622573852539062 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2000126838684082 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.4082602451989027 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27582559_08-10-2025_10_22_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27582559 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27582559 AND mptpi.`type`=3594 To do Qualite : 0.12353587962962964 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27582565_08-10-2025_10_12_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27582565 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27582565 AND mptpi.`type`=3594 To do Qualite : 0.16506567827748383 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27582577_08-10-2025_10_02_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27582577 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27582577 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30574149 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30574152 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30574154 order by id desc limit 1 Qualite : 0.16445389660493828 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27582586_08-10-2025_09_52_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27582586 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27582586 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30574157 order by id desc limit 1 Qualite : 0.09897370515046297 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/media.fotonower.com/results_Auto_P30574160_28-02-2026_17_52_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30574160 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30574160 AND mptpi.`type`=3594 To do Qualite : 0.11580176430436849 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/media.fotonower.com/results_Auto_P30574163_28-02-2026_17_41_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30574163 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30574163 AND mptpi.`type`=3594 To do Qualite : 0.04081674918552812 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/media.fotonower.com/results_Auto_P30574168_28-02-2026_17_31_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30574168 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30574168 AND mptpi.`type`=3594 To do Qualite : 0.1652580656828704 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/media.fotonower.com/results_Auto_P30574170_28-02-2026_17_21_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30574170 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30574170 AND mptpi.`type`=3594 To do Qualite : 0.08326033775252524 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/media.fotonower.com/results_Auto_P30574175_28-02-2026_17_11_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 30574175 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30574175 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'06102025': {'nb_upload': 24, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1387796549, 1387796546, 1387796544, 1387796542, 1387796516, 1387796514, 1387796511, 1387796510, 1387796506, 1387796502, 1387796493, 1387796491, 1387796489, 1387796486, 1387796484, 1387796480, 1387796471, 1387796470, 1387796465, 1387796462, 1387796459, 1387796456, 1387796227, 1387796224] Looping around the photos to save general results len do output : 1 /30574160Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796549', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796546', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796544', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796542', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796516', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796514', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796511', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796510', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796506', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796502', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796493', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796491', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796489', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796486', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796484', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796480', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796471', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796470', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796465', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796462', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796459', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796456', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796227', None, None, None, None, None, '4354651') ('3318', None, None, None, None, None, None, None, '4354651') ('3318', '30574160', '1387796224', None, None, None, None, None, '4354651') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 25 time used for this insertion : 0.017008543014526367 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.074830055236816 time spend to save output : 0.01729440689086914 total time spend for step 10 : 6.0921244621276855 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 24 set_done_treatment 73.70user 29.24system 2:09.65elapsed 79%CPU (0avgtext+0avgdata 2998112maxresident)k 3488inputs+40336outputs (101major+2165752minor)pagefaults 0swaps