python /home/admin/mtr/script_for_cron.py -j default -m 20 -a 'python3 ~/workarea/git/Velours/python/prod/datou.py -j batch_current -C 3986890' -s traitement_3459 -M 0 -S 0 -U 100,80,95 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/home/admin/workarea/git/apy', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 4110142 load datou : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : step 0 init_dummy_multi_datou is not linked in the step_by_step architecture ! WARNING : step 1294 init_dummy_multi_datou is not linked in the step_by_step architecture ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : (photo_id, hashtag_id, score_max) was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3459, datou_cur_ids : ['3986890'] with mtr_portfolio_ids : ['27871581'] and first list_photo_ids : [] new path : /proc/4110142/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, thcl, merge_mask_thcl_custom, rle_unique_nms_with_priority, crop_condition, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 20 list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 20 ; length of list_pids : 20 ; length of list_args : 20 time to download the photos : 3.5434796810150146 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Tue Nov 4 09:19:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10774 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-11-04 09:19:36.519170: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-11-04 09:19:36.542507: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493010000 Hz 2025-11-04 09:19:36.544449: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7efef4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-11-04 09:19:36.544505: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-11-04 09:19:36.548349: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-11-04 09:19:36.792306: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x688ec30 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-11-04 09:19:36.792348: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-11-04 09:19:36.793267: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-04 09:19:36.796980: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-04 09:19:36.800019: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-04 09:19:36.804860: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-04 09:19:36.805199: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-04 09:19:36.808690: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-04 09:19:36.810764: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-04 09:19:36.822653: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-04 09:19:36.824431: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-04 09:19:36.824505: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-04 09:19:36.825454: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-04 09:19:36.825471: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-04 09:19:36.825492: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-04 09:19:36.827265: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-11-04 09:19:37.102976: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-04 09:19:37.103089: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-04 09:19:37.103114: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-04 09:19:37.103136: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-04 09:19:37.103157: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-04 09:19:37.103178: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-04 09:19:37.103198: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-04 09:19:37.103219: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-04 09:19:37.104952: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-04 09:19:37.106659: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-11-04 09:19:37.106753: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-11-04 09:19:37.106774: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-04 09:19:37.106792: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-11-04 09:19:37.106810: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-11-04 09:19:37.106828: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-11-04 09:19:37.106846: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-11-04 09:19:37.106864: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-11-04 09:19:37.108354: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-11-04 09:19:37.108400: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-11-04 09:19:37.108409: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-11-04 09:19:37.108417: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-11-04 09:19:37.109717: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2896 thcls : [{'id': 2896, 'mtr_user_id': 31, 'name': 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'photo_desc_type': 5309, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 2896, 'mtr_user_id': 31, 'name': 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'photo_desc_type': 5309, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5309 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5309, 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 16384, 25088, 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 5, 10, 19, 20, 46), datetime.datetime(2021, 5, 10, 19, 20, 46)) {'thcl': {'id': 2896, 'mtr_user_id': 31, 'name': 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'photo_desc_type': 5309, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'carton_brun', 'carton_gris', 'cartonnette', 'kraft', 'autre_refus', 'metal', 'plastique', 'teint_dans_la_masse', 'environnement'], 'list_hashtags_csv': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'svm_hashtag_type_desc': 5309, 'photo_desc_type': 5309, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'carton_brun', 'carton_gris', 'cartonnette', 'kraft', 'autre_refus', 'metal', 'plastique', 'teint_dans_la_masse', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_convoyeur_qualipapia_nantes_poly_100521_1 NUM_CLASSES 10 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_convoyeur_qualipapia_nantes_poly_100521_1 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-11-04 09:19:45.189697: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-11-04 09:19:45.369454: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_convoyeur_qualipapia_nantes_poly_100521_1 /data/models_weight/learn_convoyeur_qualipapia_nantes_poly_100521_1/mask_model.h5 size_local : 256031040 size in s3 : 256031040 create time local : 2021-08-09 05:45:48 create time in s3 : 2021-08-06 18:59:51 mask_model.h5 already exist and didn't need to update list_images length : 20 NEW PHOTO Processing 1 images image shape: (1080, 1632, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 1632.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1632, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 1632.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1632, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 1632.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (1080, 1632, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 1632.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (1080, 1632, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 1632.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (1080, 1632, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 1632.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (1080, 1632, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 1632.00000 nb d'objets trouves : 19 NEW PHOTO Processing 1 images image shape: (1080, 1632, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 1632.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (1080, 1632, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 1632.00000 nb d'objets trouves : 5 NEW PHOTO Processing 1 images image shape: (1080, 1632, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 1632.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1632, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 1632.00000 nb d'objets trouves : 22 NEW PHOTO Processing 1 images image shape: (1080, 1632, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 1632.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (1080, 1632, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 1632.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (1080, 1632, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 1632.00000 nb d'objets trouves : 17 NEW PHOTO Processing 1 images image shape: (1080, 1632, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 1632.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (1080, 1632, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 1632.00000 nb d'objets trouves : 16 NEW PHOTO Processing 1 images image shape: (1080, 1632, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 1632.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (1080, 1632, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 1632.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1632, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.34339 image_metas shape: (1, 18) min: 0.00000 max: 1632.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (1080, 1632, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 18) min: 0.00000 max: 1632.00000 nb d'objets trouves : 14 Detection mask done ! Trying to reset tf kernel 4110379 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5485 tf kernel not reseted sub process len(results) : 20 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 20 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10774 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2896 Catched exception ! Connect or reconnect ! thcls : [{'id': 2896, 'mtr_user_id': 31, 'name': 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'photo_desc_type': 5309, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0'}] thcl {'id': 2896, 'mtr_user_id': 31, 'name': 'learn_convoyeur_qualipapia_nantes_poly_100521_1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,carton_brun,carton_gris,cartonnette,kraft,autre_refus,metal,plastique,teint_dans_la_masse,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3663, 'photo_desc_type': 5309, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5309 ['background', 'carton_brun', 'carton_gris', 'cartonnette', 'kraft', 'autre_refus', 'metal', 'plastique', 'teint_dans_la_masse', 'environnement'] time for calcul the mask position with numpy : 0.00011229515075683594 nb_pixel_total : 874 time to create 1 rle with old method : 0.0011334419250488281 length of segment : 53 time for calcul the mask position with numpy : 0.0006549358367919922 nb_pixel_total : 21034 time to create 1 rle with old method : 0.023877620697021484 length of segment : 422 time for calcul the mask position with numpy : 0.007109880447387695 nb_pixel_total : 380486 time to create 1 rle with new method : 0.01980757713317871 length of segment : 1371 time for calcul the mask position with numpy : 0.0013475418090820312 nb_pixel_total : 114009 time to create 1 rle with old method : 0.12178444862365723 length of segment : 370 time for calcul the mask position with numpy : 8.797645568847656e-05 nb_pixel_total : 3381 time to create 1 rle with old method : 0.0039064884185791016 length of segment : 88 time for calcul the mask position with numpy : 0.00014853477478027344 nb_pixel_total : 4421 time to create 1 rle with old method : 0.005468130111694336 length of segment : 148 time for calcul the mask position with numpy : 0.0003170967102050781 nb_pixel_total : 14444 time to create 1 rle with old method : 0.016804218292236328 length of segment : 234 time for calcul the mask position with numpy : 0.0006990432739257812 nb_pixel_total : 45729 time to create 1 rle with old method : 0.051674604415893555 length of segment : 530 time for calcul the mask position with numpy : 0.00022172927856445312 nb_pixel_total : 6299 time to create 1 rle with old method : 0.010551691055297852 length of segment : 236 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 874 time to create 1 rle with old method : 0.001112222671508789 length of segment : 53 time for calcul the mask position with numpy : 0.0005128383636474609 nb_pixel_total : 20258 time to create 1 rle with old method : 0.02244257926940918 length of segment : 418 time for calcul the mask position with numpy : 0.005543947219848633 nb_pixel_total : 382841 time to create 1 rle with new method : 0.014480352401733398 length of segment : 1368 time for calcul the mask position with numpy : 0.001293182373046875 nb_pixel_total : 114034 time to create 1 rle with old method : 0.12750720977783203 length of segment : 373 time for calcul the mask position with numpy : 0.00010251998901367188 nb_pixel_total : 3372 time to create 1 rle with old method : 0.003907442092895508 length of segment : 88 time for calcul the mask position with numpy : 0.00043582916259765625 nb_pixel_total : 14357 time to create 1 rle with old method : 0.016408920288085938 length of segment : 266 time for calcul the mask position with numpy : 0.00015354156494140625 nb_pixel_total : 4379 time to create 1 rle with old method : 0.00550532341003418 length of segment : 146 time for calcul the mask position with numpy : 0.0009315013885498047 nb_pixel_total : 45720 time to create 1 rle with old method : 0.05032467842102051 length of segment : 529 time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 1530 time to create 1 rle with old method : 0.0018622875213623047 length of segment : 71 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 992 time to create 1 rle with old method : 0.0013194084167480469 length of segment : 58 time for calcul the mask position with numpy : 8.749961853027344e-05 nb_pixel_total : 3818 time to create 1 rle with old method : 0.004517555236816406 length of segment : 93 time for calcul the mask position with numpy : 0.0007605552673339844 nb_pixel_total : 45819 time to create 1 rle with old method : 0.05143141746520996 length of segment : 305 time for calcul the mask position with numpy : 0.00018072128295898438 nb_pixel_total : 4719 time to create 1 rle with old method : 0.005650520324707031 length of segment : 166 time for calcul the mask position with numpy : 0.0005946159362792969 nb_pixel_total : 30301 time to create 1 rle with old method : 0.035730838775634766 length of segment : 268 time for calcul the mask position with numpy : 0.0003414154052734375 nb_pixel_total : 20039 time to create 1 rle with old method : 0.022917747497558594 length of segment : 143 time for calcul the mask position with numpy : 0.006789445877075195 nb_pixel_total : 348761 time to create 1 rle with new method : 0.01839733123779297 length of segment : 1029 time for calcul the mask position with numpy : 0.0014476776123046875 nb_pixel_total : 98037 time to create 1 rle with old method : 0.11043977737426758 length of segment : 328 time for calcul the mask position with numpy : 0.0014576911926269531 nb_pixel_total : 103185 time to create 1 rle with old method : 0.138444185256958 length of segment : 389 time for calcul the mask position with numpy : 0.000415802001953125 nb_pixel_total : 8426 time to create 1 rle with old method : 0.009933710098266602 length of segment : 127 time for calcul the mask position with numpy : 0.0003414154052734375 nb_pixel_total : 5352 time to create 1 rle with old method : 0.0062291622161865234 length of segment : 136 time for calcul the mask position with numpy : 0.0011837482452392578 nb_pixel_total : 34173 time to create 1 rle with old method : 0.03759145736694336 length of segment : 338 time for calcul the mask position with numpy : 0.0010938644409179688 nb_pixel_total : 31762 time to create 1 rle with old method : 0.03544020652770996 length of segment : 202 time for calcul the mask position with numpy : 0.0003108978271484375 nb_pixel_total : 1730 time to create 1 rle with old method : 0.0023038387298583984 length of segment : 79 time for calcul the mask position with numpy : 0.0001766681671142578 nb_pixel_total : 2228 time to create 1 rle with old method : 0.002472400665283203 length of segment : 87 time for calcul the mask position with numpy : 0.0002789497375488281 nb_pixel_total : 3986 time to create 1 rle with old method : 0.004690647125244141 length of segment : 96 time for calcul the mask position with numpy : 0.0012662410736083984 nb_pixel_total : 41849 time to create 1 rle with old method : 0.046486616134643555 length of segment : 207 time for calcul the mask position with numpy : 0.0005278587341308594 nb_pixel_total : 10732 time to create 1 rle with old method : 0.012297630310058594 length of segment : 139 time for calcul the mask position with numpy : 0.00015592575073242188 nb_pixel_total : 1868 time to create 1 rle with old method : 0.0022552013397216797 length of segment : 53 time for calcul the mask position with numpy : 0.0009486675262451172 nb_pixel_total : 23252 time to create 1 rle with old method : 0.025907278060913086 length of segment : 246 time for calcul the mask position with numpy : 0.00030422210693359375 nb_pixel_total : 3433 time to create 1 rle with old method : 0.004258632659912109 length of segment : 100 time for calcul the mask position with numpy : 0.0004985332489013672 nb_pixel_total : 16435 time to create 1 rle with old method : 0.018349647521972656 length of segment : 132 time for calcul the mask position with numpy : 0.0003666877746582031 nb_pixel_total : 24925 time to create 1 rle with old method : 0.027109384536743164 length of segment : 242 time for calcul the mask position with numpy : 0.00018072128295898438 nb_pixel_total : 2321 time to create 1 rle with old method : 0.0028166770935058594 length of segment : 75 time for calcul the mask position with numpy : 0.00015282630920410156 nb_pixel_total : 2174 time to create 1 rle with old method : 0.0027930736541748047 length of segment : 55 time for calcul the mask position with numpy : 8.916854858398438e-05 nb_pixel_total : 1031 time to create 1 rle with old method : 0.0013077259063720703 length of segment : 32 time for calcul the mask position with numpy : 0.010301589965820312 nb_pixel_total : 419121 time to create 1 rle with new method : 0.01649951934814453 length of segment : 1313 time for calcul the mask position with numpy : 0.0006775856018066406 nb_pixel_total : 30740 time to create 1 rle with old method : 0.03347921371459961 length of segment : 256 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 1493 time to create 1 rle with old method : 0.0018601417541503906 length of segment : 55 time for calcul the mask position with numpy : 0.00075531005859375 nb_pixel_total : 44073 time to create 1 rle with old method : 0.05060124397277832 length of segment : 352 time for calcul the mask position with numpy : 9.799003601074219e-05 nb_pixel_total : 878 time to create 1 rle with old method : 0.0010595321655273438 length of segment : 33 time for calcul the mask position with numpy : 0.00133514404296875 nb_pixel_total : 31304 time to create 1 rle with old method : 0.03504323959350586 length of segment : 704 time for calcul the mask position with numpy : 0.002200603485107422 nb_pixel_total : 100768 time to create 1 rle with old method : 0.10849285125732422 length of segment : 313 time for calcul the mask position with numpy : 0.0012826919555664062 nb_pixel_total : 32882 time to create 1 rle with old method : 0.03781890869140625 length of segment : 304 time for calcul the mask position with numpy : 0.0004913806915283203 nb_pixel_total : 10039 time to create 1 rle with old method : 0.011707305908203125 length of segment : 163 time for calcul the mask position with numpy : 0.0002772808074951172 nb_pixel_total : 3585 time to create 1 rle with old method : 0.004232645034790039 length of segment : 105 time for calcul the mask position with numpy : 0.0002467632293701172 nb_pixel_total : 4344 time to create 1 rle with old method : 0.004957914352416992 length of segment : 79 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 469 time to create 1 rle with old method : 0.0006644725799560547 length of segment : 45 time for calcul the mask position with numpy : 8.320808410644531e-05 nb_pixel_total : 929 time to create 1 rle with old method : 0.0011324882507324219 length of segment : 29 time for calcul the mask position with numpy : 0.0002338886260986328 nb_pixel_total : 7428 time to create 1 rle with old method : 0.00859832763671875 length of segment : 64 time for calcul the mask position with numpy : 0.0027828216552734375 nb_pixel_total : 123766 time to create 1 rle with old method : 0.1379566192626953 length of segment : 422 time for calcul the mask position with numpy : 0.00019979476928710938 nb_pixel_total : 2784 time to create 1 rle with old method : 0.0031931400299072266 length of segment : 89 time for calcul the mask position with numpy : 0.00010347366333007812 nb_pixel_total : 1740 time to create 1 rle with old method : 0.001986980438232422 length of segment : 70 time for calcul the mask position with numpy : 0.0004456043243408203 nb_pixel_total : 7740 time to create 1 rle with old method : 0.008884668350219727 length of segment : 141 time for calcul the mask position with numpy : 0.00011801719665527344 nb_pixel_total : 639 time to create 1 rle with old method : 0.0008401870727539062 length of segment : 32 time for calcul the mask position with numpy : 0.00047707557678222656 nb_pixel_total : 5517 time to create 1 rle with old method : 0.006313800811767578 length of segment : 176 time for calcul the mask position with numpy : 0.0008475780487060547 nb_pixel_total : 25489 time to create 1 rle with old method : 0.028311491012573242 length of segment : 253 time for calcul the mask position with numpy : 0.0007188320159912109 nb_pixel_total : 6450 time to create 1 rle with old method : 0.008121490478515625 length of segment : 155 time for calcul the mask position with numpy : 0.0005106925964355469 nb_pixel_total : 12602 time to create 1 rle with old method : 0.014522314071655273 length of segment : 187 time for calcul the mask position with numpy : 0.0012326240539550781 nb_pixel_total : 47455 time to create 1 rle with old method : 0.052649736404418945 length of segment : 388 time for calcul the mask position with numpy : 0.0001862049102783203 nb_pixel_total : 2492 time to create 1 rle with old method : 0.003069639205932617 length of segment : 63 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 381 time to create 1 rle with old method : 0.0005326271057128906 length of segment : 22 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 1040 time to create 1 rle with old method : 0.001348257064819336 length of segment : 48 time for calcul the mask position with numpy : 0.0004227161407470703 nb_pixel_total : 24163 time to create 1 rle with old method : 0.02823495864868164 length of segment : 247 time for calcul the mask position with numpy : 8.368492126464844e-05 nb_pixel_total : 625 time to create 1 rle with old method : 0.0007681846618652344 length of segment : 33 time for calcul the mask position with numpy : 0.0003063678741455078 nb_pixel_total : 4326 time to create 1 rle with old method : 0.005167245864868164 length of segment : 142 time for calcul the mask position with numpy : 0.00015807151794433594 nb_pixel_total : 1199 time to create 1 rle with old method : 0.0014870166778564453 length of segment : 79 time for calcul the mask position with numpy : 0.00021982192993164062 nb_pixel_total : 3257 time to create 1 rle with old method : 0.003827333450317383 length of segment : 95 time for calcul the mask position with numpy : 0.00030517578125 nb_pixel_total : 5828 time to create 1 rle with old method : 0.007025241851806641 length of segment : 120 time for calcul the mask position with numpy : 0.015350341796875 nb_pixel_total : 398377 time to create 1 rle with new method : 0.023476362228393555 length of segment : 1395 time for calcul the mask position with numpy : 0.0018765926361083984 nb_pixel_total : 91982 time to create 1 rle with old method : 0.1030278205871582 length of segment : 356 time for calcul the mask position with numpy : 0.00030517578125 nb_pixel_total : 7715 time to create 1 rle with old method : 0.009170293807983398 length of segment : 116 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 1133 time to create 1 rle with old method : 0.0013921260833740234 length of segment : 60 time for calcul the mask position with numpy : 0.0017805099487304688 nb_pixel_total : 115535 time to create 1 rle with old method : 0.12830090522766113 length of segment : 519 time for calcul the mask position with numpy : 0.00018930435180664062 nb_pixel_total : 2401 time to create 1 rle with old method : 0.002979755401611328 length of segment : 60 time for calcul the mask position with numpy : 0.00019097328186035156 nb_pixel_total : 2433 time to create 1 rle with old method : 0.0029294490814208984 length of segment : 78 time for calcul the mask position with numpy : 0.00012922286987304688 nb_pixel_total : 943 time to create 1 rle with old method : 0.0012221336364746094 length of segment : 63 time for calcul the mask position with numpy : 0.0002911090850830078 nb_pixel_total : 3250 time to create 1 rle with old method : 0.0040280818939208984 length of segment : 113 time for calcul the mask position with numpy : 0.0002791881561279297 nb_pixel_total : 4080 time to create 1 rle with old method : 0.004995584487915039 length of segment : 101 time for calcul the mask position with numpy : 0.011003494262695312 nb_pixel_total : 467843 time to create 1 rle with new method : 0.01877284049987793 length of segment : 1042 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 918 time to create 1 rle with old method : 0.0010783672332763672 length of segment : 46 time for calcul the mask position with numpy : 0.0002925395965576172 nb_pixel_total : 4497 time to create 1 rle with old method : 0.0054471492767333984 length of segment : 97 time for calcul the mask position with numpy : 0.0005512237548828125 nb_pixel_total : 26267 time to create 1 rle with old method : 0.02933526039123535 length of segment : 196 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 400 time to create 1 rle with old method : 0.0005936622619628906 length of segment : 22 time for calcul the mask position with numpy : 0.0027005672454833984 nb_pixel_total : 119059 time to create 1 rle with old method : 0.13159656524658203 length of segment : 444 time for calcul the mask position with numpy : 0.00017976760864257812 nb_pixel_total : 4483 time to create 1 rle with old method : 0.007936239242553711 length of segment : 95 time for calcul the mask position with numpy : 0.00045561790466308594 nb_pixel_total : 9136 time to create 1 rle with old method : 0.015703439712524414 length of segment : 112 time for calcul the mask position with numpy : 0.00019431114196777344 nb_pixel_total : 3311 time to create 1 rle with old method : 0.006029367446899414 length of segment : 81 time for calcul the mask position with numpy : 0.0015740394592285156 nb_pixel_total : 99937 time to create 1 rle with old method : 0.11618876457214355 length of segment : 494 time for calcul the mask position with numpy : 0.0015587806701660156 nb_pixel_total : 83867 time to create 1 rle with old method : 0.0968465805053711 length of segment : 473 time for calcul the mask position with numpy : 0.00022864341735839844 nb_pixel_total : 5808 time to create 1 rle with old method : 0.006958961486816406 length of segment : 105 time for calcul the mask position with numpy : 0.0015902519226074219 nb_pixel_total : 51544 time to create 1 rle with old method : 0.060862064361572266 length of segment : 303 time for calcul the mask position with numpy : 0.000701904296875 nb_pixel_total : 11361 time to create 1 rle with old method : 0.013603925704956055 length of segment : 147 time for calcul the mask position with numpy : 0.005749940872192383 nb_pixel_total : 107820 time to create 1 rle with old method : 0.12587738037109375 length of segment : 399 time for calcul the mask position with numpy : 0.00013184547424316406 nb_pixel_total : 820 time to create 1 rle with old method : 0.0009944438934326172 length of segment : 41 time for calcul the mask position with numpy : 0.00016236305236816406 nb_pixel_total : 2324 time to create 1 rle with old method : 0.0029671192169189453 length of segment : 49 time for calcul the mask position with numpy : 0.013775348663330078 nb_pixel_total : 386159 time to create 1 rle with new method : 0.020966529846191406 length of segment : 1302 time for calcul the mask position with numpy : 0.0007338523864746094 nb_pixel_total : 21905 time to create 1 rle with old method : 0.025136232376098633 length of segment : 120 time for calcul the mask position with numpy : 0.00045180320739746094 nb_pixel_total : 11724 time to create 1 rle with old method : 0.013803243637084961 length of segment : 106 time for calcul the mask position with numpy : 0.00010800361633300781 nb_pixel_total : 2561 time to create 1 rle with old method : 0.003014087677001953 length of segment : 79 time for calcul the mask position with numpy : 0.0009443759918212891 nb_pixel_total : 18768 time to create 1 rle with old method : 0.021946191787719727 length of segment : 258 time for calcul the mask position with numpy : 0.00038242340087890625 nb_pixel_total : 12616 time to create 1 rle with old method : 0.014042854309082031 length of segment : 152 time for calcul the mask position with numpy : 0.001672506332397461 nb_pixel_total : 92233 time to create 1 rle with old method : 0.11562371253967285 length of segment : 542 time for calcul the mask position with numpy : 0.0002269744873046875 nb_pixel_total : 7145 time to create 1 rle with old method : 0.009429216384887695 length of segment : 123 time for calcul the mask position with numpy : 0.0009629726409912109 nb_pixel_total : 33677 time to create 1 rle with old method : 0.037287235260009766 length of segment : 293 time for calcul the mask position with numpy : 0.01960921287536621 nb_pixel_total : 1028847 time to create 1 rle with new method : 0.06432104110717773 length of segment : 1696 time for calcul the mask position with numpy : 0.002234220504760742 nb_pixel_total : 121243 time to create 1 rle with old method : 0.13493752479553223 length of segment : 340 time for calcul the mask position with numpy : 0.0015642642974853516 nb_pixel_total : 93287 time to create 1 rle with old method : 0.1039896011352539 length of segment : 378 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 235 time to create 1 rle with old method : 0.00037932395935058594 length of segment : 22 time for calcul the mask position with numpy : 0.012683868408203125 nb_pixel_total : 634449 time to create 1 rle with new method : 0.02763509750366211 length of segment : 1759 time for calcul the mask position with numpy : 0.00018548965454101562 nb_pixel_total : 7789 time to create 1 rle with old method : 0.009122610092163086 length of segment : 127 time for calcul the mask position with numpy : 0.0012054443359375 nb_pixel_total : 89009 time to create 1 rle with old method : 0.09799623489379883 length of segment : 348 time for calcul the mask position with numpy : 0.003008604049682617 nb_pixel_total : 196884 time to create 1 rle with new method : 0.008853673934936523 length of segment : 781 time for calcul the mask position with numpy : 0.0010540485382080078 nb_pixel_total : 62527 time to create 1 rle with old method : 0.07082200050354004 length of segment : 331 time for calcul the mask position with numpy : 0.0002720355987548828 nb_pixel_total : 4608 time to create 1 rle with old method : 0.0053060054779052734 length of segment : 213 time for calcul the mask position with numpy : 9.512901306152344e-05 nb_pixel_total : 4325 time to create 1 rle with old method : 0.005275726318359375 length of segment : 79 time for calcul the mask position with numpy : 0.00010180473327636719 nb_pixel_total : 571 time to create 1 rle with old method : 0.0007848739624023438 length of segment : 43 time for calcul the mask position with numpy : 0.00023698806762695312 nb_pixel_total : 4318 time to create 1 rle with old method : 0.005339384078979492 length of segment : 90 time for calcul the mask position with numpy : 0.0007488727569580078 nb_pixel_total : 5808 time to create 1 rle with old method : 0.007080554962158203 length of segment : 207 time for calcul the mask position with numpy : 0.0018846988677978516 nb_pixel_total : 29794 time to create 1 rle with old method : 0.03384590148925781 length of segment : 524 time for calcul the mask position with numpy : 0.0004990100860595703 nb_pixel_total : 9778 time to create 1 rle with old method : 0.011633157730102539 length of segment : 178 time for calcul the mask position with numpy : 0.0004982948303222656 nb_pixel_total : 5582 time to create 1 rle with old method : 0.006601572036743164 length of segment : 221 time for calcul the mask position with numpy : 9.274482727050781e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.0003654956817626953 length of segment : 20 time for calcul the mask position with numpy : 0.001753091812133789 nb_pixel_total : 87063 time to create 1 rle with old method : 0.11021637916564941 length of segment : 334 time for calcul the mask position with numpy : 0.0009982585906982422 nb_pixel_total : 17000 time to create 1 rle with old method : 0.019815921783447266 length of segment : 248 time for calcul the mask position with numpy : 0.011400938034057617 nb_pixel_total : 429536 time to create 1 rle with new method : 0.019243955612182617 length of segment : 934 time for calcul the mask position with numpy : 0.0002949237823486328 nb_pixel_total : 9005 time to create 1 rle with old method : 0.0107421875 length of segment : 92 time for calcul the mask position with numpy : 0.0006973743438720703 nb_pixel_total : 32799 time to create 1 rle with old method : 0.03832554817199707 length of segment : 151 time for calcul the mask position with numpy : 0.0005564689636230469 nb_pixel_total : 32803 time to create 1 rle with old method : 0.037578582763671875 length of segment : 152 time for calcul the mask position with numpy : 8.273124694824219e-05 nb_pixel_total : 412 time to create 1 rle with old method : 0.000560760498046875 length of segment : 37 time for calcul the mask position with numpy : 8.916854858398438e-05 nb_pixel_total : 1651 time to create 1 rle with old method : 0.002022981643676758 length of segment : 67 time for calcul the mask position with numpy : 0.00023102760314941406 nb_pixel_total : 10088 time to create 1 rle with old method : 0.012067079544067383 length of segment : 117 time for calcul the mask position with numpy : 0.00010991096496582031 nb_pixel_total : 2384 time to create 1 rle with old method : 0.002941608428955078 length of segment : 41 time for calcul the mask position with numpy : 0.00028824806213378906 nb_pixel_total : 17031 time to create 1 rle with old method : 0.0190432071685791 length of segment : 216 time for calcul the mask position with numpy : 0.0001544952392578125 nb_pixel_total : 3062 time to create 1 rle with old method : 0.003797769546508789 length of segment : 102 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 258 time to create 1 rle with old method : 0.0003457069396972656 length of segment : 16 time for calcul the mask position with numpy : 0.0004208087921142578 nb_pixel_total : 8441 time to create 1 rle with old method : 0.009760618209838867 length of segment : 145 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.0002913475036621094 length of segment : 22 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 369 time to create 1 rle with old method : 0.00048160552978515625 length of segment : 27 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 775 time to create 1 rle with old method : 0.0009827613830566406 length of segment : 42 time for calcul the mask position with numpy : 0.003546476364135742 nb_pixel_total : 164170 time to create 1 rle with new method : 0.005548954010009766 length of segment : 849 time for calcul the mask position with numpy : 0.00833749771118164 nb_pixel_total : 359148 time to create 1 rle with new method : 0.014602899551391602 length of segment : 1089 time for calcul the mask position with numpy : 0.00040078163146972656 nb_pixel_total : 5774 time to create 1 rle with old method : 0.00737309455871582 length of segment : 217 time for calcul the mask position with numpy : 0.0007586479187011719 nb_pixel_total : 25670 time to create 1 rle with old method : 0.03008413314819336 length of segment : 245 time for calcul the mask position with numpy : 0.0002353191375732422 nb_pixel_total : 7584 time to create 1 rle with old method : 0.009584188461303711 length of segment : 244 time for calcul the mask position with numpy : 0.00030541419982910156 nb_pixel_total : 8851 time to create 1 rle with old method : 0.010772705078125 length of segment : 159 time for calcul the mask position with numpy : 0.0009088516235351562 nb_pixel_total : 56320 time to create 1 rle with old method : 0.07439923286437988 length of segment : 343 time for calcul the mask position with numpy : 0.0022263526916503906 nb_pixel_total : 171745 time to create 1 rle with new method : 0.0054931640625 length of segment : 566 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 216 time to create 1 rle with old method : 0.00035262107849121094 length of segment : 20 time for calcul the mask position with numpy : 0.0008366107940673828 nb_pixel_total : 22051 time to create 1 rle with old method : 0.029237985610961914 length of segment : 191 time for calcul the mask position with numpy : 0.0001804828643798828 nb_pixel_total : 3355 time to create 1 rle with old method : 0.0037653446197509766 length of segment : 78 time for calcul the mask position with numpy : 0.0010726451873779297 nb_pixel_total : 18406 time to create 1 rle with old method : 0.0197756290435791 length of segment : 262 time for calcul the mask position with numpy : 0.0003917217254638672 nb_pixel_total : 9202 time to create 1 rle with old method : 0.01056528091430664 length of segment : 91 time for calcul the mask position with numpy : 0.008226394653320312 nb_pixel_total : 295744 time to create 1 rle with new method : 0.013297557830810547 length of segment : 887 time for calcul the mask position with numpy : 0.0011110305786132812 nb_pixel_total : 59331 time to create 1 rle with old method : 0.06440210342407227 length of segment : 379 time for calcul the mask position with numpy : 9.5367431640625e-05 nb_pixel_total : 1015 time to create 1 rle with old method : 0.0011887550354003906 length of segment : 45 time for calcul the mask position with numpy : 8.463859558105469e-05 nb_pixel_total : 2500 time to create 1 rle with old method : 0.002889871597290039 length of segment : 85 time for calcul the mask position with numpy : 0.0003712177276611328 nb_pixel_total : 22258 time to create 1 rle with old method : 0.024291038513183594 length of segment : 189 time for calcul the mask position with numpy : 0.0001544952392578125 nb_pixel_total : 2631 time to create 1 rle with old method : 0.0030727386474609375 length of segment : 119 time for calcul the mask position with numpy : 0.00012350082397460938 nb_pixel_total : 4792 time to create 1 rle with old method : 0.0054340362548828125 length of segment : 80 time for calcul the mask position with numpy : 0.0013718605041503906 nb_pixel_total : 51658 time to create 1 rle with old method : 0.054784297943115234 length of segment : 464 time for calcul the mask position with numpy : 0.00037026405334472656 nb_pixel_total : 18194 time to create 1 rle with old method : 0.02036309242248535 length of segment : 200 time for calcul the mask position with numpy : 0.0014309883117675781 nb_pixel_total : 110330 time to create 1 rle with old method : 0.11801767349243164 length of segment : 368 time for calcul the mask position with numpy : 0.00031495094299316406 nb_pixel_total : 4392 time to create 1 rle with old method : 0.005105495452880859 length of segment : 125 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 552 time to create 1 rle with old method : 0.0007581710815429688 length of segment : 37 time for calcul the mask position with numpy : 0.0001704692840576172 nb_pixel_total : 7080 time to create 1 rle with old method : 0.008166790008544922 length of segment : 118 time for calcul the mask position with numpy : 0.0012056827545166016 nb_pixel_total : 77847 time to create 1 rle with old method : 0.08617520332336426 length of segment : 368 time for calcul the mask position with numpy : 0.0001575946807861328 nb_pixel_total : 779 time to create 1 rle with old method : 0.0009734630584716797 length of segment : 78 time for calcul the mask position with numpy : 0.00022554397583007812 nb_pixel_total : 4967 time to create 1 rle with old method : 0.0056002140045166016 length of segment : 120 time for calcul the mask position with numpy : 8.273124694824219e-05 nb_pixel_total : 480 time to create 1 rle with old method : 0.0006368160247802734 length of segment : 29 time for calcul the mask position with numpy : 0.0006780624389648438 nb_pixel_total : 5855 time to create 1 rle with old method : 0.006709098815917969 length of segment : 198 time for calcul the mask position with numpy : 0.00010967254638671875 nb_pixel_total : 3794 time to create 1 rle with old method : 0.004362344741821289 length of segment : 89 time for calcul the mask position with numpy : 0.0014235973358154297 nb_pixel_total : 101077 time to create 1 rle with old method : 0.10939574241638184 length of segment : 401 time for calcul the mask position with numpy : 0.0018460750579833984 nb_pixel_total : 104698 time to create 1 rle with old method : 0.11436247825622559 length of segment : 504 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 884 time to create 1 rle with old method : 0.0012388229370117188 length of segment : 52 time for calcul the mask position with numpy : 0.0004913806915283203 nb_pixel_total : 22444 time to create 1 rle with old method : 0.024152517318725586 length of segment : 332 time for calcul the mask position with numpy : 0.007740497589111328 nb_pixel_total : 301455 time to create 1 rle with new method : 0.012637615203857422 length of segment : 1275 time for calcul the mask position with numpy : 0.0006213188171386719 nb_pixel_total : 22941 time to create 1 rle with old method : 0.026256084442138672 length of segment : 224 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 209 time to create 1 rle with old method : 0.0002841949462890625 length of segment : 27 time for calcul the mask position with numpy : 0.0004029273986816406 nb_pixel_total : 22339 time to create 1 rle with old method : 0.025647640228271484 length of segment : 181 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 1057 time to create 1 rle with old method : 0.0012524127960205078 length of segment : 50 time for calcul the mask position with numpy : 0.0006849765777587891 nb_pixel_total : 42311 time to create 1 rle with old method : 0.049358367919921875 length of segment : 397 time for calcul the mask position with numpy : 0.000148773193359375 nb_pixel_total : 1285 time to create 1 rle with old method : 0.0019643306732177734 length of segment : 41 time for calcul the mask position with numpy : 0.0006005764007568359 nb_pixel_total : 14888 time to create 1 rle with old method : 0.019194841384887695 length of segment : 124 time for calcul the mask position with numpy : 0.0006890296936035156 nb_pixel_total : 14242 time to create 1 rle with old method : 0.018001794815063477 length of segment : 183 time for calcul the mask position with numpy : 0.00011229515075683594 nb_pixel_total : 1070 time to create 1 rle with old method : 0.0012726783752441406 length of segment : 47 time for calcul the mask position with numpy : 0.0010991096496582031 nb_pixel_total : 31798 time to create 1 rle with old method : 0.03535318374633789 length of segment : 351 time for calcul the mask position with numpy : 0.0009191036224365234 nb_pixel_total : 35911 time to create 1 rle with old method : 0.04262900352478027 length of segment : 484 time for calcul the mask position with numpy : 0.012001752853393555 nb_pixel_total : 237576 time to create 1 rle with new method : 0.021557331085205078 length of segment : 1811 time for calcul the mask position with numpy : 0.0001494884490966797 nb_pixel_total : 704 time to create 1 rle with old method : 0.0009634494781494141 length of segment : 42 time for calcul the mask position with numpy : 0.0013980865478515625 nb_pixel_total : 56901 time to create 1 rle with old method : 0.06564736366271973 length of segment : 249 time for calcul the mask position with numpy : 0.0005750656127929688 nb_pixel_total : 8010 time to create 1 rle with old method : 0.009338617324829102 length of segment : 173 time for calcul the mask position with numpy : 8.440017700195312e-05 nb_pixel_total : 2460 time to create 1 rle with old method : 0.0030393600463867188 length of segment : 76 time for calcul the mask position with numpy : 0.00015997886657714844 nb_pixel_total : 6940 time to create 1 rle with old method : 0.00795888900756836 length of segment : 176 time for calcul the mask position with numpy : 8.869171142578125e-05 nb_pixel_total : 2397 time to create 1 rle with old method : 0.0029439926147460938 length of segment : 98 time for calcul the mask position with numpy : 0.001028299331665039 nb_pixel_total : 41352 time to create 1 rle with old method : 0.04718780517578125 length of segment : 347 time for calcul the mask position with numpy : 0.0016949176788330078 nb_pixel_total : 105954 time to create 1 rle with old method : 0.11932635307312012 length of segment : 364 time for calcul the mask position with numpy : 0.00023698806762695312 nb_pixel_total : 7127 time to create 1 rle with old method : 0.008563995361328125 length of segment : 155 time for calcul the mask position with numpy : 0.0005388259887695312 nb_pixel_total : 24322 time to create 1 rle with old method : 0.028307199478149414 length of segment : 252 time for calcul the mask position with numpy : 0.00012373924255371094 nb_pixel_total : 2563 time to create 1 rle with old method : 0.003138303756713867 length of segment : 83 time for calcul the mask position with numpy : 0.0004916191101074219 nb_pixel_total : 24627 time to create 1 rle with old method : 0.028631925582885742 length of segment : 285 time for calcul the mask position with numpy : 0.0008876323699951172 nb_pixel_total : 55188 time to create 1 rle with old method : 0.06210780143737793 length of segment : 366 time for calcul the mask position with numpy : 0.0004477500915527344 nb_pixel_total : 7846 time to create 1 rle with old method : 0.011035680770874023 length of segment : 161 time for calcul the mask position with numpy : 0.00018668174743652344 nb_pixel_total : 2540 time to create 1 rle with old method : 0.0037331581115722656 length of segment : 68 time for calcul the mask position with numpy : 0.00040531158447265625 nb_pixel_total : 8819 time to create 1 rle with old method : 0.012188434600830078 length of segment : 133 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 253 time to create 1 rle with old method : 0.00044226646423339844 length of segment : 22 time for calcul the mask position with numpy : 0.0005445480346679688 nb_pixel_total : 15925 time to create 1 rle with old method : 0.02207207679748535 length of segment : 151 time for calcul the mask position with numpy : 0.00020432472229003906 nb_pixel_total : 2630 time to create 1 rle with old method : 0.003935813903808594 length of segment : 66 time for calcul the mask position with numpy : 0.00020575523376464844 nb_pixel_total : 2385 time to create 1 rle with old method : 0.003467559814453125 length of segment : 77 time for calcul the mask position with numpy : 0.001990795135498047 nb_pixel_total : 100603 time to create 1 rle with old method : 0.11860060691833496 length of segment : 471 time for calcul the mask position with numpy : 0.00015425682067871094 nb_pixel_total : 2578 time to create 1 rle with old method : 0.0032689571380615234 length of segment : 53 time for calcul the mask position with numpy : 0.002490997314453125 nb_pixel_total : 126619 time to create 1 rle with old method : 0.14457321166992188 length of segment : 463 time for calcul the mask position with numpy : 0.0010304450988769531 nb_pixel_total : 36686 time to create 1 rle with old method : 0.0423891544342041 length of segment : 242 time for calcul the mask position with numpy : 0.011418342590332031 nb_pixel_total : 402586 time to create 1 rle with new method : 0.020178556442260742 length of segment : 1248 time for calcul the mask position with numpy : 0.0003254413604736328 nb_pixel_total : 10277 time to create 1 rle with old method : 0.013413190841674805 length of segment : 142 time for calcul the mask position with numpy : 0.0007579326629638672 nb_pixel_total : 25499 time to create 1 rle with old method : 0.030381202697753906 length of segment : 151 time for calcul the mask position with numpy : 0.00040078163146972656 nb_pixel_total : 25362 time to create 1 rle with old method : 0.029612064361572266 length of segment : 144 time for calcul the mask position with numpy : 0.0002944469451904297 nb_pixel_total : 4017 time to create 1 rle with old method : 0.004949808120727539 length of segment : 95 time for calcul the mask position with numpy : 0.00021457672119140625 nb_pixel_total : 2645 time to create 1 rle with old method : 0.003186464309692383 length of segment : 89 time for calcul the mask position with numpy : 0.0008959770202636719 nb_pixel_total : 20476 time to create 1 rle with old method : 0.025800704956054688 length of segment : 177 time for calcul the mask position with numpy : 0.0010752677917480469 nb_pixel_total : 21546 time to create 1 rle with old method : 0.025033950805664062 length of segment : 193 time for calcul the mask position with numpy : 0.0004665851593017578 nb_pixel_total : 5378 time to create 1 rle with old method : 0.0066280364990234375 length of segment : 176 time for calcul the mask position with numpy : 0.0006291866302490234 nb_pixel_total : 17127 time to create 1 rle with old method : 0.020319461822509766 length of segment : 138 time for calcul the mask position with numpy : 0.0010578632354736328 nb_pixel_total : 28607 time to create 1 rle with old method : 0.035236358642578125 length of segment : 155 time for calcul the mask position with numpy : 0.0004496574401855469 nb_pixel_total : 6836 time to create 1 rle with old method : 0.008006811141967773 length of segment : 119 time for calcul the mask position with numpy : 0.00047135353088378906 nb_pixel_total : 13263 time to create 1 rle with old method : 0.01582956314086914 length of segment : 89 time for calcul the mask position with numpy : 0.002499818801879883 nb_pixel_total : 90214 time to create 1 rle with old method : 0.10337042808532715 length of segment : 322 time for calcul the mask position with numpy : 0.012357234954833984 nb_pixel_total : 300385 time to create 1 rle with new method : 0.022478818893432617 length of segment : 1545 time for calcul the mask position with numpy : 0.0004172325134277344 nb_pixel_total : 5250 time to create 1 rle with old method : 0.005980253219604492 length of segment : 101 time for calcul the mask position with numpy : 0.00011491775512695312 nb_pixel_total : 901 time to create 1 rle with old method : 0.0012161731719970703 length of segment : 70 time for calcul the mask position with numpy : 0.002132415771484375 nb_pixel_total : 72742 time to create 1 rle with old method : 0.08206486701965332 length of segment : 403 time for calcul the mask position with numpy : 0.0004107952117919922 nb_pixel_total : 15514 time to create 1 rle with old method : 0.018041610717773438 length of segment : 105 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 567 time to create 1 rle with old method : 0.0007944107055664062 length of segment : 37 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 376 time to create 1 rle with old method : 0.000530242919921875 length of segment : 29 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 695 time to create 1 rle with old method : 0.0009181499481201172 length of segment : 28 time for calcul the mask position with numpy : 9.632110595703125e-05 nb_pixel_total : 665 time to create 1 rle with old method : 0.0008945465087890625 length of segment : 32 time for calcul the mask position with numpy : 0.0003783702850341797 nb_pixel_total : 7782 time to create 1 rle with old method : 0.00900125503540039 length of segment : 212 time for calcul the mask position with numpy : 0.00011515617370605469 nb_pixel_total : 763 time to create 1 rle with old method : 0.0010251998901367188 length of segment : 34 time for calcul the mask position with numpy : 0.00045418739318847656 nb_pixel_total : 18938 time to create 1 rle with old method : 0.022773027420043945 length of segment : 200 time for calcul the mask position with numpy : 0.002626657485961914 nb_pixel_total : 95527 time to create 1 rle with old method : 0.10785722732543945 length of segment : 621 time for calcul the mask position with numpy : 7.367134094238281e-05 nb_pixel_total : 1287 time to create 1 rle with old method : 0.0016360282897949219 length of segment : 52 time for calcul the mask position with numpy : 0.00026297569274902344 nb_pixel_total : 5569 time to create 1 rle with old method : 0.006829023361206055 length of segment : 131 time for calcul the mask position with numpy : 0.00019598007202148438 nb_pixel_total : 4088 time to create 1 rle with old method : 0.004914045333862305 length of segment : 77 time for calcul the mask position with numpy : 0.00036144256591796875 nb_pixel_total : 17073 time to create 1 rle with old method : 0.019993066787719727 length of segment : 152 time for calcul the mask position with numpy : 0.000171661376953125 nb_pixel_total : 3987 time to create 1 rle with old method : 0.004878520965576172 length of segment : 74 time for calcul the mask position with numpy : 0.007816076278686523 nb_pixel_total : 314896 time to create 1 rle with new method : 0.02034759521484375 length of segment : 1354 time for calcul the mask position with numpy : 0.0014116764068603516 nb_pixel_total : 89570 time to create 1 rle with old method : 0.10232257843017578 length of segment : 318 time for calcul the mask position with numpy : 0.00010228157043457031 nb_pixel_total : 3796 time to create 1 rle with old method : 0.0047566890716552734 length of segment : 76 time for calcul the mask position with numpy : 0.00014495849609375 nb_pixel_total : 2780 time to create 1 rle with old method : 0.003607034683227539 length of segment : 82 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 1872 time to create 1 rle with old method : 0.0023424625396728516 length of segment : 52 time for calcul the mask position with numpy : 0.0014369487762451172 nb_pixel_total : 99670 time to create 1 rle with old method : 0.11189794540405273 length of segment : 472 time for calcul the mask position with numpy : 0.00047469139099121094 nb_pixel_total : 8461 time to create 1 rle with old method : 0.010087966918945312 length of segment : 232 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 256 time to create 1 rle with old method : 0.00036454200744628906 length of segment : 21 time for calcul the mask position with numpy : 8.130073547363281e-05 nb_pixel_total : 567 time to create 1 rle with old method : 0.0006957054138183594 length of segment : 47 time for calcul the mask position with numpy : 0.002272367477416992 nb_pixel_total : 106510 time to create 1 rle with old method : 0.1221761703491211 length of segment : 422 time for calcul the mask position with numpy : 0.004233837127685547 nb_pixel_total : 127128 time to create 1 rle with old method : 0.14427590370178223 length of segment : 885 time for calcul the mask position with numpy : 0.0006198883056640625 nb_pixel_total : 19468 time to create 1 rle with old method : 0.02291131019592285 length of segment : 137 time for calcul the mask position with numpy : 0.0013425350189208984 nb_pixel_total : 65076 time to create 1 rle with old method : 0.0765535831451416 length of segment : 351 time for calcul the mask position with numpy : 0.0013377666473388672 nb_pixel_total : 68638 time to create 1 rle with old method : 0.07873177528381348 length of segment : 462 time for calcul the mask position with numpy : 0.0008389949798583984 nb_pixel_total : 63073 time to create 1 rle with old method : 0.07195806503295898 length of segment : 350 time for calcul the mask position with numpy : 0.0005950927734375 nb_pixel_total : 17405 time to create 1 rle with old method : 0.020210742950439453 length of segment : 195 time for calcul the mask position with numpy : 0.00029921531677246094 nb_pixel_total : 4666 time to create 1 rle with old method : 0.005563259124755859 length of segment : 143 time for calcul the mask position with numpy : 0.00015997886657714844 nb_pixel_total : 1872 time to create 1 rle with old method : 0.002427816390991211 length of segment : 102 time for calcul the mask position with numpy : 0.007854938507080078 nb_pixel_total : 306258 time to create 1 rle with new method : 0.01402425765991211 length of segment : 1059 time for calcul the mask position with numpy : 0.001827239990234375 nb_pixel_total : 89570 time to create 1 rle with old method : 0.10130906105041504 length of segment : 364 time for calcul the mask position with numpy : 0.0004165172576904297 nb_pixel_total : 22524 time to create 1 rle with old method : 0.026590347290039062 length of segment : 78 time for calcul the mask position with numpy : 0.0005924701690673828 nb_pixel_total : 22521 time to create 1 rle with old method : 0.02611708641052246 length of segment : 326 time for calcul the mask position with numpy : 0.0003924369812011719 nb_pixel_total : 19196 time to create 1 rle with old method : 0.0217742919921875 length of segment : 229 time for calcul the mask position with numpy : 0.0002620220184326172 nb_pixel_total : 13308 time to create 1 rle with old method : 0.015295267105102539 length of segment : 107 time for calcul the mask position with numpy : 0.0003070831298828125 nb_pixel_total : 17204 time to create 1 rle with old method : 0.019610881805419922 length of segment : 156 time for calcul the mask position with numpy : 0.0014345645904541016 nb_pixel_total : 60012 time to create 1 rle with old method : 0.06970858573913574 length of segment : 486 time for calcul the mask position with numpy : 0.00010442733764648438 nb_pixel_total : 2723 time to create 1 rle with old method : 0.0033740997314453125 length of segment : 83 time spent for convertir_results : 16.70664620399475 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 280 chid ids of type : 3663 Number RLEs to save : 73667 save missing photos in datou_result : time spend for datou_step_exec : 47.29647159576416 time spend to save output : 4.571284294128418 total time spend for step 1 : 51.86775588989258 step2:crop_condition Tue Nov 4 09:20:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3663 Loading chi in step crop for list_pids : 20 ! batch 1 Loaded 280 chid ids of type : 3663 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : teint_dans_la_masse param for this class : {'min_score': 0.7} filtre for class : teint_dans_la_masse hashtag_id of this class : 2107752385 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 29 About to insert : list_path_to_insert length 29 new photo from crops ! we have finished the crop for the class : teint_dans_la_masse begin to crop the class : autre_refus param for this class : {'min_score': 0.5} filtre for class : autre_refus hashtag_id of this class : 2107752406 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 17 About to insert : list_path_to_insert length 17 new photo from crops ! we have finished the crop for the class : autre_refus begin to crop the class : carton_gris param for this class : {'min_score': 0.5} filtre for class : carton_gris hashtag_id of this class : 2107753020 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 20 About to insert : list_path_to_insert length 20 new photo from crops ! we have finished the crop for the class : carton_gris begin to crop the class : cartonnette param for this class : {'min_score': 0.5} filtre for class : cartonnette hashtag_id of this class : 702398920 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 50 About to insert : list_path_to_insert length 50 new photo from crops ! we have finished the crop for the class : cartonnette begin to crop the class : carton_brun param for this class : {'min_score': 0.7} filtre for class : carton_brun hashtag_id of this class : 2107753024 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 12 About to insert : list_path_to_insert length 12 new photo from crops ! we have finished the crop for the class : carton_brun begin to crop the class : plastique param for this class : {'min_score': 0.5} filtre for class : plastique hashtag_id of this class : 492725882 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! we have finished the crop for the class : plastique begin to crop the class : kraft param for this class : {'min_score': 0.5} filtre for class : kraft hashtag_id of this class : 493202403 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! we have finished the crop for the class : kraft begin to crop the class : metal param for this class : {'min_score': 0.5} filtre for class : metal hashtag_id of this class : 492628673 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1389762934, 1389762902, 1389762884, 1389762881, 1389762878, 1389762876, 1389762873, 1389762870, 1389762860, 1389762856, 1389762852, 1389762849, 1389762839, 1389762835, 1389762831, 1389762822, 1389762819, 1389762817, 1389762814, 1389762810] Looping around the photos to save general results len do output : 135 /-4018865768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018866014Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018866016Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018866006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018866021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018866023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018866000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018866002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018866010Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018866013Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018866020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018866022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018866024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018866012Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018866025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /-4018865994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762934', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762902', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762884', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762881', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762878', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762876', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762873', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762870', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762860', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762856', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762852', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762849', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762839', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762835', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762831', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762822', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762819', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762817', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762814', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762810', None, None, None, None, None, '3986890') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 425 time used for this insertion : 0.04911398887634277 save_final save missing photos in datou_result : time spend for datou_step_exec : 24.309290885925293 time spend to save output : 0.05220508575439453 total time spend for step 2 : 24.361495971679688 step3:thcl Tue Nov 4 09:20:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! nombre de thcls : 2 we are using the classfication for multi_thcl [2456, 2868] time to import caffe and check if the image exist : 0.00815582275390625 time to convert the images to numpy array : 0.05244755744934082 time to import caffe and check if the image exist : 0.012827396392822266 time to convert the images to numpy array : 0.07308554649353027 time to import caffe and check if the image exist : 0.010494470596313477 time to convert the images to numpy array : 0.39454221725463867 time to import caffe and check if the image exist : 0.018481969833374023 time to convert the images to numpy array : 0.3914666175842285 time to import caffe and check if the image exist : 0.00827169418334961 time to convert the images to numpy array : 0.40476560592651367 time to import caffe and check if the image exist : 0.017011165618896484 time to convert the images to numpy array : 0.39949870109558105 time to import caffe and check if the image exist : 0.014585256576538086 time to convert the images to numpy array : 0.41389012336730957 time to import caffe and check if the image exist : 0.010879755020141602 time to convert the images to numpy array : 0.4205353260040283 time to import caffe and check if the image exist : 0.015052318572998047 time to convert the images to numpy array : 0.4222538471221924 time to import caffe and check if the image exist : 0.01865363121032715 time to convert the images to numpy array : 0.41889023780822754 total time to convert the images to numpy array : 0.6230039596557617 list photo_ids error: [] list photo_ids correct : [-4018865938, -4018865998, -4018865809, -4018865871, -4018865889, -4018865970, -4018866012, -4018866025, -4018865994, -4018866013, -4018866020, -4018866022, -4018866024, -4018865775, -4018865784, -4018865785, -4018865802, -4018865836, -4018865837, -4018865866, -4018865892, -4018865911, -4018865915, -4018865768, -4018865770, -4018865782, -4018865793, -4018865799, -4018865803, -4018865805, -4018865824, -4018865834, -4018865838, -4018865841, -4018865848, -4018865850, -4018865853, -4018865940, -4018865948, -4018865956, -4018865964, -4018865773, -4018865779, -4018865788, -4018865812, -4018865847, -4018865854, -4018865874, -4018865887, -4018865917, -4018865931, -4018866016, -4018865789, -4018865819, -4018865823, -4018865831, -4018865844, -4018865855, -4018865857, -4018865859, -4018865876, -4018865899, -4018865901, -4018865903, -4018865922, -4018865875, -4018865882, -4018865898, -4018865905, -4018865907, -4018865910, -4018865929, -4018865962, -4018865966, -4018865978, -4018865979, -4018865980, -4018865999, -4018866014, -4018865946, -4018865947, -4018865967, -4018865975, -4018865984, -4018865986, -4018865987, -4018866006, -4018866021, -4018866023, -4018865751, -4018865754, -4018865756, -4018865760, -4018865939, -4018865942, -4018865943, -4018865949, -4018865952, -4018865960, -4018865965, -4018865968, -4018865976, -4018865981, -4018865982, -4018866000, -4018866002, -4018866010, -4018865762, -4018865771, -4018865774, -4018865777, -4018865787, -4018865795, -4018865797, -4018865798, -4018865806, -4018865813, -4018865814, -4018865826, -4018865840, -4018865842, -4018865849, -4018865860, -4018865863, -4018865867, -4018865869, -4018865879, -4018865880, -4018865883, -4018865902, -4018865913, -4018865918, -4018865919, -4018865928, -4018865937] number of photos to traite : 135 try to delete the photos incorrect in DB tagging for thcl : 2456 To do loadFromThcl(), then load ParamDescType : thcl2456 thcls : [{'id': 2456, 'mtr_user_id': 31, 'name': 'learn_qualipapia_papier_refus_from_vlg_data_aug', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'papier,refus', 'svm_portfolios_learning': '3028087,3028251', 'photo_hashtag_type': 3049, 'photo_desc_type': 4999, 'type_classification': 'caffe', 'hashtag_id_list': '492668766,538914404'}] thcl {'id': 2456, 'mtr_user_id': 31, 'name': 'learn_qualipapia_papier_refus_from_vlg_data_aug', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'papier,refus', 'svm_portfolios_learning': '3028087,3028251', 'photo_hashtag_type': 3049, 'photo_desc_type': 4999, 'type_classification': 'caffe', 'hashtag_id_list': '492668766,538914404'} Update svm_hashtag_type_desc : 4999 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (4999, 'learn_qualipapia_papier_refus_from_vlg_data_aug', 16384, 25088, 'learn_qualipapia_papier_refus_from_vlg_data_aug', 'res5b', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2020, 10, 23, 14, 27, 22), datetime.datetime(2020, 10, 23, 14, 27, 22)) To loadFromThcl() : net_4999 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 6813 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (4999, 'learn_qualipapia_papier_refus_from_vlg_data_aug', 16384, 25088, 'learn_qualipapia_papier_refus_from_vlg_data_aug', 'res5b', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2020, 10, 23, 14, 27, 22), datetime.datetime(2020, 10, 23, 14, 27, 22)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_qualipapia_papier_refus_from_vlg_data_aug Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_qualipapia_papier_refus_from_vlg_data_aug model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug/caffemodel size_local : 44972172 size in s3 : 44972172 create time local : 2021-08-09 05:55:48 create time in s3 : 2021-08-06 19:28:49 caffemodel already exist and didn't need to update /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug/deploy.prototxt size_local : 17311 size in s3 : 17311 create time local : 2021-08-09 05:55:48 create time in s3 : 2021-08-06 19:28:49 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-08-09 05:55:48 create time in s3 : 2021-08-06 19:28:51 mean.npy already exist and didn't need to update /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug/synset_words.txt size_local : 57 size in s3 : 57 create time local : 2021-08-09 05:55:48 create time in s3 : 2021-08-06 19:28:49 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/:/home/admin/workarea/git/apy/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug/deploy.prototxt caffemodel_filename : /data/models_weight/learn_qualipapia_papier_refus_from_vlg_data_aug/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 6594 max_wait_temp : 1 max_wait : 0 dict_keys(['prob']) time used to do the prepocess of the images : 1.013542652130127 time used to do the prediction : 0.2911381721496582 we don't save the descriptors for this thcl 2456 tagging for thcl : 2868 To do loadFromThcl(), then load ParamDescType : thcl2868 thcls : [{'id': 2868, 'mtr_user_id': 31, 'name': 'learn_papier_nantes_300421', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,environnement,kraft,metal,papier,plastique', 'svm_portfolios_learning': '3752117,3752118,3752123,3752106,3752116,3752124,3752119,3581575,3486029,3752122', 'photo_hashtag_type': 3632, 'photo_desc_type': 5288, 'type_classification': 'caffe', 'hashtag_id_list': '2107753024,2107753020,2107752385,2107752406,702398920,493012381,493202403,492628673,492668766,492725882'}] thcl {'id': 2868, 'mtr_user_id': 31, 'name': 'learn_papier_nantes_300421', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,environnement,kraft,metal,papier,plastique', 'svm_portfolios_learning': '3752117,3752118,3752123,3752106,3752116,3752124,3752119,3581575,3486029,3752122', 'photo_hashtag_type': 3632, 'photo_desc_type': 5288, 'type_classification': 'caffe', 'hashtag_id_list': '2107753024,2107753020,2107752385,2107752406,702398920,493012381,493202403,492628673,492668766,492725882'} Update svm_hashtag_type_desc : 5288 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5288, 'learn_papier_nantes_300421', 512, 512, 'learn_papier_nantes_300421', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 30, 17, 9, 41), datetime.datetime(2021, 4, 30, 17, 9, 41)) To loadFromThcl() : net_5288 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 6198 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5288, 'learn_papier_nantes_300421', 512, 512, 'learn_papier_nantes_300421', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 30, 17, 9, 41), datetime.datetime(2021, 4, 30, 17, 9, 41)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_papier_nantes_300421 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_papier_nantes_300421 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_papier_nantes_300421 /data/models_weight/learn_papier_nantes_300421/caffemodel size_local : 44791983 size in s3 : 44791983 create time local : 2021-08-09 05:55:59 create time in s3 : 2021-08-06 19:22:13 caffemodel already exist and didn't need to update /data/models_weight/learn_papier_nantes_300421/deploy.prototxt size_local : 17255 size in s3 : 17255 create time local : 2021-08-09 05:55:59 create time in s3 : 2021-08-06 19:22:12 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_papier_nantes_300421/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-08-09 05:55:59 create time in s3 : 2021-08-06 19:22:14 mean.npy already exist and didn't need to update /data/models_weight/learn_papier_nantes_300421/synset_words.txt size_local : 331 size in s3 : 331 create time local : 2021-08-09 05:56:00 create time in s3 : 2021-08-06 19:22:12 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/:/home/admin/workarea/git/apy/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_papier_nantes_300421/deploy.prototxt caffemodel_filename : /data/models_weight/learn_papier_nantes_300421/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory havn't enough memory gpu , need / 2500 l 3632 free memory gpu now : 1708 wait 20 seconds l 3637 free memory gpu now : 1708 max_wait_temp : 1 max_wait : 0 dict_keys(['prob']) time used to do the prepocess of the images : 0.997941255569458 time used to do the prediction : 0.4054567813873291 we don't save the descriptors for this thcl 2868 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos test new format of the output of the step_thcl begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 0 time used for this insertion : 1.9073486328125e-05 save missing photos in datou_result : time spend for datou_step_exec : 30.3239643573761 time spend to save output : 0.001112222671508789 total time spend for step 3 : 30.325076580047607 step4:merge_mask_thcl_custom Tue Nov 4 09:21:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step merge_mask_thcl_custom batch 1 Loaded 280 chid ids of type : 3663 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++As expected we have just one thcl present End of step merge_mask_thcl_custom Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : merge_mask_thcl_custom we use saveGeneral [1389762934, 1389762902, 1389762884, 1389762881, 1389762878, 1389762876, 1389762873, 1389762870, 1389762860, 1389762856, 1389762852, 1389762849, 1389762839, 1389762835, 1389762831, 1389762822, 1389762819, 1389762817, 1389762814, 1389762810] Looping around the photos to save general results len do output : 20 /1389762934Didn't retrieve data .Didn't retrieve data . /1389762902Didn't retrieve data .Didn't retrieve data . /1389762884Didn't retrieve data .Didn't retrieve data . /1389762881Didn't retrieve data .Didn't retrieve data . /1389762878Didn't retrieve data .Didn't retrieve data . /1389762876Didn't retrieve data .Didn't retrieve data . /1389762873Didn't retrieve data .Didn't retrieve data . /1389762870Didn't retrieve data .Didn't retrieve data . /1389762860Didn't retrieve data .Didn't retrieve data . /1389762856Didn't retrieve data .Didn't retrieve data . /1389762852Didn't retrieve data .Didn't retrieve data . /1389762849Didn't retrieve data .Didn't retrieve data . /1389762839Didn't retrieve data .Didn't retrieve data . /1389762835Didn't retrieve data .Didn't retrieve data . /1389762831Didn't retrieve data .Didn't retrieve data . /1389762822Didn't retrieve data .Didn't retrieve data . /1389762819Didn't retrieve data .Didn't retrieve data . /1389762817Didn't retrieve data .Didn't retrieve data . /1389762814Didn't retrieve data .Didn't retrieve data . /1389762810Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762934', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762902', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762884', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762881', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762878', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762876', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762873', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762870', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762860', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762856', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762852', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762849', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762839', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762835', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762831', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762822', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762819', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762817', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762814', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762810', None, None, None, None, None, '3986890') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 60 time used for this insertion : 0.014992475509643555 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.07932448387145996 time spend to save output : 0.01585698127746582 total time spend for step 4 : 0.09518146514892578 step5:rle_unique_nms_with_priority Tue Nov 4 09:21:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 2.0267276763916016 time for calcul the mask position with numpy : 0.042586326599121094 nb_pixel_total : 1216511 time to create 1 rle with new method : 0.07871794700622559 time for calcul the mask position with numpy : 0.006853818893432617 nb_pixel_total : 105821 time to create 1 rle with old method : 0.12009072303771973 time for calcul the mask position with numpy : 0.006040811538696289 nb_pixel_total : 4117 time to create 1 rle with old method : 0.004929780960083008 time for calcul the mask position with numpy : 0.005707979202270508 nb_pixel_total : 3366 time to create 1 rle with old method : 0.0047435760498046875 time for calcul the mask position with numpy : 0.0062406063079833984 nb_pixel_total : 6282 time to create 1 rle with old method : 0.009096145629882812 time for calcul the mask position with numpy : 0.009372234344482422 nb_pixel_total : 390206 time to create 1 rle with new method : 0.3408975601196289 time for calcul the mask position with numpy : 0.005857706069946289 nb_pixel_total : 14472 time to create 1 rle with old method : 0.016715526580810547 time for calcul the mask position with numpy : 0.005904197692871094 nb_pixel_total : 20914 time to create 1 rle with old method : 0.02519702911376953 time for calcul the mask position with numpy : 0.005459308624267578 nb_pixel_total : 871 time to create 1 rle with old method : 0.001027822494506836 create new chi : 0.704167366027832 time to delete rle : 0.01392817497253418 batch 1 Loaded 9 chid ids of type : 3726 Number RLEs to save : 6265 TO DO : save crop sub photo not yet done ! save time : 0.42249202728271484 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 2.0071640014648438 time for calcul the mask position with numpy : 0.025372743606567383 nb_pixel_total : 1199589 time to create 1 rle with new method : 0.06324315071105957 time for calcul the mask position with numpy : 0.007007598876953125 nb_pixel_total : 106603 time to create 1 rle with old method : 0.13491034507751465 time for calcul the mask position with numpy : 0.006433010101318359 nb_pixel_total : 4112 time to create 1 rle with old method : 0.0049245357513427734 time for calcul the mask position with numpy : 0.006919384002685547 nb_pixel_total : 3361 time to create 1 rle with old method : 0.004002571105957031 time for calcul the mask position with numpy : 0.012971639633178711 nb_pixel_total : 413777 time to create 1 rle with new method : 0.03554940223693848 time for calcul the mask position with numpy : 0.00693821907043457 nb_pixel_total : 20149 time to create 1 rle with old method : 0.023682117462158203 time for calcul the mask position with numpy : 0.0064411163330078125 nb_pixel_total : 871 time to create 1 rle with old method : 0.001088857650756836 time for calcul the mask position with numpy : 0.0064830780029296875 nb_pixel_total : 14098 time to create 1 rle with old method : 0.01676011085510254 create new chi : 0.3638434410095215 time to delete rle : 0.0007772445678710938 batch 1 Loaded 8 chid ids of type : 3726 Number RLEs to save : 5407 TO DO : save crop sub photo not yet done ! save time : 0.35158276557922363 nb_obj : 13 nb_hashtags : 5 time to prepare the origin masks : 1.5568184852600098 time for calcul the mask position with numpy : 0.04389238357543945 nb_pixel_total : 1155678 time to create 1 rle with new method : 0.28589701652526855 time for calcul the mask position with numpy : 0.006467580795288086 nb_pixel_total : 19937 time to create 1 rle with old method : 0.021178483963012695 time for calcul the mask position with numpy : 0.00629115104675293 nb_pixel_total : 34102 time to create 1 rle with old method : 0.03625202178955078 time for calcul the mask position with numpy : 0.009213447570800781 nb_pixel_total : 352074 time to create 1 rle with new method : 0.08892345428466797 time for calcul the mask position with numpy : 0.006354331970214844 nb_pixel_total : 2099 time to create 1 rle with old method : 0.002447843551635742 time for calcul the mask position with numpy : 0.006497621536254883 nb_pixel_total : 103110 time to create 1 rle with old method : 0.11131882667541504 time for calcul the mask position with numpy : 0.006306648254394531 nb_pixel_total : 3180 time to create 1 rle with old method : 0.003682374954223633 time for calcul the mask position with numpy : 0.0064809322357177734 nb_pixel_total : 45742 time to create 1 rle with old method : 0.049286603927612305 time for calcul the mask position with numpy : 0.006652116775512695 nb_pixel_total : 8395 time to create 1 rle with old method : 0.009211063385009766 time for calcul the mask position with numpy : 0.006182670593261719 nb_pixel_total : 3802 time to create 1 rle with old method : 0.00561976432800293 time for calcul the mask position with numpy : 0.0063934326171875 nb_pixel_total : 983 time to create 1 rle with old method : 0.0016756057739257812 time for calcul the mask position with numpy : 0.006482601165771484 nb_pixel_total : 1525 time to create 1 rle with old method : 0.0025627613067626953 time for calcul the mask position with numpy : 0.006380319595336914 nb_pixel_total : 1711 time to create 1 rle with old method : 0.0029799938201904297 time for calcul the mask position with numpy : 0.0067577362060546875 nb_pixel_total : 30222 time to create 1 rle with old method : 0.045884132385253906 create new chi : 0.808807373046875 time to delete rle : 0.0008275508880615234 batch 1 Loaded 14 chid ids of type : 3726 Number RLEs to save : 7037 TO DO : save crop sub photo not yet done ! save time : 0.44905543327331543 nb_obj : 17 nb_hashtags : 5 time to prepare the origin masks : 1.5803873538970947 time for calcul the mask position with numpy : 0.15770268440246582 nb_pixel_total : 1037948 time to create 1 rle with new method : 0.09694027900695801 time for calcul the mask position with numpy : 0.008309125900268555 nb_pixel_total : 100637 time to create 1 rle with old method : 0.14150691032409668 time for calcul the mask position with numpy : 0.008072137832641602 nb_pixel_total : 1857 time to create 1 rle with old method : 0.0027992725372314453 time for calcul the mask position with numpy : 0.005711078643798828 nb_pixel_total : 438 time to create 1 rle with old method : 0.0005490779876708984 time for calcul the mask position with numpy : 0.005957126617431641 nb_pixel_total : 872 time to create 1 rle with old method : 0.0009751319885253906 time for calcul the mask position with numpy : 0.00599980354309082 nb_pixel_total : 24893 time to create 1 rle with old method : 0.027071237564086914 time for calcul the mask position with numpy : 0.005841493606567383 nb_pixel_total : 29951 time to create 1 rle with old method : 0.033142805099487305 time for calcul the mask position with numpy : 0.010504722595214844 nb_pixel_total : 409721 time to create 1 rle with new method : 0.07478666305541992 time for calcul the mask position with numpy : 0.005707502365112305 nb_pixel_total : 16361 time to create 1 rle with old method : 0.01807999610900879 time for calcul the mask position with numpy : 0.0056874752044677734 nb_pixel_total : 1024 time to create 1 rle with old method : 0.0011332035064697266 time for calcul the mask position with numpy : 0.005700349807739258 nb_pixel_total : 2174 time to create 1 rle with old method : 0.002534627914428711 time for calcul the mask position with numpy : 0.005603790283203125 nb_pixel_total : 3405 time to create 1 rle with old method : 0.003773212432861328 time for calcul the mask position with numpy : 0.005826711654663086 nb_pixel_total : 30649 time to create 1 rle with old method : 0.03345155715942383 time for calcul the mask position with numpy : 0.005961894989013672 nb_pixel_total : 10662 time to create 1 rle with old method : 0.01179647445678711 time for calcul the mask position with numpy : 0.005987405776977539 nb_pixel_total : 41784 time to create 1 rle with old method : 0.04451155662536621 time for calcul the mask position with numpy : 0.005755901336669922 nb_pixel_total : 3961 time to create 1 rle with old method : 0.004396677017211914 time for calcul the mask position with numpy : 0.005952358245849609 nb_pixel_total : 43997 time to create 1 rle with old method : 0.047250986099243164 time for calcul the mask position with numpy : 0.005919456481933594 nb_pixel_total : 2226 time to create 1 rle with old method : 0.002559185028076172 create new chi : 0.8256881237030029 time to delete rle : 0.0009067058563232422 batch 1 Loaded 18 chid ids of type : 3726 Number RLEs to save : 8715 TO DO : save crop sub photo not yet done ! save time : 0.5317442417144775 nb_obj : 20 nb_hashtags : 7 time to prepare the origin masks : 1.6999461650848389 time for calcul the mask position with numpy : 0.25751423835754395 nb_pixel_total : 1476642 time to create 1 rle with new method : 0.08706402778625488 time for calcul the mask position with numpy : 0.011307716369628906 nb_pixel_total : 4327 time to create 1 rle with old method : 0.004985332489013672 time for calcul the mask position with numpy : 0.010543346405029297 nb_pixel_total : 1033 time to create 1 rle with old method : 0.0012290477752685547 time for calcul the mask position with numpy : 0.006017923355102539 nb_pixel_total : 7716 time to create 1 rle with old method : 0.008764982223510742 time for calcul the mask position with numpy : 0.006074666976928711 nb_pixel_total : 12537 time to create 1 rle with old method : 0.014945030212402344 time for calcul the mask position with numpy : 0.0067555904388427734 nb_pixel_total : 123484 time to create 1 rle with old method : 0.1448373794555664 time for calcul the mask position with numpy : 0.007636070251464844 nb_pixel_total : 377 time to create 1 rle with old method : 0.0006303787231445312 time for calcul the mask position with numpy : 0.00786733627319336 nb_pixel_total : 7397 time to create 1 rle with old method : 0.010226964950561523 time for calcul the mask position with numpy : 0.007917404174804688 nb_pixel_total : 44260 time to create 1 rle with old method : 0.06521391868591309 time for calcul the mask position with numpy : 0.008662939071655273 nb_pixel_total : 1457 time to create 1 rle with old method : 0.003288745880126953 time for calcul the mask position with numpy : 0.010415077209472656 nb_pixel_total : 674 time to create 1 rle with old method : 0.0015821456909179688 time for calcul the mask position with numpy : 0.008625030517578125 nb_pixel_total : 5525 time to create 1 rle with old method : 0.009493589401245117 time for calcul the mask position with numpy : 0.00949406623840332 nb_pixel_total : 637 time to create 1 rle with old method : 0.001058340072631836 time for calcul the mask position with numpy : 0.009529352188110352 nb_pixel_total : 32978 time to create 1 rle with old method : 0.044059038162231445 time for calcul the mask position with numpy : 0.006222963333129883 nb_pixel_total : 1732 time to create 1 rle with old method : 0.002041339874267578 time for calcul the mask position with numpy : 0.006200075149536133 nb_pixel_total : 24099 time to create 1 rle with old method : 0.0282137393951416 time for calcul the mask position with numpy : 0.006789445877075195 nb_pixel_total : 2772 time to create 1 rle with old method : 0.004589080810546875 time for calcul the mask position with numpy : 0.00827646255493164 nb_pixel_total : 927 time to create 1 rle with old method : 0.0015752315521240234 time for calcul the mask position with numpy : 0.010629653930664062 nb_pixel_total : 3559 time to create 1 rle with old method : 0.006757974624633789 time for calcul the mask position with numpy : 0.011158227920532227 nb_pixel_total : 9962 time to create 1 rle with old method : 0.018511295318603516 time for calcul the mask position with numpy : 0.010070323944091797 nb_pixel_total : 465 time to create 1 rle with old method : 0.0008807182312011719 create new chi : 0.900705099105835 time to delete rle : 0.0014319419860839844 batch 1 Loaded 21 chid ids of type : 3726 Number RLEs to save : 6332 TO DO : save crop sub photo not yet done ! save time : 0.38780736923217773 nb_obj : 7 nb_hashtags : 3 time to prepare the origin masks : 0.6488566398620605 time for calcul the mask position with numpy : 0.026928186416625977 nb_pixel_total : 1189363 time to create 1 rle with new method : 0.03575420379638672 time for calcul the mask position with numpy : 0.010070085525512695 nb_pixel_total : 4660 time to create 1 rle with old method : 0.0053250789642333984 time for calcul the mask position with numpy : 0.005692958831787109 nb_pixel_total : 7655 time to create 1 rle with old method : 0.008490800857543945 time for calcul the mask position with numpy : 0.01657247543334961 nb_pixel_total : 462873 time to create 1 rle with new method : 0.034459590911865234 time for calcul the mask position with numpy : 0.01219797134399414 nb_pixel_total : 1193 time to create 1 rle with old method : 0.001718759536743164 time for calcul the mask position with numpy : 0.007314205169677734 nb_pixel_total : 4311 time to create 1 rle with old method : 0.005559206008911133 time for calcul the mask position with numpy : 0.010097980499267578 nb_pixel_total : 617 time to create 1 rle with old method : 0.0010542869567871094 time for calcul the mask position with numpy : 0.008460760116577148 nb_pixel_total : 91888 time to create 1 rle with old method : 0.11879324913024902 create new chi : 0.31746482849121094 time to delete rle : 0.0004773139953613281 batch 1 Loaded 8 chid ids of type : 3726 Number RLEs to save : 4481 TO DO : save crop sub photo not yet done ! save time : 0.3019697666168213 nb_obj : 15 nb_hashtags : 4 time to prepare the origin masks : 1.5406975746154785 time for calcul the mask position with numpy : 0.032228946685791016 nb_pixel_total : 1063610 time to create 1 rle with new method : 0.1666727066040039 time for calcul the mask position with numpy : 0.005427122116088867 nb_pixel_total : 24719 time to create 1 rle with old method : 0.028059720993041992 time for calcul the mask position with numpy : 0.005669355392456055 nb_pixel_total : 4064 time to create 1 rle with old method : 0.004721403121948242 time for calcul the mask position with numpy : 0.006039619445800781 nb_pixel_total : 22151 time to create 1 rle with old method : 0.029506206512451172 time for calcul the mask position with numpy : 0.006161928176879883 nb_pixel_total : 141 time to create 1 rle with old method : 0.0003178119659423828 time for calcul the mask position with numpy : 0.007607698440551758 nb_pixel_total : 186 time to create 1 rle with old method : 0.0009064674377441406 time for calcul the mask position with numpy : 0.0072803497314453125 nb_pixel_total : 395 time to create 1 rle with old method : 0.0004885196685791016 time for calcul the mask position with numpy : 0.0059812068939208984 nb_pixel_total : 4462 time to create 1 rle with old method : 0.005173444747924805 time for calcul the mask position with numpy : 0.0054280757904052734 nb_pixel_total : 911 time to create 1 rle with old method : 0.001664876937866211 time for calcul the mask position with numpy : 0.011291265487670898 nb_pixel_total : 474803 time to create 1 rle with new method : 0.09397268295288086 time for calcul the mask position with numpy : 0.006807565689086914 nb_pixel_total : 9079 time to create 1 rle with old method : 0.0159912109375 time for calcul the mask position with numpy : 0.0077457427978515625 nb_pixel_total : 3230 time to create 1 rle with old method : 0.004827737808227539 time for calcul the mask position with numpy : 0.0069103240966796875 nb_pixel_total : 943 time to create 1 rle with old method : 0.0015130043029785156 time for calcul the mask position with numpy : 0.006483793258666992 nb_pixel_total : 100071 time to create 1 rle with old method : 0.12008976936340332 time for calcul the mask position with numpy : 0.0053899288177490234 nb_pixel_total : 2370 time to create 1 rle with old method : 0.0025446414947509766 time for calcul the mask position with numpy : 0.005343198776245117 nb_pixel_total : 51425 time to create 1 rle with old method : 0.062407732009887695 create new chi : 0.6798837184906006 time to delete rle : 0.0008914470672607422 batch 1 Loaded 16 chid ids of type : 3726 Number RLEs to save : 6597 TO DO : save crop sub photo not yet done ! save time : 0.4302048683166504 nb_obj : 11 nb_hashtags : 5 time to prepare the origin masks : 0.8454070091247559 time for calcul the mask position with numpy : 0.01877570152282715 nb_pixel_total : 1136287 time to create 1 rle with new method : 0.034192562103271484 time for calcul the mask position with numpy : 0.006045818328857422 nb_pixel_total : 21851 time to create 1 rle with old method : 0.024390697479248047 time for calcul the mask position with numpy : 0.006281137466430664 nb_pixel_total : 11039 time to create 1 rle with old method : 0.012497663497924805 time for calcul the mask position with numpy : 0.009424924850463867 nb_pixel_total : 10923 time to create 1 rle with old method : 0.014935970306396484 time for calcul the mask position with numpy : 0.005785226821899414 nb_pixel_total : 12526 time to create 1 rle with old method : 0.013971090316772461 time for calcul the mask position with numpy : 0.006158113479614258 nb_pixel_total : 18619 time to create 1 rle with old method : 0.023053884506225586 time for calcul the mask position with numpy : 0.010607719421386719 nb_pixel_total : 421626 time to create 1 rle with new method : 0.03633856773376465 time for calcul the mask position with numpy : 0.007477283477783203 nb_pixel_total : 2278 time to create 1 rle with old method : 0.002709627151489258 time for calcul the mask position with numpy : 0.0066950321197509766 nb_pixel_total : 814 time to create 1 rle with old method : 0.0011792182922363281 time for calcul the mask position with numpy : 0.007683753967285156 nb_pixel_total : 107787 time to create 1 rle with old method : 0.13141584396362305 time for calcul the mask position with numpy : 0.005750417709350586 nb_pixel_total : 11680 time to create 1 rle with old method : 0.012134075164794922 time for calcul the mask position with numpy : 0.0054476261138916016 nb_pixel_total : 7130 time to create 1 rle with old method : 0.007529258728027344 create new chi : 0.4116404056549072 time to delete rle : 0.0006117820739746094 batch 1 Loaded 12 chid ids of type : 3726 Number RLEs to save : 5776 TO DO : save crop sub photo not yet done ! save time : 0.39374232292175293 nb_obj : 3 nb_hashtags : 2 time to prepare the origin masks : 0.2424755096435547 time for calcul the mask position with numpy : 0.011341571807861328 nb_pixel_total : 626964 time to create 1 rle with new method : 0.03651881217956543 time for calcul the mask position with numpy : 0.006223440170288086 nb_pixel_total : 19028 time to create 1 rle with old method : 0.019840002059936523 time for calcul the mask position with numpy : 0.016962051391601562 nb_pixel_total : 1023415 time to create 1 rle with new method : 0.030986309051513672 time for calcul the mask position with numpy : 0.009226083755493164 nb_pixel_total : 93153 time to create 1 rle with old method : 0.09531879425048828 create new chi : 0.22730374336242676 time to delete rle : 0.0005443096160888672 batch 1 Loaded 4 chid ids of type : 3726 Number RLEs to save : 5216 TO DO : save crop sub photo not yet done ! save time : 0.33514952659606934 nb_obj : 6 nb_hashtags : 3 time to prepare the origin masks : 0.7473680973052979 time for calcul the mask position with numpy : 0.025270700454711914 nb_pixel_total : 928786 time to create 1 rle with new method : 0.05605626106262207 time for calcul the mask position with numpy : 0.007053375244140625 nb_pixel_total : 48319 time to create 1 rle with old method : 0.06023812294006348 time for calcul the mask position with numpy : 0.015517950057983398 nb_pixel_total : 626588 time to create 1 rle with new method : 0.03812217712402344 time for calcul the mask position with numpy : 0.006042003631591797 nb_pixel_total : 7460 time to create 1 rle with old method : 0.008594274520874023 time for calcul the mask position with numpy : 0.006048917770385742 nb_pixel_total : 234 time to create 1 rle with old method : 0.00031495094299316406 time for calcul the mask position with numpy : 0.006459951400756836 nb_pixel_total : 62239 time to create 1 rle with old method : 0.06926822662353516 time for calcul the mask position with numpy : 0.006612300872802734 nb_pixel_total : 88934 time to create 1 rle with old method : 0.11808061599731445 create new chi : 0.42487049102783203 time to delete rle : 0.0011246204376220703 batch 1 Loaded 7 chid ids of type : 3726 Number RLEs to save : 6763 TO DO : save crop sub photo not yet done ! save time : 0.44455957412719727 nb_obj : 15 nb_hashtags : 5 time to prepare the origin masks : 1.9511001110076904 time for calcul the mask position with numpy : 0.04174017906188965 nb_pixel_total : 1132159 time to create 1 rle with new method : 0.2679603099822998 time for calcul the mask position with numpy : 0.010185718536376953 nb_pixel_total : 16930 time to create 1 rle with old method : 0.01830148696899414 time for calcul the mask position with numpy : 0.005829572677612305 nb_pixel_total : 32686 time to create 1 rle with old method : 0.03504490852355957 time for calcul the mask position with numpy : 0.0056574344635009766 nb_pixel_total : 9731 time to create 1 rle with old method : 0.01034998893737793 time for calcul the mask position with numpy : 0.005613803863525391 nb_pixel_total : 408 time to create 1 rle with old method : 0.000499725341796875 time for calcul the mask position with numpy : 0.010648250579833984 nb_pixel_total : 5769 time to create 1 rle with old method : 0.0064203739166259766 time for calcul the mask position with numpy : 0.014823675155639648 nb_pixel_total : 414240 time to create 1 rle with new method : 0.07496428489685059 time for calcul the mask position with numpy : 0.009139537811279297 nb_pixel_total : 1135 time to create 1 rle with old method : 0.0013992786407470703 time for calcul the mask position with numpy : 0.0061070919036865234 nb_pixel_total : 254 time to create 1 rle with old method : 0.00031948089599609375 time for calcul the mask position with numpy : 0.006305217742919922 nb_pixel_total : 8917 time to create 1 rle with old method : 0.009322166442871094 time for calcul the mask position with numpy : 0.005796909332275391 nb_pixel_total : 1941 time to create 1 rle with old method : 0.0022041797637939453 time for calcul the mask position with numpy : 0.0062558650970458984 nb_pixel_total : 4291 time to create 1 rle with old method : 0.004554271697998047 time for calcul the mask position with numpy : 0.007448673248291016 nb_pixel_total : 563 time to create 1 rle with old method : 0.0006353855133056641 time for calcul the mask position with numpy : 0.006502389907836914 nb_pixel_total : 17015 time to create 1 rle with old method : 0.021142244338989258 time for calcul the mask position with numpy : 0.0069386959075927734 nb_pixel_total : 86836 time to create 1 rle with old method : 0.09160184860229492 time for calcul the mask position with numpy : 0.006969928741455078 nb_pixel_total : 29685 time to create 1 rle with old method : 0.03469491004943848 create new chi : 0.7444441318511963 time to delete rle : 0.001190185546875 batch 1 Loaded 16 chid ids of type : 3726 Number RLEs to save : 7537 TO DO : save crop sub photo not yet done ! save time : 0.49223756790161133 nb_obj : 14 nb_hashtags : 5 time to prepare the origin masks : 1.5194640159606934 time for calcul the mask position with numpy : 0.016584157943725586 nb_pixel_total : 1109609 time to create 1 rle with new method : 0.09748578071594238 time for calcul the mask position with numpy : 0.006175041198730469 nb_pixel_total : 8816 time to create 1 rle with old method : 0.009793281555175781 time for calcul the mask position with numpy : 0.005796909332275391 nb_pixel_total : 213 time to create 1 rle with old method : 0.00025773048400878906 time for calcul the mask position with numpy : 0.006258726119995117 nb_pixel_total : 55836 time to create 1 rle with old method : 0.060213565826416016 time for calcul the mask position with numpy : 0.005741119384765625 nb_pixel_total : 5045 time to create 1 rle with old method : 0.006902933120727539 time for calcul the mask position with numpy : 0.006290912628173828 nb_pixel_total : 3355 time to create 1 rle with old method : 0.003797769546508789 time for calcul the mask position with numpy : 0.005745410919189453 nb_pixel_total : 8772 time to create 1 rle with old method : 0.00991201400756836 time for calcul the mask position with numpy : 0.010161161422729492 nb_pixel_total : 381205 time to create 1 rle with new method : 0.07657861709594727 time for calcul the mask position with numpy : 0.006667613983154297 nb_pixel_total : 173997 time to create 1 rle with new method : 0.03186321258544922 time for calcul the mask position with numpy : 0.006086111068725586 nb_pixel_total : 8385 time to create 1 rle with old method : 0.009655475616455078 time for calcul the mask position with numpy : 0.00646662712097168 nb_pixel_total : 5737 time to create 1 rle with old method : 0.006644725799560547 time for calcul the mask position with numpy : 0.006170511245727539 nb_pixel_total : 773 time to create 1 rle with old method : 0.0009186267852783203 time for calcul the mask position with numpy : 0.006047964096069336 nb_pixel_total : 364 time to create 1 rle with old method : 0.0004494190216064453 time for calcul the mask position with numpy : 0.006108522415161133 nb_pixel_total : 195 time to create 1 rle with old method : 0.00025010108947753906 time for calcul the mask position with numpy : 0.012956857681274414 nb_pixel_total : 258 time to create 1 rle with old method : 0.0003418922424316406 create new chi : 0.43804192543029785 time to delete rle : 0.0008072853088378906 batch 1 Loaded 15 chid ids of type : 3726 Number RLEs to save : 6642 TO DO : save crop sub photo not yet done ! save time : 0.42371606826782227 nb_obj : 16 nb_hashtags : 4 time to prepare the origin masks : 1.2999193668365479 time for calcul the mask position with numpy : 0.24018073081970215 nb_pixel_total : 1274571 time to create 1 rle with new method : 0.09154963493347168 time for calcul the mask position with numpy : 0.006090879440307617 nb_pixel_total : 1103 time to create 1 rle with old method : 0.0013616085052490234 time for calcul the mask position with numpy : 0.007272481918334961 nb_pixel_total : 21142 time to create 1 rle with old method : 0.025534629821777344 time for calcul the mask position with numpy : 0.006073713302612305 nb_pixel_total : 547 time to create 1 rle with old method : 0.0006718635559082031 time for calcul the mask position with numpy : 0.006277561187744141 nb_pixel_total : 1379 time to create 1 rle with old method : 0.0017914772033691406 time for calcul the mask position with numpy : 0.0077724456787109375 nb_pixel_total : 4361 time to create 1 rle with old method : 0.00731348991394043 time for calcul the mask position with numpy : 0.006253957748413086 nb_pixel_total : 446 time to create 1 rle with old method : 0.000606536865234375 time for calcul the mask position with numpy : 0.007560253143310547 nb_pixel_total : 3368 time to create 1 rle with old method : 0.006014585494995117 time for calcul the mask position with numpy : 0.0067098140716552734 nb_pixel_total : 2475 time to create 1 rle with old method : 0.0037407875061035156 time for calcul the mask position with numpy : 0.009427309036254883 nb_pixel_total : 294441 time to create 1 rle with new method : 0.23239731788635254 time for calcul the mask position with numpy : 0.0052907466888427734 nb_pixel_total : 11543 time to create 1 rle with old method : 0.0130462646484375 time for calcul the mask position with numpy : 0.005388021469116211 nb_pixel_total : 9141 time to create 1 rle with old method : 0.010478496551513672 time for calcul the mask position with numpy : 0.005666971206665039 nb_pixel_total : 52418 time to create 1 rle with old method : 0.06275296211242676 time for calcul the mask position with numpy : 0.009082317352294922 nb_pixel_total : 59309 time to create 1 rle with old method : 0.06656193733215332 time for calcul the mask position with numpy : 0.005858898162841797 nb_pixel_total : 21956 time to create 1 rle with old method : 0.024648189544677734 time for calcul the mask position with numpy : 0.005419492721557617 nb_pixel_total : 1009 time to create 1 rle with old method : 0.0011749267578125 time for calcul the mask position with numpy : 0.005521297454833984 nb_pixel_total : 3351 time to create 1 rle with old method : 0.003804445266723633 create new chi : 0.9120025634765625 time to delete rle : 0.0007319450378417969 batch 1 Loaded 17 chid ids of type : 3726 Number RLEs to save : 6825 TO DO : save crop sub photo not yet done ! save time : 0.43789100646972656 nb_obj : 13 nb_hashtags : 2 time to prepare the origin masks : 1.4066879749298096 time for calcul the mask position with numpy : 0.021511077880859375 nb_pixel_total : 1185458 time to create 1 rle with new method : 0.04390120506286621 time for calcul the mask position with numpy : 0.005725383758544922 nb_pixel_total : 8889 time to create 1 rle with old method : 0.010254144668579102 time for calcul the mask position with numpy : 0.006117343902587891 nb_pixel_total : 22172 time to create 1 rle with old method : 0.025208234786987305 time for calcul the mask position with numpy : 0.005461692810058594 nb_pixel_total : 211 time to create 1 rle with old method : 0.00026917457580566406 time for calcul the mask position with numpy : 0.005450248718261719 nb_pixel_total : 22471 time to create 1 rle with old method : 0.025597333908081055 time for calcul the mask position with numpy : 0.007863521575927734 nb_pixel_total : 362691 time to create 1 rle with new method : 0.025055408477783203 time for calcul the mask position with numpy : 0.00531458854675293 nb_pixel_total : 884 time to create 1 rle with old method : 0.001049041748046875 time for calcul the mask position with numpy : 0.007088899612426758 nb_pixel_total : 3771 time to create 1 rle with old method : 0.004279375076293945 time for calcul the mask position with numpy : 0.005735874176025391 nb_pixel_total : 99477 time to create 1 rle with old method : 0.11062312126159668 time for calcul the mask position with numpy : 0.005510568618774414 nb_pixel_total : 5799 time to create 1 rle with old method : 0.0066089630126953125 time for calcul the mask position with numpy : 0.005240678787231445 nb_pixel_total : 480 time to create 1 rle with old method : 0.0005631446838378906 time for calcul the mask position with numpy : 0.006169557571411133 nb_pixel_total : 5367 time to create 1 rle with old method : 0.006097316741943359 time for calcul the mask position with numpy : 0.005209207534790039 nb_pixel_total : 774 time to create 1 rle with old method : 0.0009248256683349609 time for calcul the mask position with numpy : 0.0054624080657958984 nb_pixel_total : 44116 time to create 1 rle with old method : 0.051431894302368164 create new chi : 0.41078925132751465 time to delete rle : 0.000583648681640625 batch 1 Loaded 14 chid ids of type : 3726 Number RLEs to save : 6118 TO DO : save crop sub photo not yet done ! save time : 0.3856794834136963 nb_obj : 17 nb_hashtags : 6 time to prepare the origin masks : 1.8205692768096924 time for calcul the mask position with numpy : 0.24384284019470215 nb_pixel_total : 1273926 time to create 1 rle with new method : 0.08165431022644043 time for calcul the mask position with numpy : 0.006013631820678711 nb_pixel_total : 32159 time to create 1 rle with old method : 0.03678178787231445 time for calcul the mask position with numpy : 0.005441188812255859 nb_pixel_total : 1721 time to create 1 rle with old method : 0.002022266387939453 time for calcul the mask position with numpy : 0.005342960357666016 nb_pixel_total : 6575 time to create 1 rle with old method : 0.0074999332427978516 time for calcul the mask position with numpy : 0.00530242919921875 nb_pixel_total : 2552 time to create 1 rle with old method : 0.0028896331787109375 time for calcul the mask position with numpy : 0.005225658416748047 nb_pixel_total : 1285 time to create 1 rle with old method : 0.001504659652709961 time for calcul the mask position with numpy : 0.005311489105224609 nb_pixel_total : 14755 time to create 1 rle with old method : 0.01679205894470215 time for calcul the mask position with numpy : 0.005566835403442383 nb_pixel_total : 22112 time to create 1 rle with old method : 0.025073528289794922 time for calcul the mask position with numpy : 0.0055446624755859375 nb_pixel_total : 32193 time to create 1 rle with old method : 0.037247657775878906 time for calcul the mask position with numpy : 0.005481243133544922 nb_pixel_total : 2391 time to create 1 rle with old method : 0.0028302669525146484 time for calcul the mask position with numpy : 0.00548243522644043 nb_pixel_total : 131 time to create 1 rle with old method : 0.0001976490020751953 time for calcul the mask position with numpy : 0.006732463836669922 nb_pixel_total : 238937 time to create 1 rle with new method : 0.3885359764099121 time for calcul the mask position with numpy : 0.005352497100830078 nb_pixel_total : 6923 time to create 1 rle with old method : 0.007903575897216797 time for calcul the mask position with numpy : 0.005462169647216797 nb_pixel_total : 23179 time to create 1 rle with old method : 0.026346206665039062 time for calcul the mask position with numpy : 0.00537419319152832 nb_pixel_total : 14154 time to create 1 rle with old method : 0.016329526901245117 time for calcul the mask position with numpy : 0.005774736404418945 nb_pixel_total : 56834 time to create 1 rle with old method : 0.08347797393798828 time for calcul the mask position with numpy : 0.006498813629150391 nb_pixel_total : 1064 time to create 1 rle with old method : 0.001834869384765625 time for calcul the mask position with numpy : 0.006325483322143555 nb_pixel_total : 31669 time to create 1 rle with old method : 0.03986620903015137 create new chi : 1.128736972808838 time to delete rle : 0.0009975433349609375 batch 1 Loaded 18 chid ids of type : 3726 Number RLEs to save : 9647 TO DO : save crop sub photo not yet done ! save time : 0.6199266910552979 nb_obj : 13 nb_hashtags : 6 time to prepare the origin masks : 0.898247480392456 time for calcul the mask position with numpy : 0.01229715347290039 nb_pixel_total : 1096675 time to create 1 rle with new method : 0.02685689926147461 time for calcul the mask position with numpy : 0.005481243133544922 nb_pixel_total : 36589 time to create 1 rle with old method : 0.04082179069519043 time for calcul the mask position with numpy : 0.005242824554443359 nb_pixel_total : 29901 time to create 1 rle with old method : 0.03307390213012695 time for calcul the mask position with numpy : 0.005287647247314453 nb_pixel_total : 24425 time to create 1 rle with old method : 0.02716684341430664 time for calcul the mask position with numpy : 0.005199909210205078 nb_pixel_total : 8788 time to create 1 rle with old method : 0.009938716888427734 time for calcul the mask position with numpy : 0.007557392120361328 nb_pixel_total : 422924 time to create 1 rle with new method : 0.02430868148803711 time for calcul the mask position with numpy : 0.005128383636474609 nb_pixel_total : 2562 time to create 1 rle with old method : 0.0029065608978271484 time for calcul the mask position with numpy : 0.005534648895263672 nb_pixel_total : 101364 time to create 1 rle with old method : 0.10961461067199707 time for calcul the mask position with numpy : 0.005220890045166016 nb_pixel_total : 2620 time to create 1 rle with old method : 0.0029840469360351562 time for calcul the mask position with numpy : 0.0050432682037353516 nb_pixel_total : 249 time to create 1 rle with old method : 0.0002868175506591797 time for calcul the mask position with numpy : 0.005081653594970703 nb_pixel_total : 15890 time to create 1 rle with old method : 0.01726078987121582 time for calcul the mask position with numpy : 0.0049591064453125 nb_pixel_total : 10248 time to create 1 rle with old method : 0.011100292205810547 time for calcul the mask position with numpy : 0.005084037780761719 nb_pixel_total : 2529 time to create 1 rle with old method : 0.0028967857360839844 time for calcul the mask position with numpy : 0.005057334899902344 nb_pixel_total : 7796 time to create 1 rle with old method : 0.008313894271850586 create new chi : 0.4007754325866699 time to delete rle : 0.0006279945373535156 batch 1 Loaded 14 chid ids of type : 3726 Number RLEs to save : 6932 TO DO : save crop sub photo not yet done ! save time : 0.4161686897277832 nb_obj : 20 nb_hashtags : 6 time to prepare the origin masks : 1.6065986156463623 time for calcul the mask position with numpy : 0.03689861297607422 nb_pixel_total : 1251740 time to create 1 rle with new method : 0.22536253929138184 time for calcul the mask position with numpy : 0.005339622497558594 nb_pixel_total : 2242 time to create 1 rle with old method : 0.002650022506713867 time for calcul the mask position with numpy : 0.005033254623413086 nb_pixel_total : 13225 time to create 1 rle with old method : 0.014300346374511719 time for calcul the mask position with numpy : 0.004940032958984375 nb_pixel_total : 22323 time to create 1 rle with old method : 0.02472376823425293 time for calcul the mask position with numpy : 0.0050890445709228516 nb_pixel_total : 178 time to create 1 rle with old method : 0.0003879070281982422 time for calcul the mask position with numpy : 0.005177736282348633 nb_pixel_total : 20412 time to create 1 rle with old method : 0.02261042594909668 time for calcul the mask position with numpy : 0.005365133285522461 nb_pixel_total : 1278 time to create 1 rle with old method : 0.0013878345489501953 time for calcul the mask position with numpy : 0.005103349685668945 nb_pixel_total : 21403 time to create 1 rle with old method : 0.023799419403076172 time for calcul the mask position with numpy : 0.005261659622192383 nb_pixel_total : 665 time to create 1 rle with old method : 0.0007255077362060547 time for calcul the mask position with numpy : 0.005115032196044922 nb_pixel_total : 374 time to create 1 rle with old method : 0.00045418739318847656 time for calcul the mask position with numpy : 0.005192756652832031 nb_pixel_total : 568 time to create 1 rle with old method : 0.0006766319274902344 time for calcul the mask position with numpy : 0.0052585601806640625 nb_pixel_total : 897 time to create 1 rle with old method : 0.0010650157928466797 time for calcul the mask position with numpy : 0.006882667541503906 nb_pixel_total : 291675 time to create 1 rle with new method : 0.06850242614746094 time for calcul the mask position with numpy : 0.005290508270263672 nb_pixel_total : 5216 time to create 1 rle with old method : 0.006021976470947266 time for calcul the mask position with numpy : 0.005003213882446289 nb_pixel_total : 6811 time to create 1 rle with old method : 0.00830841064453125 time for calcul the mask position with numpy : 0.004992246627807617 nb_pixel_total : 1488 time to create 1 rle with old method : 0.0018069744110107422 time for calcul the mask position with numpy : 0.0051631927490234375 nb_pixel_total : 2640 time to create 1 rle with old method : 0.0030336380004882812 time for calcul the mask position with numpy : 0.0053293704986572266 nb_pixel_total : 17051 time to create 1 rle with old method : 0.020624399185180664 time for calcul the mask position with numpy : 0.0057392120361328125 nb_pixel_total : 25834 time to create 1 rle with old method : 0.042374372482299805 time for calcul the mask position with numpy : 0.00625920295715332 nb_pixel_total : 72546 time to create 1 rle with old method : 0.08818721771240234 time for calcul the mask position with numpy : 0.005427837371826172 nb_pixel_total : 3994 time to create 1 rle with old method : 0.004850625991821289 create new chi : 0.7149968147277832 time to delete rle : 0.0008683204650878906 batch 1 Loaded 21 chid ids of type : 3726 Number RLEs to save : 8555 TO DO : save crop sub photo not yet done ! save time : 0.5121035575866699 nb_obj : 10 nb_hashtags : 5 time to prepare the origin masks : 0.6585416793823242 time for calcul the mask position with numpy : 0.013919353485107422 nb_pixel_total : 1302819 time to create 1 rle with new method : 0.02785205841064453 time for calcul the mask position with numpy : 0.005108833312988281 nb_pixel_total : 4078 time to create 1 rle with old method : 0.004556417465209961 time for calcul the mask position with numpy : 0.00503087043762207 nb_pixel_total : 3956 time to create 1 rle with old method : 0.0046253204345703125 time for calcul the mask position with numpy : 0.005217075347900391 nb_pixel_total : 314 time to create 1 rle with old method : 0.00038909912109375 time for calcul the mask position with numpy : 0.005328178405761719 nb_pixel_total : 2733 time to create 1 rle with old method : 0.0037610530853271484 time for calcul the mask position with numpy : 0.005816221237182617 nb_pixel_total : 3763 time to create 1 rle with old method : 0.0062999725341796875 time for calcul the mask position with numpy : 0.008202791213989258 nb_pixel_total : 308891 time to create 1 rle with new method : 0.028403043746948242 time for calcul the mask position with numpy : 0.005860328674316406 nb_pixel_total : 24169 time to create 1 rle with old method : 0.033788204193115234 time for calcul the mask position with numpy : 0.005302906036376953 nb_pixel_total : 5475 time to create 1 rle with old method : 0.006308794021606445 time for calcul the mask position with numpy : 0.005707740783691406 nb_pixel_total : 89395 time to create 1 rle with old method : 0.09929537773132324 time for calcul the mask position with numpy : 0.005379676818847656 nb_pixel_total : 16967 time to create 1 rle with old method : 0.019188880920410156 create new chi : 0.316913366317749 time to delete rle : 0.0005803108215332031 batch 1 Loaded 11 chid ids of type : 3726 Number RLEs to save : 6336 TO DO : save crop sub photo not yet done ! save time : 0.3785970211029053 nb_obj : 8 nb_hashtags : 3 time to prepare the origin masks : 0.6620213985443115 time for calcul the mask position with numpy : 0.019826173782348633 nb_pixel_total : 1390066 time to create 1 rle with new method : 0.04119586944580078 time for calcul the mask position with numpy : 0.0053615570068359375 nb_pixel_total : 47549 time to create 1 rle with old method : 0.053401947021484375 time for calcul the mask position with numpy : 0.006104946136474609 nb_pixel_total : 124994 time to create 1 rle with old method : 0.1391892433166504 time for calcul the mask position with numpy : 0.005081653594970703 nb_pixel_total : 565 time to create 1 rle with old method : 0.0006611347198486328 time for calcul the mask position with numpy : 0.005243062973022461 nb_pixel_total : 64949 time to create 1 rle with old method : 0.07081151008605957 time for calcul the mask position with numpy : 0.008902549743652344 nb_pixel_total : 19394 time to create 1 rle with old method : 0.023778676986694336 time for calcul the mask position with numpy : 0.005101919174194336 nb_pixel_total : 255 time to create 1 rle with old method : 0.0002875328063964844 time for calcul the mask position with numpy : 0.00545811653137207 nb_pixel_total : 106363 time to create 1 rle with old method : 0.11398744583129883 time for calcul the mask position with numpy : 0.004946708679199219 nb_pixel_total : 8425 time to create 1 rle with old method : 0.009212255477905273 create new chi : 0.5194933414459229 time to delete rle : 0.0006020069122314453 batch 1 Loaded 9 chid ids of type : 3726 Number RLEs to save : 6085 TO DO : save crop sub photo not yet done ! save time : 0.3758668899536133 nb_obj : 10 nb_hashtags : 4 time to prepare the origin masks : 0.8379323482513428 time for calcul the mask position with numpy : 0.015751123428344727 nb_pixel_total : 1248714 time to create 1 rle with new method : 0.07022690773010254 time for calcul the mask position with numpy : 0.005385637283325195 nb_pixel_total : 13263 time to create 1 rle with old method : 0.014748811721801758 time for calcul the mask position with numpy : 0.007293224334716797 nb_pixel_total : 305976 time to create 1 rle with new method : 0.10118865966796875 time for calcul the mask position with numpy : 0.005342721939086914 nb_pixel_total : 19167 time to create 1 rle with old method : 0.021127939224243164 time for calcul the mask position with numpy : 0.005757331848144531 nb_pixel_total : 89527 time to create 1 rle with old method : 0.1151731014251709 time for calcul the mask position with numpy : 0.0063054561614990234 nb_pixel_total : 1860 time to create 1 rle with old method : 0.0023963451385498047 time for calcul the mask position with numpy : 0.0067157745361328125 nb_pixel_total : 17126 time to create 1 rle with old method : 0.02521491050720215 time for calcul the mask position with numpy : 0.010019540786743164 nb_pixel_total : 17371 time to create 1 rle with old method : 0.024304628372192383 time for calcul the mask position with numpy : 0.007105112075805664 nb_pixel_total : 22444 time to create 1 rle with old method : 0.02945852279663086 time for calcul the mask position with numpy : 0.005116462707519531 nb_pixel_total : 4643 time to create 1 rle with old method : 0.00529932975769043 time for calcul the mask position with numpy : 0.005358695983886719 nb_pixel_total : 22469 time to create 1 rle with old method : 0.02489185333251953 create new chi : 0.5232744216918945 time to delete rle : 0.0007445812225341797 batch 1 Loaded 11 chid ids of type : 3726 Number RLEs to save : 6489 TO DO : save crop sub photo not yet done ! save time : 0.40726327896118164 map_output_result : {1389762934: (0.0, 'Should be the crop_list due to order', 0), 1389762902: (0.0, 'Should be the crop_list due to order', 0), 1389762884: (0.0, 'Should be the crop_list due to order', 0), 1389762881: (0.0, 'Should be the crop_list due to order', 0), 1389762878: (0.0, 'Should be the crop_list due to order', 0), 1389762876: (0.0, 'Should be the crop_list due to order', 0), 1389762873: (0.0, 'Should be the crop_list due to order', 0), 1389762870: (0.0, 'Should be the crop_list due to order', 0), 1389762860: (0.0, 'Should be the crop_list due to order', 0), 1389762856: (0.0, 'Should be the crop_list due to order', 0), 1389762852: (0.0, 'Should be the crop_list due to order', 0), 1389762849: (0.0, 'Should be the crop_list due to order', 0), 1389762839: (0.0, 'Should be the crop_list due to order', 0), 1389762835: (0.0, 'Should be the crop_list due to order', 0), 1389762831: (0.0, 'Should be the crop_list due to order', 0), 1389762822: (0.0, 'Should be the crop_list due to order', 0), 1389762819: (0.0, 'Should be the crop_list due to order', 0), 1389762817: (0.0, 'Should be the crop_list due to order', 0), 1389762814: (0.0, 'Should be the crop_list due to order', 0), 1389762810: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1389762934, 1389762902, 1389762884, 1389762881, 1389762878, 1389762876, 1389762873, 1389762870, 1389762860, 1389762856, 1389762852, 1389762849, 1389762839, 1389762835, 1389762831, 1389762822, 1389762819, 1389762817, 1389762814, 1389762810] Looping around the photos to save general results len do output : 20 /1389762934.Didn't retrieve data . /1389762902.Didn't retrieve data . /1389762884.Didn't retrieve data . /1389762881.Didn't retrieve data . /1389762878.Didn't retrieve data . /1389762876.Didn't retrieve data . /1389762873.Didn't retrieve data . /1389762870.Didn't retrieve data . /1389762860.Didn't retrieve data . /1389762856.Didn't retrieve data . /1389762852.Didn't retrieve data . /1389762849.Didn't retrieve data . /1389762839.Didn't retrieve data . /1389762835.Didn't retrieve data . /1389762831.Didn't retrieve data . /1389762822.Didn't retrieve data . /1389762819.Didn't retrieve data . /1389762817.Didn't retrieve data . /1389762814.Didn't retrieve data . /1389762810.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762934', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762902', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762884', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762881', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762878', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762876', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762873', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762870', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762860', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762856', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762852', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762849', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762839', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762835', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762831', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762822', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762819', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762817', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762814', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762810', None, None, None, None, None, '3986890') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 60 time used for this insertion : 0.014917373657226562 save_final save missing photos in datou_result : time spend for datou_step_exec : 46.38486289978027 time spend to save output : 0.015679121017456055 total time spend for step 5 : 46.40054202079773 step6:crop_condition Tue Nov 4 09:22:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 3726 Loading chi in step crop for list_pids : 20 ! batch 1 Loaded 263 chid ids of type : 3726 begin to crop the class : teint_dans_la_masse param for this class : {'min_score': 0.7} filtre for class : teint_dans_la_masse hashtag_id of this class : 2107752385 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 13 About to insert : list_path_to_insert length 13 new photo from crops ! About to upload 13 photos upload in portfolio : 4869462 init cache_photo without model_param we have 13 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762244528_4110142 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244531), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762884_f6d3aef5a9182619dcba8cfec92db671_rle_crop_4018866796_0.png', 0, 236, 305, 0, 1762244531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244531), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762881_cb1f44ce2c536a36f45d2ebb8d960eee_rle_crop_4018866853_0.png', 0, 282, 207, 0, 1762244531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244531), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762873_36adad963d3386ac28d8d974317b9f18_rle_crop_4018867104_0.png', 0, 118, 96, 0, 1762244531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244531), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762852_8c57b50dd8ac3fedcfb7a10f6bdefbae_rle_crop_4018867168_0.png', 0, 170, 87, 0, 1762244531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244531), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762839_721896cecbb73d1db999809844a3ff2f_rle_crop_4018867204_0.png', 0, 235, 191, 0, 1762244531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244531), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762831_249153396527d826650e8c084472d60d_rle_crop_4018867698_0.png', 0, 203, 221, 0, 1762244531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244531), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762822_80a55a41c41c2c941d5f92a7e6e48190_rle_crop_4018867713_0.png', 0, 152, 149, 0, 1762244531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244531), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762822_80a55a41c41c2c941d5f92a7e6e48190_rle_crop_4018867709_0.png', 0, 96, 52, 0, 1762244531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244531), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762819_924b44e4fe00a792040d2755bff39f04_rle_crop_4018867734_0.png', 0, 163, 138, 0, 1762244531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244531), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762819_924b44e4fe00a792040d2755bff39f04_rle_crop_4018867731_0.png', 0, 128, 119, 0, 1762244531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244531), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762817_f9f9055a219e1c6826b448682821cf6a_rle_crop_4018867748_0.png', 0, 196, 128, 0, 1762244531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244531), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762810_df7dbb1b4e6cdc152a6fa58e4311c623_rle_crop_4018867765_0.png', 0, 177, 179, 0, 1762244531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244531), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762810_df7dbb1b4e6cdc152a6fa58e4311c623_rle_crop_4018867759_0.png', 0, 164, 107, 0, 1762244531,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 13 photos in the portfolio 4869462 time of upload the photos Elapsed time : 3.91619610786438 we have finished the crop for the class : teint_dans_la_masse begin to crop the class : autre_refus param for this class : {'min_score': 0.5} filtre for class : autre_refus hashtag_id of this class : 2107752406 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762244533_4110142 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244533), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762870_ee516a696956f13ea81155b2a2d3d359_rle_crop_4018867130_0.png', 0, 138, 119, 0, 1762244533,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244533), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762839_721896cecbb73d1db999809844a3ff2f_rle_crop_4018867195_0.png', 0, 57, 107, 0, 1762244533,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.8160595893859863 we have finished the crop for the class : autre_refus begin to crop the class : carton_gris param for this class : {'min_score': 0.5} filtre for class : carton_gris hashtag_id of this class : 2107753020 Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 4869462 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762244535_4110142 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244536), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762878_159f3a03355ec1b938794618b2ee1744_rle_crop_4018866882_0.png', 0, 137, 172, 0, 1762244536,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244536), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762870_ee516a696956f13ea81155b2a2d3d359_rle_crop_4018867136_0.png', 0, 172, 104, 0, 1762244536,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244536), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762856_fc510e7f6f32df3a647eea2043787c63_rle_crop_4018867155_0.png', 0, 98, 112, 0, 1762244536,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244536), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762822_80a55a41c41c2c941d5f92a7e6e48190_rle_crop_4018867707_0.png', 0, 98, 132, 0, 1762244536,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244536), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762819_924b44e4fe00a792040d2755bff39f04_rle_crop_4018867724_0.png', 0, 235, 188, 0, 1762244536,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 5 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.629227876663208 we have finished the crop for the class : carton_gris begin to crop the class : cartonnette param for this class : {'min_score': 0.5} filtre for class : cartonnette hashtag_id of this class : 702398920 Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 4869462 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762244537_4110142 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244539), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762881_cb1f44ce2c536a36f45d2ebb8d960eee_rle_crop_4018866844_0.png', 0, 135, 236, 0, 1762244539,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244539), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762878_159f3a03355ec1b938794618b2ee1744_rle_crop_4018866893_0.png', 0, 127, 243, 0, 1762244539,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244539), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762878_159f3a03355ec1b938794618b2ee1744_rle_crop_4018866879_0.png', 0, 81, 79, 0, 1762244539,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244539), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762849_56af5703e6a105770162c3375909b81b_rle_crop_4018867178_0.png', 0, 321, 290, 0, 1762244539,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244539), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762817_f9f9055a219e1c6826b448682821cf6a_rle_crop_4018867740_0.png', 0, 100, 68, 0, 1762244539,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 5 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.0023350715637207 we have finished the crop for the class : cartonnette begin to crop the class : carton_brun param for this class : {'min_score': 0.7} filtre for class : carton_brun hashtag_id of this class : 2107753024 Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 4869462 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762244540_4110142 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244541), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762884_f6d3aef5a9182619dcba8cfec92db671_rle_crop_4018866797_0.png', 0, 114, 127, 0, 1762244541,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244541), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762873_36adad963d3386ac28d8d974317b9f18_rle_crop_4018867105_0.png', 0, 34, 46, 0, 1762244541,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244541), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762849_56af5703e6a105770162c3375909b81b_rle_crop_4018867184_0.png', 0, 119, 145, 0, 1762244541,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244541), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762819_924b44e4fe00a792040d2755bff39f04_rle_crop_4018867730_0.png', 0, 96, 99, 0, 1762244541,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 4 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.2071967124938965 we have finished the crop for the class : carton_brun begin to crop the class : plastique param for this class : {'min_score': 0.5} filtre for class : plastique hashtag_id of this class : 492725882 Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 4869462 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1762244542_4110142 INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244543), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762878_159f3a03355ec1b938794618b2ee1744_rle_crop_4018866881_0.png', 0, 128, 130, 0, 1762244543,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244543), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762831_249153396527d826650e8c084472d60d_rle_crop_4018867691_0.png', 0, 188, 122, 0, 1762244543,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244543), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762822_80a55a41c41c2c941d5f92a7e6e48190_rle_crop_4018867714_0.png', 0, 113, 142, 0, 1762244543,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244543), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762814_c35c726a87b33d666fda3a6eebf6464b_rle_crop_4018867754_0.png', 0, 218, 122, 0, 1762244543,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! INSERT INTO MTRBack.photos (`timeStamp`, `latitude`, `longitude`, `right_categories`, `tags`, `speed`, `size`, `text`, `altitude`, `width`, `height`, `score`, `created_at`,`source_id`,`place_id`) VALUES (FROM_UNIXTIME(1762244543), 0.0, 0.0, 14, '', 0, 0, '1762244369_4110142_1389762810_df7dbb1b4e6cdc152a6fa58e4311c623_rle_crop_4018867764_0.png', 0, 177, 148, 0, 1762244543,'0',0) batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 5 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.749568223953247 we have finished the crop for the class : plastique begin to crop the class : kraft param for this class : {'min_score': 0.5} filtre for class : kraft hashtag_id of this class : 493202403 begin to crop the class : metal param for this class : {'min_score': 0.5} filtre for class : metal hashtag_id of this class : 492628673 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1389762934, 1389762902, 1389762884, 1389762881, 1389762878, 1389762876, 1389762873, 1389762870, 1389762860, 1389762856, 1389762852, 1389762849, 1389762839, 1389762835, 1389762831, 1389762822, 1389762819, 1389762817, 1389762814, 1389762810] Looping around the photos to save general results len do output : 34 /1392347329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1392347374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762934', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762902', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762884', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762881', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762878', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762876', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762873', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762870', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762860', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762856', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762852', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762849', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762839', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762835', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762831', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762822', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762819', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762817', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762814', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762810', None, None, None, None, None, '3986890') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 122 time used for this insertion : 0.03634357452392578 save_final save missing photos in datou_result : time spend for datou_step_exec : 19.000808477401733 time spend to save output : 0.03746819496154785 total time spend for step 6 : 19.03827667236328 step7:ventilate_hashtags_in_portfolio Tue Nov 4 09:22:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! To do loadFromThcl(), then load ParamDescType : thcl2725 thcls : [{'id': 2725, 'mtr_user_id': 31, 'name': 'learn_qualipapia_rle_210302_2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,environnement,kraft,metal,papier,plastique', 'svm_portfolios_learning': '3460440,3460441,3460446,3460434,3460439,3467416,3460442,3460443,3486028,3460445', 'photo_hashtag_type': 3410, 'photo_desc_type': 5186, 'type_classification': 'caffe', 'hashtag_id_list': '2107753024,2107753020,2107752385,2107752406,702398920,493012381,493202403,492628673,492668766,492725882'}] thcl {'id': 2725, 'mtr_user_id': 31, 'name': 'learn_qualipapia_rle_210302_2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,environnement,kraft,metal,papier,plastique', 'svm_portfolios_learning': '3460440,3460441,3460446,3460434,3460439,3467416,3460442,3460443,3486028,3460445', 'photo_hashtag_type': 3410, 'photo_desc_type': 5186, 'type_classification': 'caffe', 'hashtag_id_list': '2107753024,2107753020,2107752385,2107752406,702398920,493012381,493202403,492628673,492668766,492725882'} Update svm_hashtag_type_desc : 5186 Iterating over portfolio : 27871581 get user id for portfolio 27871581 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27871581 AND mptpi.`type`=3726 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre_refus','cartonnette','environnement','Carton_brun','Carton_gris','flou','mal_croppe','plastique','metal','kraft','Teint_Dans_La_Masse','papier')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27871581 AND mptpi.`type`=3726 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre_refus','cartonnette','environnement','Carton_brun','Carton_gris','flou','mal_croppe','plastique','metal','kraft','Teint_Dans_La_Masse','papier')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://marlene.fotonower.com/velours/27872108,27872115,27872122,27872132,27872138,27872145,27872148,27872151,27872156,27872162,27872167,27872172?tags=kraft,autre_refus,flou,mal_croppe,cartonnette,papier,plastique,Teint_Dans_La_Masse,Carton_brun,metal,environnement,Carton_gris Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1389762934, 1389762902, 1389762884, 1389762881, 1389762878, 1389762876, 1389762873, 1389762870, 1389762860, 1389762856, 1389762852, 1389762849, 1389762839, 1389762835, 1389762831, 1389762822, 1389762819, 1389762817, 1389762814, 1389762810] Looping around the photos to save general results len do output : 1 /27871581. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762934', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762902', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762884', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762881', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762878', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762876', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762873', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762870', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762860', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762856', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762852', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762849', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762839', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762835', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762831', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762822', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762819', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762817', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762814', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762810', None, None, None, None, None, '3986890') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.02135491371154785 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.4418799877166748 time spend to save output : 0.021728515625 total time spend for step 7 : 0.4636085033416748 step8:final Tue Nov 4 09:22:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1389762934: ('0.04226402857544025',), 1389762902: ('0.04226402857544025',), 1389762884: ('0.04226402857544025',), 1389762881: ('0.04226402857544025',), 1389762878: ('0.04226402857544025',), 1389762876: ('0.04226402857544025',), 1389762873: ('0.04226402857544025',), 1389762870: ('0.04226402857544025',), 1389762860: ('0.04226402857544025',), 1389762856: ('0.04226402857544025',), 1389762852: ('0.04226402857544025',), 1389762849: ('0.04226402857544025',), 1389762839: ('0.04226402857544025',), 1389762835: ('0.04226402857544025',), 1389762831: ('0.04226402857544025',), 1389762822: ('0.04226402857544025',), 1389762819: ('0.04226402857544025',), 1389762817: ('0.04226402857544025',), 1389762814: ('0.04226402857544025',), 1389762810: ('0.04226402857544025',)} new output for save of step final : {1389762934: ('0.04226402857544025',), 1389762902: ('0.04226402857544025',), 1389762884: ('0.04226402857544025',), 1389762881: ('0.04226402857544025',), 1389762878: ('0.04226402857544025',), 1389762876: ('0.04226402857544025',), 1389762873: ('0.04226402857544025',), 1389762870: ('0.04226402857544025',), 1389762860: ('0.04226402857544025',), 1389762856: ('0.04226402857544025',), 1389762852: ('0.04226402857544025',), 1389762849: ('0.04226402857544025',), 1389762839: ('0.04226402857544025',), 1389762835: ('0.04226402857544025',), 1389762831: ('0.04226402857544025',), 1389762822: ('0.04226402857544025',), 1389762819: ('0.04226402857544025',), 1389762817: ('0.04226402857544025',), 1389762814: ('0.04226402857544025',), 1389762810: ('0.04226402857544025',)} [1389762934, 1389762902, 1389762884, 1389762881, 1389762878, 1389762876, 1389762873, 1389762870, 1389762860, 1389762856, 1389762852, 1389762849, 1389762839, 1389762835, 1389762831, 1389762822, 1389762819, 1389762817, 1389762814, 1389762810] Looping around the photos to save general results len do output : 20 /1389762934.Didn't retrieve data . /1389762902.Didn't retrieve data . /1389762884.Didn't retrieve data . /1389762881.Didn't retrieve data . /1389762878.Didn't retrieve data . /1389762876.Didn't retrieve data . /1389762873.Didn't retrieve data . /1389762870.Didn't retrieve data . /1389762860.Didn't retrieve data . /1389762856.Didn't retrieve data . /1389762852.Didn't retrieve data . /1389762849.Didn't retrieve data . /1389762839.Didn't retrieve data . /1389762835.Didn't retrieve data . /1389762831.Didn't retrieve data . /1389762822.Didn't retrieve data . /1389762819.Didn't retrieve data . /1389762817.Didn't retrieve data . /1389762814.Didn't retrieve data . /1389762810.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762934', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762902', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762884', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762881', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762878', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762876', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762873', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762870', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762860', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762856', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762852', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762849', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762839', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762835', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762831', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762822', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762819', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762817', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762814', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762810', None, None, None, None, None, '3986890') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 60 time used for this insertion : 0.015074968338012695 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11723637580871582 time spend to save output : 0.01597118377685547 total time spend for step 8 : 0.1332075595855713 step9:velours_tree Tue Nov 4 09:22:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.03600931167602539 time spend to save output : 3.337860107421875e-05 total time spend for step 9 : 0.03604269027709961 step10:send_mail_cod Tue Nov 4 09:22:26 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin in order to get the selector url, please entre the license of selector results_Auto_P27871581_04-11-2025_09_22_26.pdf 27872108 imagette278721081762244546 27872115 change filename to text .change filename to text .imagette278721151762244546 27872122 imagette278721221762244546 27872132 imagette278721321762244546 27872138 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette278721381762244546 27872148 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette278721481762244546 27872162 imagette278721621762244546 27872151 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette278721511762244546 27872156 change filename to text .change filename to text .change filename to text .change filename to text .imagette278721561762244547 27872172 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette278721721762244548 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=27871581 and hashtag_type = 3726 and pcr.hashtag_id = h.hashtag_id; velour_link : https://marlene.fotonower.com/velours/27872108,27872115,27872122,27872132,27872138,27872145,27872148,27872151,27872156,27872162,27872167,27872172?tags=kraft,autre_refus,flou,mal_croppe,cartonnette,papier,plastique,Teint_Dans_La_Masse,Carton_brun,metal,environnement,Carton_gris your option no_mail is active, we will not send the real mail to your client args[1389762934] : ('0.04226402857544025',) no score found for photo 1389762934 We are sending mail with results at report@fotonower.com args[1389762902] : ('0.04226402857544025',) no score found for photo 1389762902 We are sending mail with results at report@fotonower.com args[1389762884] : ('0.04226402857544025',) no score found for photo 1389762884 We are sending mail with results at report@fotonower.com args[1389762881] : ('0.04226402857544025',) no score found for photo 1389762881 We are sending mail with results at report@fotonower.com args[1389762878] : ('0.04226402857544025',) no score found for photo 1389762878 We are sending mail with results at report@fotonower.com args[1389762876] : ('0.04226402857544025',) no score found for photo 1389762876 We are sending mail with results at report@fotonower.com args[1389762873] : ('0.04226402857544025',) no score found for photo 1389762873 We are sending mail with results at report@fotonower.com args[1389762870] : ('0.04226402857544025',) no score found for photo 1389762870 We are sending mail with results at report@fotonower.com args[1389762860] : ('0.04226402857544025',) no score found for photo 1389762860 We are sending mail with results at report@fotonower.com args[1389762856] : ('0.04226402857544025',) no score found for photo 1389762856 We are sending mail with results at report@fotonower.com args[1389762852] : ('0.04226402857544025',) no score found for photo 1389762852 We are sending mail with results at report@fotonower.com args[1389762849] : ('0.04226402857544025',) no score found for photo 1389762849 We are sending mail with results at report@fotonower.com args[1389762839] : ('0.04226402857544025',) no score found for photo 1389762839 We are sending mail with results at report@fotonower.com args[1389762835] : ('0.04226402857544025',) no score found for photo 1389762835 We are sending mail with results at report@fotonower.com args[1389762831] : ('0.04226402857544025',) no score found for photo 1389762831 We are sending mail with results at report@fotonower.com args[1389762822] : ('0.04226402857544025',) no score found for photo 1389762822 We are sending mail with results at report@fotonower.com args[1389762819] : ('0.04226402857544025',) no score found for photo 1389762819 We are sending mail with results at report@fotonower.com args[1389762817] : ('0.04226402857544025',) no score found for photo 1389762817 We are sending mail with results at report@fotonower.com args[1389762814] : ('0.04226402857544025',) no score found for photo 1389762814 We are sending mail with results at report@fotonower.com args[1389762810] : ('0.04226402857544025',) no score found for photo 1389762810 We are sending mail with results at report@fotonower.com refus_total : 0.04226402857544025 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos_view ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=27871581 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27871581_04-11-2025_09_22_26.pdf results_Auto_P27871581_04-11-2025_09_22_26.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27871581_04-11-2025_09_22_26.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3459','27871581','results_Auto_P27871581_04-11-2025_09_22_26.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27871581_04-11-2025_09_22_26.pdf','pdf','','0.26','0.04226402857544025') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1389762934, 1389762902, 1389762884, 1389762881, 1389762878, 1389762876, 1389762873, 1389762870, 1389762860, 1389762856, 1389762852, 1389762849, 1389762839, 1389762835, 1389762831, 1389762822, 1389762819, 1389762817, 1389762814, 1389762810] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762934', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762902', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762884', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762881', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762878', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762876', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762873', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762870', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762860', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762856', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762852', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762849', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762839', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762835', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762831', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762822', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762819', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762817', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762814', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762810', None, None, None, None, None, '3986890') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 20 time used for this insertion : 0.017294645309448242 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.006547927856445 time spend to save output : 0.017619848251342773 total time spend for step 10 : 4.024167776107788 step11:split_time_score Tue Nov 4 09:22:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('06', 81),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 17102025 27871581 Nombre de photos uploadées : 81 / 23040 (0%) 17102025 27871581 Nombre de photos taguées (types de déchets): 0 / 81 (0%) 17102025 27871581 Nombre de photos taguées (volume) : 0 / 81 (0%) elapsed_time : load_data_split_time_score 2.86102294921875e-06 elapsed_time : order_list_meta_photo_and_scores 1.0251998901367188e-05 ????????????????????????????????????????????????????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0036499500274658203 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.21271419525146484 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27870991_18-10-2025_05_34_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27870991 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27873027_17-10-2025_10_06_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27873027 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27873029_17-10-2025_10_06_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27873029 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27871053_17-10-2025_09_13_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27871053 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27873031_17-10-2025_10_06_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27873031 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27873033_18-10-2025_05_36_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27873033 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27873035_18-10-2025_05_36_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27873035 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27873037_18-10-2025_05_37_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27873037 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27871396_18-10-2025_05_37_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27871396 order by id desc limit 1 Qualite : 0.05216944116231312 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27873039_04-11-2025_09_11_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27873039 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27873039 AND mptpi.`type`=3726 To do Qualite : 0.04012631850439058 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27873041_04-11-2025_09_15_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27873041 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27873041 AND mptpi.`type`=3726 To do Qualite : 0.04749525229584136 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27871526_04-11-2025_09_16_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27871526 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27871526 AND mptpi.`type`=3726 To do Qualite : 0.022906293182411726 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27873044_04-11-2025_09_06_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27873044 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27873044 AND mptpi.`type`=3726 To do Qualite : 0.041387714743252035 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27871534_04-11-2025_09_11_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27871534 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27871534 AND mptpi.`type`=3726 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27871543_18-10-2025_05_39_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27871543 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27871551_18-10-2025_05_40_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27871551 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27871561_17-10-2025_09_20_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27871561 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27871572_18-10-2025_05_41_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27871572 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27871576_17-10-2025_09_18_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27871576 order by id desc limit 1 Qualite : 0.04226402857544025 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27871581_04-11-2025_09_22_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27871581 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=27871581 AND mptpi.`type`=3726 To do find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27871590_18-10-2025_05_41_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27871590 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27871598_17-10-2025_09_17_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27871598 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27871605_17-10-2025_09_14_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27871605 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27871619_17-10-2025_09_14_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27871619 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27871638_18-10-2025_05_43_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27871638 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27871656_18-10-2025_05_43_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27871656 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27870700_17-10-2025_08_40_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27870700 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27870807_18-10-2025_05_44_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27870807 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27870679_18-10-2025_05_45_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27870679 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27870695_18-10-2025_05_45_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27870695 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27871137_17-10-2025_14_01_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27871137 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27871563_17-10-2025_11_04_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27871563 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27872616_18-10-2025_05_46_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27872616 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27872805_18-10-2025_05_47_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27872805 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27872807_18-10-2025_05_47_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27872807 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27873114_17-10-2025_10_21_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27873114 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27874123_18-10-2025_05_48_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27874123 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27874825_17-10-2025_13_00_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27874825 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27875457_17-10-2025_13_01_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27875457 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27876116_18-10-2025_05_50_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27876116 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27876345_17-10-2025_13_01_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27876345 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27876700_18-10-2025_05_51_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27876700 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27877001_18-10-2025_05_51_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27877001 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27876781_18-10-2025_05_51_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27876781 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27880812_18-10-2025_05_51_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27880812 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27881278_18-10-2025_05_52_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27881278 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27881741_18-10-2025_05_52_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27881741 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27882357_18-10-2025_05_53_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27882357 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27882842_17-10-2025_14_49_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27882842 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27883336_17-10-2025_15_05_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27883336 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27883875_18-10-2025_05_54_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27883875 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27884777_18-10-2025_05_54_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27884777 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27885385_18-10-2025_05_55_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27885385 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27885846_18-10-2025_05_55_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27885846 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27886271_18-10-2025_05_56_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27886271 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27886760_17-10-2025_18_01_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27886760 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27887030_18-10-2025_05_56_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27887030 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27887031_18-10-2025_05_57_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27887031 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27888035_17-10-2025_18_05_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27888035 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27889036_17-10-2025_18_19_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27889036 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27889524_18-10-2025_05_58_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27889524 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27889935_18-10-2025_05_59_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27889935 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27890433_18-10-2025_05_59_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27890433 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27890884_17-10-2025_19_19_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27890884 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27891425_17-10-2025_19_33_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27891425 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27891832_18-10-2025_07_35_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27891832 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27892251_18-10-2025_07_36_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27892251 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27892704_18-10-2025_06_01_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27892704 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27893240_18-10-2025_06_02_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27893240 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27893657_18-10-2025_06_02_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27893657 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27894349_18-10-2025_06_02_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27894349 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27894482_18-10-2025_06_03_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27894482 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27895188_18-10-2025_06_03_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27895188 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27895657_18-10-2025_06_03_39.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27895657 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27896399_18-10-2025_06_04_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27896399 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27896637_18-10-2025_06_04_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27896637 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P27896729_18-10-2025_06_05_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 27896729 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'17102025': {'nb_upload': 81, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1389762934, 1389762902, 1389762884, 1389762881, 1389762878, 1389762876, 1389762873, 1389762870, 1389762860, 1389762856, 1389762852, 1389762849, 1389762839, 1389762835, 1389762831, 1389762822, 1389762819, 1389762817, 1389762814, 1389762810] Looping around the photos to save general results len do output : 1 /27871581Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762934', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762902', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762884', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762881', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762878', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762876', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762873', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762870', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762860', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762856', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762852', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762849', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762839', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762835', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762831', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762822', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762819', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762817', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762814', None, None, None, None, None, '3986890') ('3459', None, None, None, None, None, None, None, '3986890') ('3459', '27871581', '1389762810', None, None, None, None, None, '3986890') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 21 time used for this insertion : 0.021617650985717773 save_final save missing photos in datou_result : time spend for datou_step_exec : 49.10229539871216 time spend to save output : 0.021915674209594727 total time spend for step 11 : 49.12421107292175 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 102.30user 49.36system 3:52.07elapsed 65%CPU (0avgtext+0avgdata 3298884maxresident)k 828896inputs+50904outputs (1513major+4003299minor)pagefaults 0swaps