python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 832666 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['3546730'] with mtr_portfolio_ids : ['26021624'] and first list_photo_ids : [] new path : /proc/832666/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 6 ; length of list_pids : 6 ; length of list_args : 6 time to download the photos : 1.2045261859893799 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Aug 15 10:10:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 6618 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-08-15 10:10:31.682967: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-08-15 10:10:31.708569: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3492910000 Hz 2025-08-15 10:10:31.710805: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f6250000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-08-15 10:10:31.710865: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-08-15 10:10:31.714739: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-08-15 10:10:31.848480: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x15124230 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-08-15 10:10:31.848517: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-08-15 10:10:31.849303: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-15 10:10:31.849586: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-15 10:10:31.851592: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-15 10:10:31.857180: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-15 10:10:31.857504: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-15 10:10:31.860037: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-15 10:10:31.861297: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-15 10:10:31.866719: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-15 10:10:31.868003: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-15 10:10:31.868086: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-15 10:10:31.868786: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-15 10:10:31.868804: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-15 10:10:31.868814: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-15 10:10:31.869956: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6076 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-08-15 10:10:32.135884: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-15 10:10:32.135993: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-15 10:10:32.136011: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-15 10:10:32.136027: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-15 10:10:32.136041: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-15 10:10:32.136056: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-15 10:10:32.136070: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-15 10:10:32.136085: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-15 10:10:32.137119: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-15 10:10:32.138226: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-08-15 10:10:32.138256: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-08-15 10:10:32.138272: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-15 10:10:32.138286: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-08-15 10:10:32.138299: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-08-15 10:10:32.138313: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-08-15 10:10:32.138327: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-08-15 10:10:32.138341: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-08-15 10:10:32.139349: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-08-15 10:10:32.139383: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-08-15 10:10:32.139392: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-08-15 10:10:32.139400: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-08-15 10:10:32.140469: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 6076 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-08-15 10:10:39.585739: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-08-15 10:10:39.734110: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 6 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 48 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3840, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3840.00000 nb d'objets trouves : 44 Detection mask done ! Trying to reset tf kernel 833168 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1548 tf kernel not reseted sub process len(results) : 6 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 6 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 6837 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.004158973693847656 nb_pixel_total : 148755 time to create 1 rle with old method : 0.16764426231384277 length of segment : 566 time for calcul the mask position with numpy : 0.0005497932434082031 nb_pixel_total : 28857 time to create 1 rle with old method : 0.03250932693481445 length of segment : 235 time for calcul the mask position with numpy : 0.0007433891296386719 nb_pixel_total : 50100 time to create 1 rle with old method : 0.05571627616882324 length of segment : 269 time for calcul the mask position with numpy : 0.0004811286926269531 nb_pixel_total : 33135 time to create 1 rle with old method : 0.03699350357055664 length of segment : 231 time for calcul the mask position with numpy : 0.00047969818115234375 nb_pixel_total : 25518 time to create 1 rle with old method : 0.028980255126953125 length of segment : 231 time for calcul the mask position with numpy : 0.00025582313537597656 nb_pixel_total : 11549 time to create 1 rle with old method : 0.013312101364135742 length of segment : 131 time for calcul the mask position with numpy : 0.0005125999450683594 nb_pixel_total : 31183 time to create 1 rle with old method : 0.0359644889831543 length of segment : 265 time for calcul the mask position with numpy : 0.0011758804321289062 nb_pixel_total : 58544 time to create 1 rle with old method : 0.0640401840209961 length of segment : 256 time for calcul the mask position with numpy : 0.00035500526428222656 nb_pixel_total : 19860 time to create 1 rle with old method : 0.022305011749267578 length of segment : 291 time for calcul the mask position with numpy : 0.00027561187744140625 nb_pixel_total : 14449 time to create 1 rle with old method : 0.015943527221679688 length of segment : 196 time for calcul the mask position with numpy : 0.0007381439208984375 nb_pixel_total : 46673 time to create 1 rle with old method : 0.05116415023803711 length of segment : 345 time for calcul the mask position with numpy : 0.004364728927612305 nb_pixel_total : 212450 time to create 1 rle with new method : 0.011548757553100586 length of segment : 501 time for calcul the mask position with numpy : 0.0009567737579345703 nb_pixel_total : 33451 time to create 1 rle with old method : 0.03800559043884277 length of segment : 223 time for calcul the mask position with numpy : 0.0011591911315917969 nb_pixel_total : 74322 time to create 1 rle with old method : 0.08094930648803711 length of segment : 449 time for calcul the mask position with numpy : 0.0004990100860595703 nb_pixel_total : 35560 time to create 1 rle with old method : 0.042458295822143555 length of segment : 207 time for calcul the mask position with numpy : 0.0011913776397705078 nb_pixel_total : 51432 time to create 1 rle with old method : 0.057337045669555664 length of segment : 314 time for calcul the mask position with numpy : 0.000881195068359375 nb_pixel_total : 40792 time to create 1 rle with old method : 0.044089555740356445 length of segment : 365 time for calcul the mask position with numpy : 0.002972126007080078 nb_pixel_total : 157979 time to create 1 rle with new method : 0.011302709579467773 length of segment : 651 time for calcul the mask position with numpy : 0.0004525184631347656 nb_pixel_total : 31889 time to create 1 rle with old method : 0.0350346565246582 length of segment : 241 time for calcul the mask position with numpy : 0.0002307891845703125 nb_pixel_total : 11634 time to create 1 rle with old method : 0.013296842575073242 length of segment : 132 time for calcul the mask position with numpy : 0.0005474090576171875 nb_pixel_total : 30972 time to create 1 rle with old method : 0.03449654579162598 length of segment : 273 time for calcul the mask position with numpy : 0.0006911754608154297 nb_pixel_total : 46614 time to create 1 rle with old method : 0.052042484283447266 length of segment : 219 time for calcul the mask position with numpy : 0.0008542537689208984 nb_pixel_total : 55375 time to create 1 rle with old method : 0.059478759765625 length of segment : 380 time for calcul the mask position with numpy : 0.00022792816162109375 nb_pixel_total : 11354 time to create 1 rle with old method : 0.012876749038696289 length of segment : 141 time for calcul the mask position with numpy : 0.0005843639373779297 nb_pixel_total : 32838 time to create 1 rle with old method : 0.03612470626831055 length of segment : 274 time for calcul the mask position with numpy : 0.0011646747589111328 nb_pixel_total : 30438 time to create 1 rle with old method : 0.03595852851867676 length of segment : 623 time for calcul the mask position with numpy : 0.001481771469116211 nb_pixel_total : 75039 time to create 1 rle with old method : 0.08195042610168457 length of segment : 619 time for calcul the mask position with numpy : 0.0007228851318359375 nb_pixel_total : 43327 time to create 1 rle with old method : 0.0529019832611084 length of segment : 227 time for calcul the mask position with numpy : 0.0006594657897949219 nb_pixel_total : 27044 time to create 1 rle with old method : 0.0326535701751709 length of segment : 215 time for calcul the mask position with numpy : 0.000461578369140625 nb_pixel_total : 30834 time to create 1 rle with old method : 0.03714179992675781 length of segment : 162 time for calcul the mask position with numpy : 0.0008504390716552734 nb_pixel_total : 44277 time to create 1 rle with old method : 0.051690101623535156 length of segment : 358 time for calcul the mask position with numpy : 0.0004057884216308594 nb_pixel_total : 20192 time to create 1 rle with old method : 0.02340221405029297 length of segment : 268 time for calcul the mask position with numpy : 0.0005402565002441406 nb_pixel_total : 36315 time to create 1 rle with old method : 0.041017770767211914 length of segment : 340 time for calcul the mask position with numpy : 0.0022690296173095703 nb_pixel_total : 142234 time to create 1 rle with old method : 0.15623807907104492 length of segment : 461 time for calcul the mask position with numpy : 0.0013973712921142578 nb_pixel_total : 68814 time to create 1 rle with old method : 0.09178972244262695 length of segment : 446 time for calcul the mask position with numpy : 0.0026874542236328125 nb_pixel_total : 140141 time to create 1 rle with old method : 0.16281914710998535 length of segment : 477 time for calcul the mask position with numpy : 0.0012640953063964844 nb_pixel_total : 69402 time to create 1 rle with old method : 0.07860398292541504 length of segment : 413 time for calcul the mask position with numpy : 0.0006561279296875 nb_pixel_total : 27276 time to create 1 rle with old method : 0.04506349563598633 length of segment : 211 time for calcul the mask position with numpy : 0.0037126541137695312 nb_pixel_total : 137011 time to create 1 rle with old method : 0.16109895706176758 length of segment : 955 time for calcul the mask position with numpy : 0.002463102340698242 nb_pixel_total : 129326 time to create 1 rle with old method : 0.14736628532409668 length of segment : 449 time for calcul the mask position with numpy : 0.0011518001556396484 nb_pixel_total : 31905 time to create 1 rle with old method : 0.04138779640197754 length of segment : 290 time for calcul the mask position with numpy : 0.0036971569061279297 nb_pixel_total : 81314 time to create 1 rle with old method : 0.08941793441772461 length of segment : 451 time for calcul the mask position with numpy : 0.0011310577392578125 nb_pixel_total : 38100 time to create 1 rle with old method : 0.04315042495727539 length of segment : 178 time for calcul the mask position with numpy : 0.0019714832305908203 nb_pixel_total : 49888 time to create 1 rle with old method : 0.055405378341674805 length of segment : 318 time for calcul the mask position with numpy : 0.004618167877197266 nb_pixel_total : 135267 time to create 1 rle with old method : 0.15059304237365723 length of segment : 390 time for calcul the mask position with numpy : 0.0019073486328125 nb_pixel_total : 44385 time to create 1 rle with old method : 0.05121326446533203 length of segment : 207 time for calcul the mask position with numpy : 0.0016453266143798828 nb_pixel_total : 48311 time to create 1 rle with old method : 0.054329633712768555 length of segment : 268 time for calcul the mask position with numpy : 0.0017986297607421875 nb_pixel_total : 54203 time to create 1 rle with old method : 0.06236886978149414 length of segment : 277 time for calcul the mask position with numpy : 0.00223541259765625 nb_pixel_total : 45015 time to create 1 rle with old method : 0.05006718635559082 length of segment : 291 time for calcul the mask position with numpy : 0.001546621322631836 nb_pixel_total : 40078 time to create 1 rle with old method : 0.04780125617980957 length of segment : 269 time for calcul the mask position with numpy : 0.01706719398498535 nb_pixel_total : 310157 time to create 1 rle with new method : 0.023131847381591797 length of segment : 667 time for calcul the mask position with numpy : 0.005600690841674805 nb_pixel_total : 121384 time to create 1 rle with old method : 0.13866376876831055 length of segment : 600 time for calcul the mask position with numpy : 0.0013587474822998047 nb_pixel_total : 26192 time to create 1 rle with old method : 0.029819488525390625 length of segment : 208 time for calcul the mask position with numpy : 0.004305601119995117 nb_pixel_total : 56420 time to create 1 rle with old method : 0.0630497932434082 length of segment : 763 time for calcul the mask position with numpy : 0.0030584335327148438 nb_pixel_total : 70242 time to create 1 rle with old method : 0.07946395874023438 length of segment : 574 time for calcul the mask position with numpy : 0.0018672943115234375 nb_pixel_total : 49145 time to create 1 rle with old method : 0.056051015853881836 length of segment : 278 time for calcul the mask position with numpy : 0.005535125732421875 nb_pixel_total : 74428 time to create 1 rle with old method : 0.0825052261352539 length of segment : 478 time for calcul the mask position with numpy : 0.0009872913360595703 nb_pixel_total : 22591 time to create 1 rle with old method : 0.02548837661743164 length of segment : 174 time for calcul the mask position with numpy : 0.004374504089355469 nb_pixel_total : 58453 time to create 1 rle with old method : 0.06906914710998535 length of segment : 297 time for calcul the mask position with numpy : 0.0027604103088378906 nb_pixel_total : 58404 time to create 1 rle with old method : 0.06511688232421875 length of segment : 483 time for calcul the mask position with numpy : 0.001935720443725586 nb_pixel_total : 42353 time to create 1 rle with old method : 0.047508955001831055 length of segment : 322 time for calcul the mask position with numpy : 0.012263059616088867 nb_pixel_total : 406749 time to create 1 rle with new method : 0.018394947052001953 length of segment : 1059 time for calcul the mask position with numpy : 0.0012209415435791016 nb_pixel_total : 2394 time to create 1 rle with old method : 0.0031249523162841797 length of segment : 148 time for calcul the mask position with numpy : 0.0002827644348144531 nb_pixel_total : 6522 time to create 1 rle with old method : 0.007572650909423828 length of segment : 110 time for calcul the mask position with numpy : 0.000698089599609375 nb_pixel_total : 32079 time to create 1 rle with old method : 0.03624677658081055 length of segment : 345 time for calcul the mask position with numpy : 0.0005772113800048828 nb_pixel_total : 18989 time to create 1 rle with old method : 0.021413803100585938 length of segment : 183 time for calcul the mask position with numpy : 0.0007171630859375 nb_pixel_total : 19586 time to create 1 rle with old method : 0.022274494171142578 length of segment : 149 time for calcul the mask position with numpy : 0.0023956298828125 nb_pixel_total : 59848 time to create 1 rle with old method : 0.06863880157470703 length of segment : 287 time for calcul the mask position with numpy : 0.0019686222076416016 nb_pixel_total : 47364 time to create 1 rle with old method : 0.05252385139465332 length of segment : 438 time for calcul the mask position with numpy : 0.0011408329010009766 nb_pixel_total : 25978 time to create 1 rle with old method : 0.029211759567260742 length of segment : 167 time for calcul the mask position with numpy : 0.0041959285736083984 nb_pixel_total : 110521 time to create 1 rle with old method : 0.12360167503356934 length of segment : 957 time for calcul the mask position with numpy : 0.0005431175231933594 nb_pixel_total : 9868 time to create 1 rle with old method : 0.011185884475708008 length of segment : 104 time for calcul the mask position with numpy : 0.0011243820190429688 nb_pixel_total : 36875 time to create 1 rle with old method : 0.041979312896728516 length of segment : 288 time for calcul the mask position with numpy : 0.0012788772583007812 nb_pixel_total : 21484 time to create 1 rle with old method : 0.024176836013793945 length of segment : 382 time for calcul the mask position with numpy : 0.0008172988891601562 nb_pixel_total : 22824 time to create 1 rle with old method : 0.026262283325195312 length of segment : 253 time for calcul the mask position with numpy : 0.004335641860961914 nb_pixel_total : 79106 time to create 1 rle with old method : 0.08962798118591309 length of segment : 439 time for calcul the mask position with numpy : 0.002282381057739258 nb_pixel_total : 68988 time to create 1 rle with old method : 0.07726526260375977 length of segment : 321 time for calcul the mask position with numpy : 0.001489877700805664 nb_pixel_total : 20309 time to create 1 rle with old method : 0.022941112518310547 length of segment : 461 time for calcul the mask position with numpy : 0.002258777618408203 nb_pixel_total : 26897 time to create 1 rle with old method : 0.03042125701904297 length of segment : 432 time for calcul the mask position with numpy : 0.006047964096069336 nb_pixel_total : 78283 time to create 1 rle with old method : 0.08826375007629395 length of segment : 589 time for calcul the mask position with numpy : 0.00171661376953125 nb_pixel_total : 44136 time to create 1 rle with old method : 0.05015993118286133 length of segment : 290 time for calcul the mask position with numpy : 0.0006792545318603516 nb_pixel_total : 14760 time to create 1 rle with old method : 0.016820192337036133 length of segment : 334 time for calcul the mask position with numpy : 0.00046563148498535156 nb_pixel_total : 14293 time to create 1 rle with old method : 0.016184091567993164 length of segment : 170 time for calcul the mask position with numpy : 0.0012047290802001953 nb_pixel_total : 42118 time to create 1 rle with old method : 0.04920387268066406 length of segment : 280 time for calcul the mask position with numpy : 0.0015826225280761719 nb_pixel_total : 52199 time to create 1 rle with old method : 0.060605764389038086 length of segment : 322 time for calcul the mask position with numpy : 0.00039505958557128906 nb_pixel_total : 8663 time to create 1 rle with old method : 0.01035165786743164 length of segment : 121 time for calcul the mask position with numpy : 0.0022628307342529297 nb_pixel_total : 55573 time to create 1 rle with old method : 0.06382393836975098 length of segment : 380 time for calcul the mask position with numpy : 0.0030508041381835938 nb_pixel_total : 117338 time to create 1 rle with old method : 0.13206863403320312 length of segment : 482 time for calcul the mask position with numpy : 0.0022923946380615234 nb_pixel_total : 58408 time to create 1 rle with old method : 0.06828927993774414 length of segment : 264 time for calcul the mask position with numpy : 0.0007312297821044922 nb_pixel_total : 19882 time to create 1 rle with old method : 0.0233614444732666 length of segment : 167 time for calcul the mask position with numpy : 0.0008740425109863281 nb_pixel_total : 12573 time to create 1 rle with old method : 0.017189741134643555 length of segment : 87 time for calcul the mask position with numpy : 0.002157449722290039 nb_pixel_total : 28219 time to create 1 rle with old method : 0.03279614448547363 length of segment : 335 time for calcul the mask position with numpy : 0.0019898414611816406 nb_pixel_total : 41335 time to create 1 rle with old method : 0.050406455993652344 length of segment : 219 time for calcul the mask position with numpy : 0.00047516822814941406 nb_pixel_total : 5308 time to create 1 rle with old method : 0.006452798843383789 length of segment : 100 time for calcul the mask position with numpy : 0.006262063980102539 nb_pixel_total : 166369 time to create 1 rle with new method : 0.009617090225219727 length of segment : 419 time for calcul the mask position with numpy : 0.0008795261383056641 nb_pixel_total : 17407 time to create 1 rle with old method : 0.0203249454498291 length of segment : 198 time for calcul the mask position with numpy : 0.0003476142883300781 nb_pixel_total : 5484 time to create 1 rle with old method : 0.006844282150268555 length of segment : 129 time for calcul the mask position with numpy : 0.014687538146972656 nb_pixel_total : 353263 time to create 1 rle with new method : 0.020285844802856445 length of segment : 1172 time for calcul the mask position with numpy : 0.002634763717651367 nb_pixel_total : 43238 time to create 1 rle with old method : 0.07045483589172363 length of segment : 310 time for calcul the mask position with numpy : 0.003264188766479492 nb_pixel_total : 60917 time to create 1 rle with old method : 0.06934475898742676 length of segment : 515 time for calcul the mask position with numpy : 0.0003368854522705078 nb_pixel_total : 6878 time to create 1 rle with old method : 0.008284807205200195 length of segment : 92 time for calcul the mask position with numpy : 0.0011484622955322266 nb_pixel_total : 10066 time to create 1 rle with old method : 0.012056350708007812 length of segment : 173 time for calcul the mask position with numpy : 0.0017406940460205078 nb_pixel_total : 31553 time to create 1 rle with old method : 0.036698341369628906 length of segment : 257 time for calcul the mask position with numpy : 0.0019197463989257812 nb_pixel_total : 44316 time to create 1 rle with old method : 0.05159950256347656 length of segment : 327 time for calcul the mask position with numpy : 0.0011835098266601562 nb_pixel_total : 29889 time to create 1 rle with old method : 0.03514862060546875 length of segment : 128 time for calcul the mask position with numpy : 0.00526738166809082 nb_pixel_total : 113266 time to create 1 rle with old method : 0.13024353981018066 length of segment : 343 time for calcul the mask position with numpy : 0.0006270408630371094 nb_pixel_total : 12567 time to create 1 rle with old method : 0.014782428741455078 length of segment : 126 time for calcul the mask position with numpy : 0.004366397857666016 nb_pixel_total : 67561 time to create 1 rle with old method : 0.07781600952148438 length of segment : 495 time for calcul the mask position with numpy : 0.0034918785095214844 nb_pixel_total : 74906 time to create 1 rle with old method : 0.08831572532653809 length of segment : 238 time for calcul the mask position with numpy : 0.002938508987426758 nb_pixel_total : 144651 time to create 1 rle with old method : 0.1697678565979004 length of segment : 691 time for calcul the mask position with numpy : 0.0008590221405029297 nb_pixel_total : 18461 time to create 1 rle with old method : 0.02143263816833496 length of segment : 186 time for calcul the mask position with numpy : 0.0015158653259277344 nb_pixel_total : 22790 time to create 1 rle with old method : 0.026812076568603516 length of segment : 242 time for calcul the mask position with numpy : 0.0035581588745117188 nb_pixel_total : 103008 time to create 1 rle with old method : 0.11953449249267578 length of segment : 404 time spent for convertir_results : 11.511664152145386 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 113 chid ids of type : 3594 Number RLEs to save : 38501 save missing photos in datou_result : time spend for datou_step_exec : 43.3577196598053 time spend to save output : 2.709223508834839 total time spend for step 1 : 46.06694316864014 step2:crop_condition Fri Aug 15 10:11:14 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 6 ! batch 1 Loaded 113 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 91 About to insert : list_path_to_insert length 91 new photo from crops ! About to upload 91 photos upload in portfolio : 3736932 init cache_photo without model_param we have 91 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755245502_832666 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 91 photos in the portfolio 3736932 time of upload the photos Elapsed time : 21.886914253234863 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 3736932 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755245526_832666 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 14 photos in the portfolio 3736932 time of upload the photos Elapsed time : 4.687849760055542 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755245534_832666 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.8738713264465332 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1755245536_832666 batch_size : 0, verbose : False, strat_bulk_insert : ignore_different_from_first This is a hack ! we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.6361837387084961 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1377107950, 1377107936, 1377107926, 1377107913, 1377107865, 1377107863] Looping around the photos to save general results len do output : 113 /1377265425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1377265544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107950', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107936', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107926', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107913', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107865', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107863', None, None, None, None, None, '3546730') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 345 time used for this insertion : 0.18060779571533203 save_final save missing photos in datou_result : time spend for datou_step_exec : 62.2645628452301 time spend to save output : 0.1848893165588379 total time spend for step 2 : 62.44945216178894 step3:rle_unique_nms_with_priority Fri Aug 15 10:12:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 113 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 0.7757937908172607 time for calcul the mask position with numpy : 0.09572553634643555 nb_pixel_total : 7377865 time to create 1 rle with new method : 0.18088364601135254 time for calcul the mask position with numpy : 0.025940418243408203 nb_pixel_total : 40792 time to create 1 rle with old method : 0.046301841735839844 time for calcul the mask position with numpy : 0.025740861892700195 nb_pixel_total : 51337 time to create 1 rle with old method : 0.058576107025146484 time for calcul the mask position with numpy : 0.02543473243713379 nb_pixel_total : 35560 time to create 1 rle with old method : 0.04084300994873047 time for calcul the mask position with numpy : 0.025543212890625 nb_pixel_total : 74322 time to create 1 rle with old method : 0.08269405364990234 time for calcul the mask position with numpy : 0.023004531860351562 nb_pixel_total : 33451 time to create 1 rle with old method : 0.03620028495788574 time for calcul the mask position with numpy : 0.024462461471557617 nb_pixel_total : 212450 time to create 1 rle with new method : 0.1503002643585205 time for calcul the mask position with numpy : 0.023615598678588867 nb_pixel_total : 46673 time to create 1 rle with old method : 0.050991058349609375 time for calcul the mask position with numpy : 0.02313065528869629 nb_pixel_total : 14449 time to create 1 rle with old method : 0.015440702438354492 time for calcul the mask position with numpy : 0.022721052169799805 nb_pixel_total : 19860 time to create 1 rle with old method : 0.02122020721435547 time for calcul the mask position with numpy : 0.023233890533447266 nb_pixel_total : 58544 time to create 1 rle with old method : 0.06314420700073242 time for calcul the mask position with numpy : 0.022758960723876953 nb_pixel_total : 31183 time to create 1 rle with old method : 0.03414654731750488 time for calcul the mask position with numpy : 0.022927045822143555 nb_pixel_total : 11549 time to create 1 rle with old method : 0.012571573257446289 time for calcul the mask position with numpy : 0.023003101348876953 nb_pixel_total : 25518 time to create 1 rle with old method : 0.028065919876098633 time for calcul the mask position with numpy : 0.02365875244140625 nb_pixel_total : 33135 time to create 1 rle with old method : 0.03654646873474121 time for calcul the mask position with numpy : 0.023461580276489258 nb_pixel_total : 50100 time to create 1 rle with old method : 0.05559396743774414 time for calcul the mask position with numpy : 0.02328968048095703 nb_pixel_total : 28857 time to create 1 rle with old method : 0.03098917007446289 time for calcul the mask position with numpy : 0.02437734603881836 nb_pixel_total : 148755 time to create 1 rle with old method : 0.16021394729614258 create new chi : 1.6407549381256104 time to delete rle : 0.0259246826171875 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++++Number RLEs to save : 12283 TO DO : save crop sub photo not yet done ! save time : 0.7209248542785645 nb_obj : 15 nb_hashtags : 2 time to prepare the origin masks : 0.6675372123718262 time for calcul the mask position with numpy : 0.08497095108032227 nb_pixel_total : 7647853 time to create 1 rle with new method : 0.15656566619873047 time for calcul the mask position with numpy : 0.023194551467895508 nb_pixel_total : 20192 time to create 1 rle with old method : 0.02150702476501465 time for calcul the mask position with numpy : 0.022875547409057617 nb_pixel_total : 41018 time to create 1 rle with old method : 0.044393062591552734 time for calcul the mask position with numpy : 0.023698806762695312 nb_pixel_total : 30834 time to create 1 rle with old method : 0.0338292121887207 time for calcul the mask position with numpy : 0.0229034423828125 nb_pixel_total : 27044 time to create 1 rle with old method : 0.028806209564208984 time for calcul the mask position with numpy : 0.02286386489868164 nb_pixel_total : 43327 time to create 1 rle with old method : 0.04676413536071777 time for calcul the mask position with numpy : 0.02382206916809082 nb_pixel_total : 75039 time to create 1 rle with old method : 0.08062124252319336 time for calcul the mask position with numpy : 0.023035764694213867 nb_pixel_total : 30438 time to create 1 rle with old method : 0.03351259231567383 time for calcul the mask position with numpy : 0.023559093475341797 nb_pixel_total : 32838 time to create 1 rle with old method : 0.0354456901550293 time for calcul the mask position with numpy : 0.022898435592651367 nb_pixel_total : 11354 time to create 1 rle with old method : 0.012187719345092773 time for calcul the mask position with numpy : 0.023050546646118164 nb_pixel_total : 55375 time to create 1 rle with old method : 0.05934476852416992 time for calcul the mask position with numpy : 0.02304697036743164 nb_pixel_total : 46614 time to create 1 rle with old method : 0.05171918869018555 time for calcul the mask position with numpy : 0.023644685745239258 nb_pixel_total : 30972 time to create 1 rle with old method : 0.03362607955932617 time for calcul the mask position with numpy : 0.022947311401367188 nb_pixel_total : 11634 time to create 1 rle with old method : 0.012725830078125 time for calcul the mask position with numpy : 0.022763729095458984 nb_pixel_total : 31889 time to create 1 rle with old method : 0.03448748588562012 time for calcul the mask position with numpy : 0.023761272430419922 nb_pixel_total : 157979 time to create 1 rle with new method : 0.15538477897644043 create new chi : 1.3050806522369385 time to delete rle : 0.0014872550964355469 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 11561 TO DO : save crop sub photo not yet done ! save time : 0.8166553974151611 nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 0.6733577251434326 time for calcul the mask position with numpy : 0.0829613208770752 nb_pixel_total : 7270153 time to create 1 rle with new method : 0.15823817253112793 time for calcul the mask position with numpy : 0.02358222007751465 nb_pixel_total : 48311 time to create 1 rle with old method : 0.054256439208984375 time for calcul the mask position with numpy : 0.026160717010498047 nb_pixel_total : 44385 time to create 1 rle with old method : 0.13084030151367188 time for calcul the mask position with numpy : 0.02853560447692871 nb_pixel_total : 13649 time to create 1 rle with old method : 0.04666638374328613 time for calcul the mask position with numpy : 0.034696340560913086 nb_pixel_total : 49888 time to create 1 rle with old method : 0.0797739028930664 time for calcul the mask position with numpy : 0.026937484741210938 nb_pixel_total : 38100 time to create 1 rle with old method : 0.04319953918457031 time for calcul the mask position with numpy : 0.02636122703552246 nb_pixel_total : 81314 time to create 1 rle with old method : 0.09137177467346191 time for calcul the mask position with numpy : 0.026803016662597656 nb_pixel_total : 31905 time to create 1 rle with old method : 0.03592944145202637 time for calcul the mask position with numpy : 0.028188467025756836 nb_pixel_total : 129326 time to create 1 rle with old method : 0.14777660369873047 time for calcul the mask position with numpy : 0.026838302612304688 nb_pixel_total : 103694 time to create 1 rle with old method : 0.13267135620117188 time for calcul the mask position with numpy : 0.02641439437866211 nb_pixel_total : 26769 time to create 1 rle with old method : 0.03027033805847168 time for calcul the mask position with numpy : 0.02701711654663086 nb_pixel_total : 69402 time to create 1 rle with old method : 0.11083602905273438 time for calcul the mask position with numpy : 0.030737638473510742 nb_pixel_total : 140141 time to create 1 rle with old method : 0.17479467391967773 time for calcul the mask position with numpy : 0.026530742645263672 nb_pixel_total : 68814 time to create 1 rle with old method : 0.07715272903442383 time for calcul the mask position with numpy : 0.02532958984375 nb_pixel_total : 142234 time to create 1 rle with old method : 0.15850472450256348 time for calcul the mask position with numpy : 0.02577352523803711 nb_pixel_total : 36315 time to create 1 rle with old method : 0.04153013229370117 create new chi : 2.0242481231689453 time to delete rle : 0.0017390251159667969 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 12798 TO DO : save crop sub photo not yet done ! save time : 0.7560164928436279 nb_obj : 27 nb_hashtags : 3 time to prepare the origin masks : 4.7642199993133545 time for calcul the mask position with numpy : 0.08198881149291992 nb_pixel_total : 6474232 time to create 1 rle with new method : 0.16219258308410645 time for calcul the mask position with numpy : 0.033299922943115234 nb_pixel_total : 74428 time to create 1 rle with old method : 0.08060073852539062 time for calcul the mask position with numpy : 0.03271961212158203 nb_pixel_total : 58404 time to create 1 rle with old method : 0.06463122367858887 time for calcul the mask position with numpy : 0.03399085998535156 nb_pixel_total : 25978 time to create 1 rle with old method : 0.02906036376953125 time for calcul the mask position with numpy : 0.03238105773925781 nb_pixel_total : 9868 time to create 1 rle with old method : 0.010755538940429688 time for calcul the mask position with numpy : 0.03283882141113281 nb_pixel_total : 2394 time to create 1 rle with old method : 0.002779722213745117 time for calcul the mask position with numpy : 0.03474068641662598 nb_pixel_total : 309905 time to create 1 rle with new method : 0.14359188079833984 time for calcul the mask position with numpy : 0.03262758255004883 nb_pixel_total : 36875 time to create 1 rle with old method : 0.039885520935058594 time for calcul the mask position with numpy : 0.03273463249206543 nb_pixel_total : 59848 time to create 1 rle with old method : 0.06505155563354492 time for calcul the mask position with numpy : 0.033158302307128906 nb_pixel_total : 47364 time to create 1 rle with old method : 0.05157637596130371 time for calcul the mask position with numpy : 0.03425431251525879 nb_pixel_total : 6522 time to create 1 rle with old method : 0.007249593734741211 time for calcul the mask position with numpy : 0.032843589782714844 nb_pixel_total : 40078 time to create 1 rle with old method : 0.042897939682006836 time for calcul the mask position with numpy : 0.03258156776428223 nb_pixel_total : 19586 time to create 1 rle with old method : 0.021385908126831055 time for calcul the mask position with numpy : 0.032469987869262695 nb_pixel_total : 26192 time to create 1 rle with old method : 0.02846693992614746 time for calcul the mask position with numpy : 0.032820940017700195 nb_pixel_total : 49145 time to create 1 rle with old method : 0.05260634422302246 time for calcul the mask position with numpy : 0.032549142837524414 nb_pixel_total : 42353 time to create 1 rle with old method : 0.04572558403015137 time for calcul the mask position with numpy : 0.03301286697387695 nb_pixel_total : 121384 time to create 1 rle with old method : 0.13238096237182617 time for calcul the mask position with numpy : 0.03368568420410156 nb_pixel_total : 110499 time to create 1 rle with old method : 0.1189413070678711 time for calcul the mask position with numpy : 0.03287553787231445 nb_pixel_total : 56420 time to create 1 rle with old method : 0.06136274337768555 time for calcul the mask position with numpy : 0.03477978706359863 nb_pixel_total : 406749 time to create 1 rle with new method : 0.14438796043395996 time for calcul the mask position with numpy : 0.03361368179321289 nb_pixel_total : 70242 time to create 1 rle with old method : 0.0761265754699707 time for calcul the mask position with numpy : 0.03315401077270508 nb_pixel_total : 54203 time to create 1 rle with old method : 0.059410810470581055 time for calcul the mask position with numpy : 0.03282594680786133 nb_pixel_total : 31928 time to create 1 rle with old method : 0.03456234931945801 time for calcul the mask position with numpy : 0.032353878021240234 nb_pixel_total : 14755 time to create 1 rle with old method : 0.01620936393737793 time for calcul the mask position with numpy : 0.0326533317565918 nb_pixel_total : 18989 time to create 1 rle with old method : 0.02109050750732422 time for calcul the mask position with numpy : 0.03268027305603027 nb_pixel_total : 22591 time to create 1 rle with old method : 0.024717092514038086 time for calcul the mask position with numpy : 0.03273916244506836 nb_pixel_total : 58453 time to create 1 rle with old method : 0.06381011009216309 time for calcul the mask position with numpy : 0.033598899841308594 nb_pixel_total : 45015 time to create 1 rle with old method : 0.049303531646728516 create new chi : 2.6733579635620117 time to delete rle : 0.0024628639221191406 batch 1 Loaded 55 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 22486 TO DO : save crop sub photo not yet done ! save time : 1.4325342178344727 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 0.7331910133361816 time for calcul the mask position with numpy : 0.0841367244720459 nb_pixel_total : 7571246 time to create 1 rle with new method : 0.15891218185424805 time for calcul the mask position with numpy : 0.02451634407043457 nb_pixel_total : 19882 time to create 1 rle with old method : 0.022382736206054688 time for calcul the mask position with numpy : 0.023789405822753906 nb_pixel_total : 58408 time to create 1 rle with old method : 0.06383562088012695 time for calcul the mask position with numpy : 0.023355484008789062 nb_pixel_total : 117338 time to create 1 rle with old method : 0.12590956687927246 time for calcul the mask position with numpy : 0.023360013961791992 nb_pixel_total : 55573 time to create 1 rle with old method : 0.06007981300354004 time for calcul the mask position with numpy : 0.023330211639404297 nb_pixel_total : 8663 time to create 1 rle with old method : 0.00965738296508789 time for calcul the mask position with numpy : 0.023773908615112305 nb_pixel_total : 52199 time to create 1 rle with old method : 0.05680274963378906 time for calcul the mask position with numpy : 0.02319812774658203 nb_pixel_total : 42118 time to create 1 rle with old method : 0.04537034034729004 time for calcul the mask position with numpy : 0.0228424072265625 nb_pixel_total : 13670 time to create 1 rle with old method : 0.015311479568481445 time for calcul the mask position with numpy : 0.024052143096923828 nb_pixel_total : 14760 time to create 1 rle with old method : 0.01656341552734375 time for calcul the mask position with numpy : 0.023230791091918945 nb_pixel_total : 44136 time to create 1 rle with old method : 0.04720258712768555 time for calcul the mask position with numpy : 0.024085283279418945 nb_pixel_total : 78283 time to create 1 rle with old method : 0.08530545234680176 time for calcul the mask position with numpy : 0.022922992706298828 nb_pixel_total : 26897 time to create 1 rle with old method : 0.02982187271118164 time for calcul the mask position with numpy : 0.023110389709472656 nb_pixel_total : 20309 time to create 1 rle with old method : 0.022267580032348633 time for calcul the mask position with numpy : 0.02339649200439453 nb_pixel_total : 68988 time to create 1 rle with old method : 0.07426762580871582 time for calcul the mask position with numpy : 0.02353811264038086 nb_pixel_total : 79106 time to create 1 rle with old method : 0.08439874649047852 time for calcul the mask position with numpy : 0.02289605140686035 nb_pixel_total : 22824 time to create 1 rle with old method : 0.02543950080871582 create new chi : 1.421236515045166 time to delete rle : 0.0017719268798828125 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 12687 TO DO : save crop sub photo not yet done ! save time : 0.7633543014526367 nb_obj : 23 nb_hashtags : 3 time to prepare the origin masks : 1.1263606548309326 time for calcul the mask position with numpy : 0.3382375240325928 nb_pixel_total : 6894868 time to create 1 rle with new method : 0.3992295265197754 time for calcul the mask position with numpy : 0.023635387420654297 nb_pixel_total : 103008 time to create 1 rle with old method : 0.11143112182617188 time for calcul the mask position with numpy : 0.023984432220458984 nb_pixel_total : 21675 time to create 1 rle with old method : 0.023799896240234375 time for calcul the mask position with numpy : 0.023397445678710938 nb_pixel_total : 18461 time to create 1 rle with old method : 0.019681453704833984 time for calcul the mask position with numpy : 0.023549556732177734 nb_pixel_total : 131320 time to create 1 rle with old method : 0.1399240493774414 time for calcul the mask position with numpy : 0.023059844970703125 nb_pixel_total : 74906 time to create 1 rle with old method : 0.07994651794433594 time for calcul the mask position with numpy : 0.023944854736328125 nb_pixel_total : 67561 time to create 1 rle with old method : 0.07236480712890625 time for calcul the mask position with numpy : 0.02312183380126953 nb_pixel_total : 12567 time to create 1 rle with old method : 0.013557910919189453 time for calcul the mask position with numpy : 0.0233154296875 nb_pixel_total : 113266 time to create 1 rle with old method : 0.12077975273132324 time for calcul the mask position with numpy : 0.022813796997070312 nb_pixel_total : 29869 time to create 1 rle with old method : 0.033707618713378906 time for calcul the mask position with numpy : 0.023441076278686523 nb_pixel_total : 44316 time to create 1 rle with old method : 0.0473024845123291 time for calcul the mask position with numpy : 0.02285480499267578 nb_pixel_total : 31553 time to create 1 rle with old method : 0.033661603927612305 time for calcul the mask position with numpy : 0.022818565368652344 nb_pixel_total : 10066 time to create 1 rle with old method : 0.010710477828979492 time for calcul the mask position with numpy : 0.022820234298706055 nb_pixel_total : 6878 time to create 1 rle with old method : 0.007547616958618164 time for calcul the mask position with numpy : 0.023165225982666016 nb_pixel_total : 60917 time to create 1 rle with old method : 0.06843829154968262 time for calcul the mask position with numpy : 0.024875402450561523 nb_pixel_total : 43238 time to create 1 rle with old method : 0.046163082122802734 time for calcul the mask position with numpy : 0.025085926055908203 nb_pixel_total : 353263 time to create 1 rle with new method : 0.1796729564666748 time for calcul the mask position with numpy : 0.023207902908325195 nb_pixel_total : 5484 time to create 1 rle with old method : 0.00608372688293457 time for calcul the mask position with numpy : 0.023192882537841797 nb_pixel_total : 17407 time to create 1 rle with old method : 0.019211769104003906 time for calcul the mask position with numpy : 0.023810863494873047 nb_pixel_total : 166342 time to create 1 rle with new method : 0.27280569076538086 time for calcul the mask position with numpy : 0.024839162826538086 nb_pixel_total : 5308 time to create 1 rle with old method : 0.006131887435913086 time for calcul the mask position with numpy : 0.024724960327148438 nb_pixel_total : 41335 time to create 1 rle with old method : 0.044634342193603516 time for calcul the mask position with numpy : 0.023084402084350586 nb_pixel_total : 28219 time to create 1 rle with old method : 0.030293941497802734 time for calcul the mask position with numpy : 0.02346968650817871 nb_pixel_total : 12573 time to create 1 rle with old method : 0.013897180557250977 create new chi : 2.7568280696868896 time to delete rle : 0.002007007598876953 batch 1 Loaded 47 chid ids of type : 3594 ++++++++++++++++++++++++++++Number RLEs to save : 16258 TO DO : save crop sub photo not yet done ! save time : 0.9742922782897949 map_output_result : {1377107950: (0.0, 'Should be the crop_list due to order', 0), 1377107936: (0.0, 'Should be the crop_list due to order', 0), 1377107926: (0.0, 'Should be the crop_list due to order', 0), 1377107913: (0.0, 'Should be the crop_list due to order', 0), 1377107865: (0.0, 'Should be the crop_list due to order', 0), 1377107863: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1377107950, 1377107936, 1377107926, 1377107913, 1377107865, 1377107863] Looping around the photos to save general results len do output : 6 /1377107950.Didn't retrieve data . /1377107936.Didn't retrieve data . /1377107926.Didn't retrieve data . /1377107913.Didn't retrieve data . /1377107865.Didn't retrieve data . /1377107863.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107950', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107936', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107926', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107913', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107865', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107863', None, None, None, None, None, '3546730') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.030717849731445312 save_final save missing photos in datou_result : time spend for datou_step_exec : 26.88764214515686 time spend to save output : 0.03105306625366211 total time spend for step 3 : 26.918695211410522 step4:ventilate_hashtags_in_portfolio Fri Aug 15 10:12:44 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 26021624 get user id for portfolio 26021624 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26021624 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','pehd','metal','background','papier','flou','autre','carton','pet_fonce','environnement','mal_croppe')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26021624 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','pehd','metal','background','papier','flou','autre','carton','pet_fonce','environnement','mal_croppe')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26021624 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','pehd','metal','background','papier','flou','autre','carton','pet_fonce','environnement','mal_croppe')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/26021790,26021791,26021792,26021793,26021794,26021795,26021796,26021797,26021798,26021799,26021800?tags=pet_clair,pehd,metal,background,papier,flou,autre,carton,pet_fonce,environnement,mal_croppe Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1377107950, 1377107936, 1377107926, 1377107913, 1377107865, 1377107863] Looping around the photos to save general results len do output : 1 /26021624. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107950', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107936', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107926', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107913', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107865', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107863', None, None, None, None, None, '3546730') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.014971494674682617 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6750938892364502 time spend to save output : 0.015170812606811523 total time spend for step 4 : 1.6902647018432617 step5:final Fri Aug 15 10:12:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1377107950: ('0.13121670444315844',), 1377107936: ('0.13121670444315844',), 1377107926: ('0.13121670444315844',), 1377107913: ('0.13121670444315844',), 1377107865: ('0.13121670444315844',), 1377107863: ('0.13121670444315844',)} new output for save of step final : {1377107950: ('0.13121670444315844',), 1377107936: ('0.13121670444315844',), 1377107926: ('0.13121670444315844',), 1377107913: ('0.13121670444315844',), 1377107865: ('0.13121670444315844',), 1377107863: ('0.13121670444315844',)} [1377107950, 1377107936, 1377107926, 1377107913, 1377107865, 1377107863] Looping around the photos to save general results len do output : 6 /1377107950.Didn't retrieve data . /1377107936.Didn't retrieve data . /1377107926.Didn't retrieve data . /1377107913.Didn't retrieve data . /1377107865.Didn't retrieve data . /1377107863.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107950', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107936', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107926', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107913', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107865', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107863', None, None, None, None, None, '3546730') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 18 time used for this insertion : 0.018735408782958984 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12958717346191406 time spend to save output : 0.019067049026489258 total time spend for step 5 : 0.14865422248840332 step6:blur_detection Fri Aug 15 10:12:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b.jpg resize: (2160, 3840) 1377107950 -7.362230252103345 treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1.jpg resize: (2160, 3840) 1377107936 -7.446804125228568 treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee.jpg resize: (2160, 3840) 1377107926 -7.192777860921922 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4.jpg resize: (2160, 3840) 1377107913 -7.139401205464336 treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7.jpg resize: (2160, 3840) 1377107865 -7.174035301390982 treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc.jpg resize: (2160, 3840) 1377107863 -7.13888097078931 treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536976_0.png resize: (310, 319) 1377265425 -3.580048915679502 treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536970_0.png resize: (137, 160) 1377265426 -3.360583510167969 treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536966_0.png resize: (131, 122) 1377265427 -3.0834509099832155 treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536965_0.png resize: (231, 177) 1377265428 -3.2738561805118853 treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536967_0.png resize: (253, 199) 1377265429 -0.8344715183538224 treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536972_0.png resize: (501, 605) 1377265430 -5.053555494075644 treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536973_0.png resize: (197, 475) 1377265431 -3.868109307529015 treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536971_0.png resize: (344, 199) 1377265432 -4.49588352189254 treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536962_0.png resize: (226, 194) 1377265433 -3.9108586212220118 treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536961_0.png resize: (503, 538) 1377265434 -2.1742248260310735 treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536968_0.png resize: (256, 364) 1377265435 -2.857628877298216 treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536977_0.png resize: (361, 163) 1377265436 -4.487164219581159 treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536974_0.png resize: (424, 286) 1377265437 -4.343316150456839 treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536963_0.png resize: (239, 311) 1377265438 -3.8449246848028586 treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536983_0.png resize: (376, 207) 1377265439 -1.7241018877119914 treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536989_0.png resize: (165, 306) 1377265440 -3.4054302436880564 treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536984_0.png resize: (141, 126) 1377265441 -2.208889196720923 treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536980_0.png resize: (132, 124) 1377265442 -2.247500010312763 treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536985_0.png resize: (267, 198) 1377265443 -1.5449201338234864 treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536991_0.png resize: (328, 187) 1377265444 -4.444616076065189 treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536986_0.png resize: (564, 198) 1377265445 -2.6877161671560508 treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536981_0.png resize: (261, 198) 1377265446 -4.167779114447839 treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536978_0.png resize: (545, 570) 1377265447 -1.7949467034957272 treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536988_0.png resize: (204, 317) 1377265448 -1.376563765414801 treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536990_0.png resize: (161, 227) 1377265449 3.489582062272422 treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536987_0.png resize: (475, 302) 1377265450 -3.9245574626703834 treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536982_0.png resize: (217, 315) 1377265451 -4.033245140699483 treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916536994_0.png resize: (446, 552) 1377265452 -4.706972760086543 treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916536999_0.png resize: (556, 697) 1377265453 -2.7455447251497094 treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916536998_0.png resize: (209, 194) 1377265454 -1.1772171843219956 treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916536997_0.png resize: (285, 388) 1377265455 -3.2502768985106245 treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916537000_0.png resize: (373, 637) 1377265456 -3.2320016642957152 treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916537001_0.png resize: (270, 177) 1377265457 -4.667518399473058 treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916536996_0.png resize: (439, 533) 1377265458 -2.6205023408820516 treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916537006_0.png resize: (204, 348) 1377265459 -0.8396616518642094 treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916536993_0.png resize: (339, 146) 1377265460 -4.563952875363627 treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916536995_0.png resize: (405, 260) 1377265461 0.6064116524229095 treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916537002_0.png resize: (436, 334) 1377265462 -4.034808753689513 treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916537003_0.png resize: (169, 285) 1377265463 -4.30322183042955 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537009_0.png resize: (288, 201) 1377265464 -3.070012317797781 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537014_0.png resize: (613, 170) 1377265465 -3.374700081030204 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537029_0.png resize: (436, 170) 1377265466 -3.5221841985638704 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537028_0.png resize: (285, 280) 1377265467 -3.800672398476145 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537032_0.png resize: (103, 110) 1377265468 5.21883320202862 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537018_0.png resize: (168, 183) 1377265469 -1.6891298176186997 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537017_0.png resize: (478, 395) 1377265470 -3.0438706682222842 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537016_0.png resize: (275, 235) 1377265471 -2.4970428377313785 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537030_0.png resize: (163, 211) 1377265472 -1.5737355946898313 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537011_0.png resize: (667, 765) 1377265473 -1.0110137690851781 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537022_0.png resize: (743, 734) 1377265474 -4.888305445735295 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537020_0.png resize: (286, 363) 1377265475 -0.48768493289731624 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537008_0.png resize: (252, 259) 1377265476 -4.904564579166706 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537034_0.png resize: (262, 145) 1377265477 -2.868583756279882 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537026_0.png resize: (179, 155) 1377265478 -3.4964543285747123 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537015_0.png resize: (498, 262) 1377265479 -4.174803644333745 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537033_0.png resize: (282, 148) 1377265480 -4.605309395399851 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537012_0.png resize: (534, 363) 1377265481 -2.1741138267143283 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537025_0.png resize: (238, 190) 1377265482 -3.867016419499893 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537031_0.png resize: (752, 251) 1377265483 -4.7561954236197606 treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537048_0.png resize: (448, 358) 1377265484 -4.451127339483508 treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537038_0.png resize: (404, 120) 1377265485 -3.449234102429455 treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537046_0.png resize: (112, 107) 1377265486 -2.031744605002357 treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537036_0.png resize: (412, 281) 1377265487 -5.019290183363933 treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537039_0.png resize: (372, 229) 1377265488 -3.541875326466446 treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537035_0.png resize: (253, 119) 1377265489 -3.2668213352566196 treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537044_0.png resize: (271, 194) 1377265490 -2.6050746066517085 treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537049_0.png resize: (259, 390) 1377265491 0.7415926872706148 treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537037_0.png resize: (320, 352) 1377265492 -3.870296679816246 treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537050_0.png resize: (167, 175) 1377265493 -4.183566428995326 treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537040_0.png resize: (583, 615) 1377265494 -2.9977133223978885 treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537041_0.png resize: (290, 249) 1377265495 -4.562206528371093 treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537043_0.png resize: (170, 132) 1377265496 -2.9674687633090717 treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537058_0.png resize: (908, 536) 1377265497 -4.507525919345061 treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537066_0.png resize: (335, 510) 1377265498 -3.4055249561153356 treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537070_0.png resize: (673, 421) 1377265499 0.24151024739610186 treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537068_0.png resize: (476, 299) 1377265500 -3.3682274123684763 treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537064_0.png resize: (322, 193) 1377265501 -2.0057265297749653 treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537072_0.png resize: (236, 221) 1377265502 -3.288869775704689 treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537062_0.png resize: (154, 165) 1377265503 -2.105830573479664 treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537053_0.png resize: (219, 301) 1377265504 -3.6007074685340434 treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537055_0.png resize: (394, 597) 1377265505 -4.9468722066043584 treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537067_0.png resize: (124, 141) 1377265506 -3.949383189345876 treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537051_0.png resize: (81, 203) 1377265507 -0.7468450356614551 treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537073_0.png resize: (338, 450) 1377265508 -3.935501073742317 treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537065_0.png resize: (120, 287) 1377265509 -3.833501293186992 treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537061_0.png resize: (90, 113) 1377265510 -2.642406164228585 treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537057_0.png resize: (86, 100) 1377265511 -1.3395880842585652 treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537063_0.png resize: (249, 157) 1377265512 -3.2287447880346707 treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537054_0.png resize: (92, 84) 1377265513 -4.68361838003237 treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537060_0.png resize: (510, 192) 1377265514 -3.713641374983716 treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537052_0.png resize: (335, 226) 1377265515 -2.8228022411992733 treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536969_0.png resize: (160, 200) 1377265520 -4.684930922942636 treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536964_0.png resize: (230, 177) 1377265521 -4.876023575067596 treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536992_0.png resize: (167, 192) 1377265523 -4.654185247965608 treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536979_0.png resize: (241, 171) 1377265524 -4.750298733123575 treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916537007_0.png resize: (268, 294) 1377265525 -3.583006242770036 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537010_0.png resize: (266, 219) 1377265526 -3.7431778394855466 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537021_0.png resize: (287, 236) 1377265527 -4.085753559058862 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537024_0.png resize: (110, 89) 1377265528 -3.2060907066305875 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537013_0.png resize: (208, 185) 1377265529 -3.4082757488015076 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537027_0.png resize: (145, 159) 1377265530 -3.7003676289739165 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537023_0.png resize: (129, 153) 1377265531 -1.5738056744943592 treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537045_0.png resize: (301, 233) 1377265532 -4.306610539186554 treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537042_0.png resize: (232, 117) 1377265533 -4.318337771955193 treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537056_0.png resize: (196, 118) 1377265534 -3.828952135226935 treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916537004_0.png resize: (295, 238) 1377265536 -4.447508706418673 treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916537005_0.png resize: (381, 537) 1377265537 -3.275078977735368 treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537019_0.png resize: (260, 309) 1377265538 -4.7377789087848114 treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537047_0.png resize: (379, 214) 1377265539 -4.788813721199322 treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537071_0.png resize: (185, 128) 1377265540 -4.042174581441924 treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537069_0.png resize: (196, 605) 1377265541 -2.561072024952732 treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537059_0.png resize: (310, 182) 1377265542 -4.161735579489512 treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536975_0.png resize: (206, 208) 1377265544 -4.841972369234389 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 119 time used for this insertion : 0.02232050895690918 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 119 time used for this insertion : 0.14688658714294434 save missing photos in datou_result : time spend for datou_step_exec : 23.08104395866394 time spend to save output : 0.1739366054534912 total time spend for step 6 : 23.25498056411743 step7:brightness Fri Aug 15 10:13:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b.jpg treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1.jpg treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee.jpg treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4.jpg treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7.jpg treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc.jpg treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536976_0.png treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536970_0.png treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536966_0.png treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536965_0.png treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536967_0.png treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536972_0.png treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536973_0.png treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536971_0.png treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536962_0.png treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536961_0.png treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536968_0.png treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536977_0.png treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536974_0.png treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536963_0.png treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536983_0.png treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536989_0.png treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536984_0.png treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536980_0.png treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536985_0.png treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536991_0.png treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536986_0.png treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536981_0.png treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536978_0.png treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536988_0.png treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536990_0.png treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536987_0.png treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536982_0.png treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916536994_0.png treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916536999_0.png treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916536998_0.png treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916536997_0.png treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916537000_0.png treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916537001_0.png treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916536996_0.png treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916537006_0.png treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916536993_0.png treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916536995_0.png treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916537002_0.png treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916537003_0.png treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537009_0.png treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537014_0.png treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537029_0.png treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537028_0.png treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537032_0.png treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537018_0.png treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537017_0.png treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537016_0.png treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537030_0.png treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537011_0.png treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537022_0.png treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537020_0.png treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537008_0.png treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537034_0.png treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537026_0.png treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537015_0.png treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537033_0.png treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537012_0.png treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537025_0.png treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537031_0.png treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537048_0.png treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537038_0.png treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537046_0.png treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537036_0.png treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537039_0.png treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537035_0.png treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537044_0.png treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537049_0.png treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537037_0.png treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537050_0.png treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537040_0.png treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537041_0.png treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537043_0.png treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537058_0.png treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537066_0.png treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537070_0.png treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537068_0.png treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537064_0.png treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537072_0.png treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537062_0.png treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537053_0.png treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537055_0.png treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537067_0.png treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537051_0.png treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537073_0.png treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537065_0.png treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537061_0.png treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537057_0.png treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537063_0.png treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537054_0.png treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537060_0.png treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537052_0.png treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536969_0.png treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536964_0.png treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536992_0.png treat image : temp/1755245427_832666_1377107936_a55d656a4463554f4db48c1baf1525b1_rle_crop_3916536979_0.png treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916537007_0.png treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537010_0.png treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537021_0.png treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537024_0.png treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537013_0.png treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537027_0.png treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537023_0.png treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537045_0.png treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537042_0.png treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537056_0.png treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916537004_0.png treat image : temp/1755245427_832666_1377107926_616616d90d61cf1c158433b1e871beee_rle_crop_3916537005_0.png treat image : temp/1755245427_832666_1377107913_875a7b7b635ddb2f327ec25aa0c79aa4_rle_crop_3916537019_0.png treat image : temp/1755245427_832666_1377107865_e7b693ff21feb65613556973a8d08ea7_rle_crop_3916537047_0.png treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537071_0.png treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537069_0.png treat image : temp/1755245427_832666_1377107863_f58abc97e4e8cffe9014eb58a69220cc_rle_crop_3916537059_0.png treat image : temp/1755245427_832666_1377107950_d991adebc1bda069d109dac36920fd2b_rle_crop_3916536975_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 119 time used for this insertion : 0.017499923706054688 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 119 time used for this insertion : 0.03624987602233887 save missing photos in datou_result : time spend for datou_step_exec : 7.1893463134765625 time spend to save output : 0.0592188835144043 total time spend for step 7 : 7.248565196990967 step8:velours_tree Fri Aug 15 10:13:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.09405803680419922 time spend to save output : 3.886222839355469e-05 total time spend for step 8 : 0.09409689903259277 step9:send_mail_cod Fri Aug 15 10:13:16 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P26021624_15-08-2025_10_13_16.pdf 26021790 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette260217901755245596 26021791 imagette260217911755245597 26021792 imagette260217921755245597 26021793 imagette260217931755245597 26021794 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette260217941755245597 26021795 imagette260217951755245598 26021796 imagette260217961755245598 26021797 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette260217971755245598 26021798 change filename to text .imagette260217981755245599 26021800 imagette260218001755245599 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=26021624 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/26021790,26021791,26021792,26021793,26021794,26021795,26021796,26021797,26021798,26021799,26021800?tags=pet_clair,pehd,metal,background,papier,flou,autre,carton,pet_fonce,environnement,mal_croppe args[1377107950] : ((1377107950, -7.362230252103345, 492609224), (1377107950, 1.929517930749879, 2107752395), '0.13121670444315844') We are sending mail with results at report@fotonower.com args[1377107936] : ((1377107936, -7.446804125228568, 492609224), (1377107936, 1.868944202904233, 2107752395), '0.13121670444315844') We are sending mail with results at report@fotonower.com args[1377107926] : ((1377107926, -7.192777860921922, 492609224), (1377107926, 1.9103432214749798, 2107752395), '0.13121670444315844') We are sending mail with results at report@fotonower.com args[1377107913] : ((1377107913, -7.139401205464336, 492609224), (1377107913, 1.7120741483995967, 2107752395), '0.13121670444315844') We are sending mail with results at report@fotonower.com args[1377107865] : ((1377107865, -7.174035301390982, 492609224), (1377107865, 1.716048170376178, 2107752395), '0.13121670444315844') We are sending mail with results at report@fotonower.com args[1377107863] : ((1377107863, -7.13888097078931, 492609224), (1377107863, 1.4045271882186585, 2107752395), '0.13121670444315844') We are sending mail with results at report@fotonower.com refus_total : 0.13121670444315844 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=26021624 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26021624_15-08-2025_10_13_16.pdf results_Auto_P26021624_15-08-2025_10_13_16.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26021624_15-08-2025_10_13_16.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','26021624','results_Auto_P26021624_15-08-2025_10_13_16.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26021624_15-08-2025_10_13_16.pdf','pdf','','0.51','0.13121670444315844') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/26021624

https://www.fotonower.com/image?json=false&list_photos_id=1377107950
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377107936
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377107926
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377107913
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377107865
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1377107863
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 13.12%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/26021790?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/26021794?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/26021797?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/26021798?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26021624_15-08-2025_10_13_16.pdf.

Lien vers velours :https://www.fotonower.com/velours/26021790,26021791,26021792,26021793,26021794,26021795,26021796,26021797,26021798,26021799,26021800?tags=pet_clair,pehd,metal,background,papier,flou,autre,carton,pet_fonce,environnement,mal_croppe.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 15 Aug 2025 08:13:22 GMT Content-Length: 0 Connection: close X-Message-Id: JoOLb5PXTvClFq1JJfsLHQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1377107950, 1377107936, 1377107926, 1377107913, 1377107865, 1377107863] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107950', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107936', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107926', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107913', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107865', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107863', None, None, None, None, None, '3546730') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.021010160446166992 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.4587626457214355 time spend to save output : 0.02124762535095215 total time spend for step 9 : 5.480010271072388 step10:split_time_score Fri Aug 15 10:13:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('12', 6),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 14082025 26021624 Nombre de photos uploadées : 6 / 23040 (0%) 14082025 26021624 Nombre de photos taguées (types de déchets): 0 / 6 (0%) 14082025 26021624 Nombre de photos taguées (volume) : 0 / 6 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ?????? elapsed_time : fill_and_build_computed_from_old_data 0.0003218650817871094 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.21596908569335938 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26021522 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26021572 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26021610 order by id desc limit 1 Qualite : 0.13121670444315844 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P26021624_15-08-2025_10_13_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26021624 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=26021624 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 26021635 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'14082025': {'nb_upload': 6, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1377107950, 1377107936, 1377107926, 1377107913, 1377107865, 1377107863] Looping around the photos to save general results len do output : 1 /26021624Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107950', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107936', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107926', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107913', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107865', None, None, None, None, None, '3546730') ('3318', None, None, None, None, None, None, None, '3546730') ('3318', '26021624', '1377107863', None, None, None, None, None, '3546730') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 7 time used for this insertion : 0.01693248748779297 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.370803594589233 time spend to save output : 0.017139673233032227 total time spend for step 10 : 4.387943267822266 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 6 set_done_treatment 114.82user 25.75system 3:01.19elapsed 77%CPU (0avgtext+0avgdata 4798944maxresident)k 524856inputs+103264outputs (277major+6554515minor)pagefaults 0swaps