import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3788586 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2927958'] with mtr_portfolio_ids : ['23219795'] and first list_photo_ids : [] new path : /proc/3788586/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 1.5366830825805664 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Wed May 21 18:30:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 4166 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-21 18:30:34.626222: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-21 18:30:34.655344: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-21 18:30:34.657610: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f09b4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-21 18:30:34.657677: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-21 18:30:34.662117: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-21 18:30:34.812474: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x37856fa0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-21 18:30:34.812542: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-21 18:30:34.813759: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-21 18:30:34.814231: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-21 18:30:34.817482: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-21 18:30:34.820475: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-21 18:30:34.820908: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-21 18:30:34.823605: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-21 18:30:34.825142: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-21 18:30:34.830457: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-21 18:30:34.831729: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-21 18:30:34.831830: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-21 18:30:34.832424: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-21 18:30:34.832439: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-21 18:30:34.832448: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-21 18:30:34.833385: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3561 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-21 18:30:35.139682: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-21 18:30:35.139801: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-21 18:30:35.139830: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-21 18:30:35.139848: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-21 18:30:35.139865: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-21 18:30:35.139882: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-21 18:30:35.139899: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-21 18:30:35.139915: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-21 18:30:35.140814: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-21 18:30:35.141805: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-21 18:30:35.141852: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-21 18:30:35.141868: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-21 18:30:35.141882: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-21 18:30:35.141896: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-21 18:30:35.141910: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-21 18:30:35.141924: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-21 18:30:35.141938: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-21 18:30:35.142821: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-21 18:30:35.142848: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-21 18:30:35.142857: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-21 18:30:35.142865: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-21 18:30:35.143818: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3561 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-21 18:30:46.593577: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-21 18:30:46.852603: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-21 18:30:48.220364: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.98G (3199074304 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-05-21 18:30:49.002829: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-05-21 18:30:49.002869: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 3.29GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 45 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 10.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 30 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 23 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 32.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 18 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 8.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 14 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 25 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 44.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 24 Detection mask done ! Trying to reset tf kernel 3789332 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 227 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4166 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0007429122924804688 nb_pixel_total : 24821 time to create 1 rle with old method : 0.02791452407836914 length of segment : 141 time for calcul the mask position with numpy : 0.000278472900390625 nb_pixel_total : 13154 time to create 1 rle with old method : 0.014938116073608398 length of segment : 118 time for calcul the mask position with numpy : 0.0014755725860595703 nb_pixel_total : 49965 time to create 1 rle with old method : 0.0554656982421875 length of segment : 224 time for calcul the mask position with numpy : 0.0004699230194091797 nb_pixel_total : 26234 time to create 1 rle with old method : 0.029225826263427734 length of segment : 164 time for calcul the mask position with numpy : 0.0010077953338623047 nb_pixel_total : 56337 time to create 1 rle with old method : 0.06243467330932617 length of segment : 278 time for calcul the mask position with numpy : 0.0006392002105712891 nb_pixel_total : 32128 time to create 1 rle with old method : 0.03479719161987305 length of segment : 305 time for calcul the mask position with numpy : 0.0005338191986083984 nb_pixel_total : 20560 time to create 1 rle with old method : 0.022753477096557617 length of segment : 237 time for calcul the mask position with numpy : 0.0006260871887207031 nb_pixel_total : 24302 time to create 1 rle with old method : 0.027157306671142578 length of segment : 201 time for calcul the mask positiotime to create 1 rle with old method : 0.01795792579650879 length of segment : 166 time for calcul the mask position with numpy : 0.0011138916015625 nb_pixel_total : 25767 time to create 1 rle with old method : 0.028733015060424805 length of segment : 298 time for calcul the mask position with numpy : 0.0004341602325439453 nb_pixel_total : 8188 time to create 1 rle with old method : 0.010014772415161133 length of segment : 130 time for calcul the mask position with numpy : 0.0006668567657470703 nb_pixel_total : 13466 time to create 1 rle with old method : 0.016590118408203125 length of segment : 124 time for calcul the mask position with numpy : 0.0017197132110595703 nb_pixel_total : 47785 time to create 1 rle with old method : 0.053499698638916016 length of segment : 390 time for calcul the mask position with numpy : 0.0006458759307861328 nb_pixel_total : 15123 time to create 1 rle with old method : 0.01681208610534668 length of segment : 220 time for calcul the mask position with numpy : 0.0007085800170898438 nb_pixel_total : 22066 time to create 1 rle with old method : 0.024506568908691406 length of segment : 221 time for calcul the mask position with numpy : 0.0011093616485595703 nb_pixel_total : 33756 time to create 1 rle with old method : 0.037587642669677734 length of segment : 273 time for calcul the mask position with numpy : 0.0008497238159179688 nb_pixel_total : 22683 time to create 1 rle with old method : 0.024786949157714844 length of segment : 228 time for calcul the mask position with numpy : 0.002217531204223633 nb_pixel_total : 65202 time to create 1 rle with old method : 0.07081747055053711 length of segment : 399 time for calcul the mask position with numpy : 0.0010879039764404297 nb_pixel_total : 33275 time to create 1 rle with old method : 0.036685943603515625 length of segment : 253 time for calcul the mask position with numpy : 0.0003070831298828125 nb_pixel_total : 7238 time to create 1 rle with old method : 0.008121490478515625 length of segment : 94 time for calcul the mask position with numpy : 0.0008161067962646484 nb_pixel_total : 11581 time to create 1 rle with old method : 0.012915372848510742 length of segment : 170 time for calcul the mask position with numpy : 0.0024862289428710938 nb_pixel_total : 58170 time to create 1 rle with old method : 0.06450796127319336 length of segment : 218 time for calcul the mask position with numpy : 0.00039124488830566406 nb_pixel_total : 13569 time to create 1 rle with old method : 0.014776945114135742 length of segment : 147 time for calcul the mask position with numpy : 0.00030994415283203125 nb_pixel_total : 7928 time to create 1 rle with old method : 0.008803129196166992 length of segment : 97 time for calcul the mask position with numpy : 0.0007596015930175781 nb_pixel_total : 23584 time to create 1 rle with old method : 0.026142597198486328 length of segment : 174 time for calcul the mask position with numpy : 0.0007398128509521484 nb_pixel_total : 14921 time to create 1 rle with old method : 0.01659560203552246 length of segment : 165 time for calcul the mask position with numpy : 0.0008015632629394531 nb_pixel_total : 26276 time to create 1 rle with old method : 0.028472185134887695 length of segment : 182 time for calcul the mask position with numpy : 0.0006012916564941406 nb_pixel_total : 15249 time to create 1 rle with old method : 0.0171053409576416 length of segment : 109 time for calcul the mask position with numpy : 0.0006551742553710938 nb_pixel_total : 18563 time to create 1 rle with old method : 0.01996636390686035 length of segment : 156 time for calcul the mask position with numpy : 0.003486156463623047 nb_pixel_total : 128397 time to create 1 rle with old method : 0.1382303237915039 length of segment : 325 time for calcul the mask position with numpy : 0.00027823448181152344 nb_pixel_total : 5237 time to create 1 rle with old method : 0.005978107452392578 length of segment : 103 time for calcul the mask position with numpy : 0.0009968280792236328 nb_pixel_total : 28824 time to create 1 rle with old method : 0.03187751770019531 length of segment : 498 time for calcul the mask position with numpy : 0.0018091201782226562 nb_pixel_total : 49265 time to create 1 rle with old method : 0.05534815788269043 length of segment : 545 time for calcul the mask position with numpy : 0.0010156631469726562 nb_pixel_total : 29716 time to create 1 rle with old method : 0.03396344184875488 length of segment : 239 time for calcul the mask position with numpy : 0.0009183883666992188 nb_pixel_total : 25147 time to create 1 rle with old method : 0.029060840606689453 length of segment : 213 time for calcul the mask position with numpy : 0.0018541812896728516 nb_pixel_total : 55405 time to create 1 rle with old method : 0.0626227855682373 length of segment : 401 time for calcul the mask position with numpy : 0.003356456756591797 nb_pixel_total : 101800 time to create 1 rle with old method : 0.11101818084716797 length of segment : 424 time for calcul the mask position with numpy : 0.0022029876708984375 nb_pixel_total : 75677 time to create 1 rle with old method : 0.0832681655883789 length of segment : 472 time for calcul the mask position with numpy : 0.002080678939819336 nb_pixel_total : 90591 time to create 1 rle with old method : 0.10209226608276367 length of segment : 368 time for calcul the mask position with numpy : 0.0005335807800292969 nb_pixel_total : 18715 time to create 1 rle with old method : 0.020433902740478516 length of segment : 156 time for calcul the mask position with numpy : 0.0011696815490722656 nb_pixel_total : 18491 time to create 1 rle with old method : 0.02024531364440918 length of segment : 271 time for calcul the mask position with numpy : 0.0006015300750732422 nb_pixel_total : 15402 time to create 1 rle with old method : 0.01723480224609375 length of segment : 176 time for calcul the mask position with numpy : 0.0005826950073242188 nb_pixel_total : 11981 time to create 1 rle with old method : 0.0204620361328125 length of segment : 131 time for calcul the mask position with numpy : 0.009883403778076172 nb_pixel_total : 347960 time to create 1 rle with new method : 0.02272963523864746 length of segment : 679 time for calcul the mask position with numpy : 0.0008673667907714844 nb_pixel_total : 35070 time to create 1 rle with old method : 0.03841805458068848 length of segment : 220 time for calcul the mask position with numpy : 0.0007424354553222656 nb_pixel_total : 23864 time to create 1 rle with old method : 0.02633976936340332 length of segment : 257 time for calcul the mask position with numpy : 0.000518798828125 nb_pixel_total : 17509 time to create 1 rle with old method : 0.019538402557373047 length of segment : 118 time for calcul the mask position with numpy : 0.0005626678466796875 nb_pixel_total : 18103 time to create 1 rle with old method : 0.02030014991760254 length of segment : 162 time for calcul the mask position with numpy : 0.0003025531768798828 nb_pixel_total : 8434 time to create 1 rle with old method : 0.009853839874267578 length of segment : 105 time for calcul the mask position with numpy : 0.0018994808197021484 nb_pixel_total : 96761 time to create 1 rle with old method : 0.1099848747253418 length of segment : 167 time for calcul the mask position with numpy : 0.0005609989166259766 nb_pixel_total : 12045 time to create 1 rle with old method : 0.014365911483764648 length of segment : 135 time for calcul the mask position with numpy : 0.0008180141448974609 nb_pixel_total : 20920 time to create 1 rle with old method : 0.023543357849121094 length of segment : 172 time for calcul the mask position with numpy : 0.0008494853973388672 nb_pixel_total : 35347 time to create 1 rle with old method : 0.04175114631652832 length of segment : 193 time for calcul the mask position with numpy : 0.0046656131744384766 nb_pixel_total : 213666 time to create 1 rle with new method : 0.009597301483154297 length of segment : 333 time for calcul the mask position with numpy : 0.0012049674987792969 nb_pixel_total : 46189 time to create 1 rle with old method : 0.05115485191345215 length of segment : 198 time for calcul the mask position with numpy : 0.0015110969543457031 nb_pixel_total : 33387 time to create 1 rle with old method : 0.0384824275970459 length of segment : 207 time for calcul the mask position with numpy : 0.0007946491241455078 nb_pixel_total : 24986 time to create 1 rle with old method : 0.027853965759277344 length of segment : 223 time for calcul the mask position with numpy : 0.004853248596191406 nb_pixel_total : 171001 time to create 1 rle with new method : 0.007517576217651367 length of segment : 434 time for calcul the mask position with numpy : 0.0007581710815429688 nb_pixel_total : 23924 time to create 1 rle with old method : 0.026407241821289062 length of segment : 186 time for calcul the mask position with numpy : 0.0008640289306640625 nb_pixel_total : 42758 time to create 1 rle with old method : 0.04700064659118652 length of segment : 279 time for calcul the mask position with numpy : 0.0008227825164794922 nb_pixel_total : 31157 time to create 1 rle with old method : 0.034607887268066406 length of segment : 268 time for calcul the mask position with numpy : 0.005095958709716797 nb_pixel_total : 184006 time to create 1 rle with new method : 0.008188247680664062 length of segment : 590 time for calcul the mask position with numpy : 0.008339166641235352 nb_pixel_total : 368126 time to create 1 rle with new method : 0.029598474502563477 length of segment : 557 time for calcul the mask position with numpy : 0.0002961158752441406 nb_pixel_total : 8404 time to create 1 rle with old method : 0.009714365005493164 length of segment : 51 time for calcul the mask position with numpy : 0.0018506050109863281 nb_pixel_total : 68082 time to create 1 rle with old method : 0.07477879524230957 length of segment : 368 time for calcul the mask position with numpy : 0.0007455348968505859 nb_pixel_total : 26790 time to create 1 rle with old method : 0.030384540557861328 length of segment : 154 time for calcul the mask position with numpy : 0.0023775100708007812 nb_pixel_total : 106563 time to create 1 rle with old method : 0.11639714241027832 length of segment : 396 time for calcul the mask position with numpy : 0.0007355213165283203 nb_pixel_total : 15930 time to create 1 rle with old method : 0.018313884735107422 length of segment : 209 time for calcul the mask position with numpy : 0.002008199691772461 nb_pixel_total : 69288 time to create 1 rle with old method : 0.07737994194030762 length of segment : 296 time for calcul the mask position with numpy : 0.002823352813720703 nb_pixel_total : 83742 time to create 1 rle with old method : 0.09150576591491699 length of segment : 400 time for calcul the mask position with numpy : 0.00041985511779785156 nb_pixel_total : 18046 time to create 1 rle with old method : 0.019197463989257812 length of segment : 220 time for calcul the mask position with numpy : 0.004093170166015625 nb_pixel_total : 203858 time to create 1 rle with new method : 0.007253170013427734 length of segment : 571 time for calcul the mask position with numpy : 0.013972043991088867 nb_pixel_total : 668985 time to create 1 rle with new method : 0.05428957939147949 length of segment : 926 time for calcul the mask position with numpy : 0.0028312206268310547 nb_pixel_total : 165851 time to create 1 rle with new method : 0.0035974979400634766 length of segment : 296 time for calcul the mask position with numpy : 0.001027822494506836 nb_pixel_total : 47943 time to create 1 rle with old method : 0.05202674865722656 length of segment : 283 time for calcul the mask position with numpy : 0.0015354156494140625 nb_pixel_total : 84717 time to create 1 rle with old method : 0.0937204360961914 length of segment : 446 time for calcul the mask position with numpy : 0.00027108192443847656 nb_pixel_total : 8388 time to create 1 rle with old method : 0.009663820266723633 length of segment : 110 time for calcul the mask position with numpy : 0.0004973411560058594 nb_pixel_total : 8854 time to create 1 rle with old method : 0.010021209716796875 length of segment : 189 time for calcul the mask position with numpy : 0.0072116851806640625 nb_pixel_total : 428859 time to create 1 rle with new method : 0.4821178913116455 length of segment : 861 time for calcul the mask position with numpy : 0.000942230224609375 nb_pixel_total : 43709 time to create 1 rle with old method : 0.04936623573303223 length of segment : 297 time for calcul the mask position with numpy : 0.0022635459899902344 nb_pixel_total : 88496 time to create 1 rle with old method : 0.09777188301086426 length of segment : 404 time for calcul the mask position with numpy : 0.006089687347412109 nb_pixel_total : 307801 time to create 1 rle with new method : 0.013253211975097656 length of segment : 882 time for calcul the mask position with numpy : 0.0009098052978515625 nb_pixel_total : 41142 time to create 1 rle with old method : 0.04467320442199707 length of segment : 234 time for calcul the mask position with numpy : 0.002476930618286133 nb_pixel_total : 132370 time to create 1 rle with old method : 0.14917755126953125 length of segment : 474 time for calcul the mask position with numpy : 0.013350248336791992 nb_pixel_total : 562132 time to create 1 rle with new method : 0.034046173095703125 length of segment : 1270 time for calcul the mask position with numpy : 0.0033464431762695312 nb_pixel_total : 114958 time to create 1 rle with old method : 0.12149238586425781 length of segment : 465 time for calcul the mask position with numpy : 0.0013928413391113281 nb_pixel_total : 57505 time to create 1 rle with old method : 0.06412220001220703 length of segment : 225 time for calcul the mask position with numpy : 0.002866983413696289 nb_pixel_total : 120156 time to create 1 rle with old method : 0.13015079498291016 length of segment : 475 time for calcul the mask position with numpy : 0.0012946128845214844 nb_pixel_total : 39506 time to create 1 rle with old method : 0.04400968551635742 length of segment : 215 time for calcul the mask position with numpy : 0.008655071258544922 nb_pixel_total : 344667 time to create 1 rle with new method : 0.028725147247314453 length of segment : 1065 time for calcul the mask position with numpy : 0.0008401870727539062 nb_pixel_total : 18563 time to create 1 rle with old method : 0.020863771438598633 length of segment : 231 time for calcul the mask position with numpy : 0.00792837142944336 nb_pixel_total : 260332 time to create 1 rle with new method : 0.03587079048156738 length of segment : 1055 time for calcul the mask position with numpy : 0.0013163089752197266 nb_pixel_total : 23061 time to create 1 rle with old method : 0.030724525451660156 length of segment : 207 time for calcul the mask position with numpy : 9.965896606445312e-05 nb_pixel_total : 4794 time to create 1 rle with old method : 0.0057408809661865234 length of segment : 74 time for calcul the mask position with numpy : 0.00032639503479003906 nb_pixel_total : 8881 time to create 1 rle with old method : 0.010058403015136719 length of segment : 89 time for calcul the mask position with numpy : 0.001463174819946289 nb_pixel_total : 52244 time to create 1 rle with old method : 0.057520389556884766 length of segment : 331 time for calcul the mask position with numpy : 0.007105112075805664 nb_pixel_total : 206220 time to create 1 rle with new method : 0.015490293502807617 length of segment : 625 time for calcul the mask position with numpy : 0.003242015838623047 nb_pixel_total : 125555 time to create 1 rle with old method : 0.13602209091186523 length of segment : 402 time for calcul the mask position with numpy : 0.0003502368927001953 nb_pixel_total : 17668 time to create 1 rle with old method : 0.020159006118774414 length of segment : 133 time for calcul the mask position with numpy : 0.0006461143493652344 nb_pixel_total : 15489 time to create 1 rle with old method : 0.017462968826293945 length of segment : 197 time for calcul the mask position with numpy : 0.0028679370880126953 nb_pixel_total : 136690 time to create 1 rle with old method : 0.15723371505737305 length of segment : 453 time for calcul the mask position with numpy : 0.001615762710571289 nb_pixel_total : 50019 time to create 1 rle with old method : 0.05480647087097168 length of segment : 308 time for calcul the mask position with numpy : 0.0032529830932617188 nb_pixel_total : 145455 time to create 1 rle with old method : 0.1595444679260254 length of segment : 491 time for calcul the mask position with numpy : 0.005718231201171875 nb_pixel_total : 241238 time to create 1 rle with new method : 0.014272212982177734 length of segment : 567 time for calcul the mask position with numpy : 0.0009090900421142578 nb_pixel_total : 34101 time to create 1 rle with old method : 0.03801584243774414 length of segment : 150 time for calcul the mask position with numpy : 0.0023164749145507812 nb_pixel_total : 115111 time to create 1 rle with old method : 0.12370562553405762 length of segment : 482 time spent for convertir_results : 12.400213479995728 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 138 chid ids of type : 3594 Number RLEs to save : 41826 save missing photos in datou_result : time spend for datou_step_exec : 68.92892122268677 time spend to save output : 2.8342225551605225 total time spend for step 1 : 71.76314377784729 step2:crop_condition Wed May 21 18:31:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 138 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 81 About to insert : list_path_to_insert length 81 new photo from crops ! About to upload 81 photos upload in portfolio : 3736932 init cache_photo without model_param we have 81 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747845127_3788586 we have uploaded 81 photos in the portfolio 3736932 time of upload the photos Elapsed time : 25.012148141860962 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 22 About to insert : list_path_to_insert length 22 new photo from crops ! About to upload 22 photos upload in portfolio : 3736932 init cache_photo without model_param we have 22 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747845160_3788586 we have uploaded 22 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.33568263053894 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 34 About to insert : list_path_to_insert length 34 new photo from crops ! About to upload 34 photos upload in portfolio : 3736932 init cache_photo without model_param we have 34 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747845181_3788586 we have uploaded 34 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.21854043006897 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747845190_3788586 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.5808596611022949 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1360010499, 1360010359, 1360010227, 1360010194, 1360010164, 1360009929, 1360009865, 1360009849, 1360009846, 1360009843] Looping around the photos to save general results len do output : 138 /1360104500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104550Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360104859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010499', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010359', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010227', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010194', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010164', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009929', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009865', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009849', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009846', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009843', None, None, None, None, None, '2927958') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 424 time used for this insertion : 0.030663251876831055 save_final save missing photos in datou_result : time spend for datou_step_exec : 87.32589840888977 time spend to save output : 0.034761667251586914 total time spend for step 2 : 87.36066007614136 step3:rle_unique_nms_with_priority Wed May 21 18:33:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 138 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 24 nb_hashtags : 3 time to prepare the origin masks : 20.63005828857422 time for calcul the mask position with numpy : 1.279409408569336 nb_pixel_total : 6346190 time to create 1 rle with new method : 1.739680290222168 time for calcul the mask position with numpy : 0.03275752067565918 nb_pixel_total : 12190 time to create 1 rle with old method : 0.012624025344848633 time for calcul the mask position with numpy : 0.033469200134277344 nb_pixel_total : 5818 time to create 1 rle with old method : 0.006566762924194336 time for calcul the mask position with numpy : 0.03561210632324219 nb_pixel_total : 12824 time to create 1 rle with old method : 0.014077425003051758 time for calcul the mask position with numpy : 0.034653425216674805 nb_pixel_total : 19602 time to create 1 rle with old method : 0.02138972282409668 time for calcul the mask position with numpy : 0.03411149978637695 nb_pixel_total : 7260 time to create 1 rle with old method : 0.008023262023925781 time for calcul the mask position with numpy : 0.03363656997680664 nb_pixel_total : 56355 time to create 1 rle with old method : 0.06052136421203613 time for calcul the mask position with numpy : 0.03404498100280762 nb_pixel_total : 8789 time to create 1 rle with old method : 0.009673595428466797 time for calcul the mask position with numpy : 0.026350975036621094 nb_pixel_total : 21715 time to create 1 rle with old method : 0.024074554443359375 time for calcul the mask position with numpy : 0.025832653045654297 nb_pixel_total : 7498 time to create 1 rle with old method : 0.00847005844116211 time for calcul the mask position with numpy : 0.022643327713012695 nb_pixel_total : 33042 time to create 1 rle with old method : 0.03662395477294922 time for calcul the mask position with numpy : 0.022143840789794922 nb_pixel_total : 77693 time to create 1 rle with old method : 0.08578372001647949 time for calcul the mask position with numpy : 0.02245497703552246 nb_pixel_total : 16848 time to create 1 rle with old method : 0.018384218215942383 time for calcul the mask position with numpy : 0.022483110427856445 nb_pixel_total : 97961 time to create 1 rle with old method : 0.1065053939819336 time for calcul the mask position with numpy : 0.021279335021972656 nb_pixel_total : 34284 time to create 1 rle with old method : 0.03774857521057129 time for calcul the mask position with numpy : 0.02076435089111328 nb_pixel_total : 6471 time to create 1 rle with old method : 0.007296323776245117 time for calcul the mask position with numpy : 0.021739721298217773 nb_pixel_total : 38199 time to create 1 rle with old method : 0.040726661682128906 time for calcul the mask position with numpy : 0.021028995513916016 nb_pixel_total : 24302 time to create 1 rle with old method : 0.02647709846496582 time for calcul the mask position with numpy : 0.01992344856262207 nb_pixel_total : 20560 time to create 1 rle with old method : 0.02180933952331543 time for calcul the mask position with numpy : 0.019823789596557617 nb_pixel_total : 32128 time to create 1 rle with old method : 0.03350710868835449 time for calcul the mask position with numpy : 0.021088361740112305 nb_pixel_total : 56337 time to create 1 rle with old method : 0.060300350189208984 time for calcul the mask position with numpy : 0.020426273345947266 nb_pixel_total : 26234 time to create 1 rle with old method : 0.028549671173095703 time for calcul the mask position with numpy : 0.021433115005493164 nb_pixel_total : 49965 time to create 1 rle with old method : 0.054224252700805664 time for calcul the mask position with numpy : 0.021233081817626953 nb_pixel_total : 13154 time to create 1 rle with old method : 0.014447689056396484 time for calcul the mask position with numpy : 0.020695924758911133 nb_pixel_total : 24821 time to create 1 rle with old method : 0.02643752098083496 create new chi : 4.4249162673950195 time to delete rle : 0.028385162353515625 batch 1 Loaded 49 chid ids of type : 3594 ++++++++++++++++++++++++++++++Number RLEs to save : 11709 TO DO : save crop sub photo not yet done ! save time : 0.7421197891235352 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 9.493025064468384 time for calcul the mask position with numpy : 1.82039475440979 nb_pixel_total : 6022964 time to create 1 rle with new method : 0.8242042064666748 time for calcul the mask position with numpy : 0.03717446327209473 nb_pixel_total : 186281 time to create 1 rle with new method : 3.0535919666290283 time for calcul the mask position with numpy : 0.0342402458190918 nb_pixel_total : 23134 time to create 1 rle with old method : 0.025354385375976562 time for calcul the mask position with numpy : 0.033533334732055664 nb_pixel_total : 465 time to create 1 rle with old method : 0.0005915164947509766 time for calcul the mask position with numpy : 0.03357887268066406 nb_pixel_total : 33626 time to create 1 rle with old method : 0.03661036491394043 time for calcul the mask position with numpy : 0.03320050239562988 nb_pixel_total : 9377 time to create 1 rle with old method : 0.010314464569091797 time for calcul the mask position with numpy : 0.03317070007324219 nb_pixel_total : 14792 time to create 1 rle with old method : 0.01572251319885254 time for calcul the mask position with numpy : 0.033339738845825195 nb_pixel_total : 85648 time to create 1 rle with old method : 0.08963584899902344 time for calcul the mask position with numpy : 0.032216548919677734 nb_pixel_total : 22085 time to create 1 rle with old method : 0.023598432540893555 time for calcul the mask position with numpy : 0.03213167190551758 nb_pixel_total : 22088 time to create 1 rle with old method : 0.02418231964111328 time for calcul the mask position with numpy : 0.03249931335449219 nb_pixel_total : 123087 time to create 1 rle with old method : 0.13079309463500977 time for calcul the mask position with numpy : 0.032416582107543945 nb_pixel_total : 32899 time to create 1 rle with old method : 0.03519749641418457 time for calcul the mask position with numpy : 0.022218704223632812 nb_pixel_total : 229863 time to create 1 rle with new method : 0.7830722332000732 time for calcul the mask position with numpy : 0.021256446838378906 nb_pixel_total : 243931 time to create 1 rle with new method : 2.8224151134490967 create new chi : 10.214791059494019 time to delete rle : 0.0021886825561523438 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 11292 TO DO : save crop sub photo not yet done ! save time : 0.6877973079681396 nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 20.9874210357666 time for calcul the mask position with numpy : 2.355846881866455 nb_pixel_total : 6596188 time to create 1 rle with new method : 1.352968454360962 time for calcul the mask position with numpy : 0.0191497802734375 nb_pixel_total : 7928 time to create 1 rle with old method : 0.008322477340698242 time for calcul the mask position with numpy : 0.03211665153503418 nb_pixel_total : 13569 time to create 1 rle with old method : 0.014425516128540039 time for calcul the mask position with numpy : 0.03390645980834961 nb_pixel_total : 58170 time to create 1 rle with old method : 0.06171774864196777 time for calcul the mask position with numpy : 0.03177523612976074 nb_pixel_total : 11581 time to create 1 rle with old method : 0.01218724250793457 time for calcul the mask position with numpy : 0.03164553642272949 nb_pixel_total : 7238 time to create 1 rle with old method : 0.007756710052490234 time for calcul the mask position with numpy : 0.033620357513427734 nb_pixel_total : 33275 time to create 1 rle with old method : 0.0368809700012207 time for calcul the mask position with numpy : 0.034027814865112305 nb_pixel_total : 65202 time to create 1 rle with old method : 0.07095575332641602 time for calcul the mask position with numpy : 0.03386688232421875 nb_pixel_total : 22683 time to create 1 rle with old method : 0.025175094604492188 time for calcul the mask position with numpy : 0.033733367919921875 nb_pixel_total : 33756 time to create 1 rle with old method : 0.037348270416259766 time for calcul the mask position with numpy : 0.033362627029418945 nb_pixel_total : 22066 time to create 1 rle with old method : 0.02360081672668457 time for calcul the mask position with numpy : 0.03434348106384277 nb_pixel_total : 15123 time to create 1 rle with old method : 0.01655268669128418 time for calcul the mask position with numpy : 0.03446817398071289 nb_pixel_total : 47785 time to create 1 rle with old method : 0.05155801773071289 time for calcul the mask position with numpy : 0.03321981430053711 nb_pixel_total : 13466 time to create 1 rle with old method : 0.014803171157836914 time for calcul the mask position with numpy : 0.021921396255493164 nb_pixel_total : 8188 time to create 1 rle with old method : 0.008990287780761719 time for calcul the mask position with numpy : 0.021304845809936523 nb_pixel_total : 25767 time to create 1 rle with old method : 0.028265953063964844 time for calcul the mask position with numpy : 0.0207059383392334 nb_pixel_total : 15437 time to create 1 rle with old method : 0.01702594757080078 time for calcul the mask position with numpy : 0.024626493453979492 nb_pixel_total : 11473 time to create 1 rle with old method : 0.012426137924194336 time for calcul the mask position with numpy : 0.0214998722076416 nb_pixel_total : 33446 time to create 1 rle with old method : 0.03625965118408203 time for calcul the mask position with numpy : 0.021711111068725586 nb_pixel_total : 7899 time to create 1 rle with old method : 0.008764505386352539 create new chi : 4.791595697402954 time to delete rle : 0.0017557144165039062 batch 1 Loaded 39 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 10080 TO DO : save crop sub photo not yet done ! save time : 0.6440579891204834 nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 9.5555100440979 time for calcul the mask position with numpy : 1.717012643814087 nb_pixel_total : 6361588 time to create 1 rle with new method : 1.5151150226593018 time for calcul the mask position with numpy : 0.02184128761291504 nb_pixel_total : 90591 time to create 1 rle with old method : 0.09723496437072754 time for calcul the mask position with numpy : 0.021157264709472656 nb_pixel_total : 75677 time to create 1 rle with old method : 0.08263897895812988 time for calcul the mask position with numpy : 0.02177262306213379 nb_pixel_total : 101800 time to create 1 rle with old method : 0.11110830307006836 time for calcul the mask position with numpy : 0.021131038665771484 nb_pixel_total : 55405 time to create 1 rle with old method : 0.05902242660522461 time for calcul the mask position with numpy : 0.020384788513183594 nb_pixel_total : 25147 time to create 1 rle with old method : 0.026988983154296875 time for calcul the mask position with numpy : 0.02048182487487793 nb_pixel_total : 29716 time to create 1 rle with old method : 0.03216409683227539 time for calcul the mask position with numpy : 0.02089667320251465 nb_pixel_total : 49265 time to create 1 rle with old method : 0.052866220474243164 time for calcul the mask position with numpy : 0.02071976661682129 nb_pixel_total : 28824 time to create 1 rle with old method : 0.029813528060913086 time for calcul the mask position with numpy : 0.020208358764648438 nb_pixel_total : 5237 time to create 1 rle with old method : 0.005588531494140625 time for calcul the mask position with numpy : 0.021012067794799805 nb_pixel_total : 128397 time to create 1 rle with old method : 0.13487839698791504 time for calcul the mask position with numpy : 0.02433300018310547 nb_pixel_total : 18563 time to create 1 rle with old method : 0.03031635284423828 time for calcul the mask position with numpy : 0.02247142791748047 nb_pixel_total : 15249 time to create 1 rle with old method : 0.018721580505371094 time for calcul the mask position with numpy : 0.020035266876220703 nb_pixel_total : 26276 time to create 1 rle with old method : 0.027573585510253906 time for calcul the mask position with numpy : 0.02059197425842285 nb_pixel_total : 14921 time to create 1 rle with old method : 0.015637636184692383 time for calcul the mask position with numpy : 0.02018880844116211 nb_pixel_total : 23584 time to create 1 rle with old method : 0.030199766159057617 create new chi : 4.3416056632995605 time to delete rle : 0.002103567123413086 batch 1 Loaded 31 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 10908 TO DO : save crop sub photo not yet done ! save time : 0.6829209327697754 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 5.997371673583984 time for calcul the mask position with numpy : 0.622244119644165 nb_pixel_total : 6404985 time to create 1 rle with new method : 1.9411754608154297 time for calcul the mask position with numpy : 0.02166891098022461 nb_pixel_total : 20920 time to create 1 rle with old method : 0.023125171661376953 time for calcul the mask position with numpy : 0.022353649139404297 nb_pixel_total : 12045 time to create 1 rle with old method : 0.013151407241821289 time for calcul the mask position with numpy : 0.020931720733642578 nb_pixel_total : 96761 time to create 1 rle with old method : 0.10169553756713867 time for calcul the mask position with numpy : 0.02043461799621582 nb_pixel_total : 8434 time to create 1 rle with old method : 0.008955955505371094 time for calcul the mask position with numpy : 0.02024698257446289 nb_pixel_total : 18103 time to create 1 rle with old method : 0.018838167190551758 time for calcul the mask position with numpy : 0.020089149475097656 nb_pixel_total : 17509 time to create 1 rle with old method : 0.01772594451904297 time for calcul the mask position with numpy : 0.02050614356994629 nb_pixel_total : 23864 time to create 1 rle with old method : 0.023925304412841797 time for calcul the mask position with numpy : 0.02020430564880371 nb_pixel_total : 35070 time to create 1 rle with old method : 0.03601336479187012 time for calcul the mask position with numpy : 0.029878616333007812 nb_pixel_total : 347960 time to create 1 rle with new method : 0.9365618228912354 time for calcul the mask position with numpy : 0.02500772476196289 nb_pixel_total : 11981 time to create 1 rle with old method : 0.012280702590942383 time for calcul the mask position with numpy : 0.02179408073425293 nb_pixel_total : 15402 time to create 1 rle with old method : 0.016251802444458008 time for calcul the mask position with numpy : 0.021464824676513672 nb_pixel_total : 18491 time to create 1 rle with old method : 0.01984262466430664 time for calcul the mask position with numpy : 0.02102828025817871 nb_pixel_total : 18715 time to create 1 rle with old method : 0.020035743713378906 create new chi : 4.158345699310303 time to delete rle : 0.001096963882446289 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 7658 TO DO : save crop sub photo not yet done ! save time : 0.653550386428833 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 5.765182018280029 time for calcul the mask position with numpy : 0.5730836391448975 nb_pixel_total : 6244420 time to create 1 rle with new method : 1.0455102920532227 time for calcul the mask position with numpy : 0.021162986755371094 nb_pixel_total : 184006 time to create 1 rle with new method : 0.9776978492736816 time for calcul the mask position with numpy : 0.020276784896850586 nb_pixel_total : 31157 time to create 1 rle with old method : 0.03378891944885254 time for calcul the mask position with numpy : 0.021148681640625 nb_pixel_total : 42157 time to create 1 rle with old method : 0.04532265663146973 time for calcul the mask position with numpy : 0.02147984504699707 nb_pixel_total : 23924 time to create 1 rle with old method : 0.026124238967895508 time for calcul the mask position with numpy : 0.021559953689575195 nb_pixel_total : 171001 time to create 1 rle with new method : 1.1388800144195557 time for calcul the mask position with numpy : 0.020644426345825195 nb_pixel_total : 24986 time to create 1 rle with old method : 0.02534651756286621 time for calcul the mask position with numpy : 0.019803762435913086 nb_pixel_total : 33387 time to create 1 rle with old method : 0.033592939376831055 time for calcul the mask position with numpy : 0.020638227462768555 nb_pixel_total : 46189 time to create 1 rle with old method : 0.046480417251586914 time for calcul the mask position with numpy : 0.02120041847229004 nb_pixel_total : 213666 time to create 1 rle with new method : 0.7342841625213623 time for calcul the mask position with numpy : 0.02026653289794922 nb_pixel_total : 35347 time to create 1 rle with old method : 0.03643155097961426 create new chi : 5.022907733917236 time to delete rle : 0.0010895729064941406 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++++Number RLEs to save : 7922 TO DO : save crop sub photo not yet done ! save time : 0.5419893264770508 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 6.620995759963989 time for calcul the mask position with numpy : 0.5585083961486816 nb_pixel_total : 6083931 time to create 1 rle with new method : 2.018760919570923 time for calcul the mask position with numpy : 0.024358510971069336 nb_pixel_total : 203858 time to create 1 rle with new method : 0.6149764060974121 time for calcul the mask position with numpy : 0.02006840705871582 nb_pixel_total : 18046 time to create 1 rle with old method : 0.018824338912963867 time for calcul the mask position with numpy : 0.019799470901489258 nb_pixel_total : 81222 time to create 1 rle with old method : 0.08264446258544922 time for calcul the mask position with numpy : 0.020121097564697266 nb_pixel_total : 69288 time to create 1 rle with old method : 0.07215452194213867 time for calcul the mask position with numpy : 0.01971602439880371 nb_pixel_total : 15930 time to create 1 rle with old method : 0.016410350799560547 time for calcul the mask position with numpy : 0.020331621170043945 nb_pixel_total : 106563 time to create 1 rle with old method : 0.11128687858581543 time for calcul the mask position with numpy : 0.02048182487487793 nb_pixel_total : 26790 time to create 1 rle with old method : 0.028685808181762695 time for calcul the mask position with numpy : 0.021669387817382812 nb_pixel_total : 68082 time to create 1 rle with old method : 0.0728921890258789 time for calcul the mask position with numpy : 0.020514249801635742 nb_pixel_total : 8404 time to create 1 rle with old method : 0.008754491806030273 time for calcul the mask position with numpy : 0.022262096405029297 nb_pixel_total : 368126 time to create 1 rle with new method : 0.9001009464263916 create new chi : 4.797164678573608 time to delete rle : 0.001386404037475586 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++Number RLEs to save : 8583 TO DO : save crop sub photo not yet done ! save time : 0.5916194915771484 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 7.979437351226807 time for calcul the mask position with numpy : 0.8841683864593506 nb_pixel_total : 5023125 time to create 1 rle with new method : 1.769728183746338 time for calcul the mask position with numpy : 0.022345542907714844 nb_pixel_total : 132370 time to create 1 rle with old method : 0.1432030200958252 time for calcul the mask position with numpy : 0.019980192184448242 nb_pixel_total : 41142 time to create 1 rle with old method : 0.04385709762573242 time for calcul the mask position with numpy : 0.022002220153808594 nb_pixel_total : 307801 time to create 1 rle with new method : 0.9061033725738525 time for calcul the mask position with numpy : 0.025608539581298828 nb_pixel_total : 88496 time to create 1 rle with old method : 0.12977266311645508 time for calcul the mask position with numpy : 0.07146811485290527 nb_pixel_total : 43709 time to create 1 rle with old method : 0.05948758125305176 time for calcul the mask position with numpy : 0.02853989601135254 nb_pixel_total : 428859 time to create 1 rle with new method : 2.17455792427063 time for calcul the mask position with numpy : 0.03296637535095215 nb_pixel_total : 8854 time to create 1 rle with old method : 0.009627103805541992 time for calcul the mask position with numpy : 0.03268074989318848 nb_pixel_total : 8388 time to create 1 rle with old method : 0.009150028228759766 time for calcul the mask position with numpy : 0.03384733200073242 nb_pixel_total : 84717 time to create 1 rle with old method : 0.09161543846130371 time for calcul the mask position with numpy : 0.0302579402923584 nb_pixel_total : 47943 time to create 1 rle with old method : 0.05115675926208496 time for calcul the mask position with numpy : 0.02218008041381836 nb_pixel_total : 165851 time to create 1 rle with new method : 1.155130386352539 time for calcul the mask position with numpy : 0.02644205093383789 nb_pixel_total : 668985 time to create 1 rle with new method : 0.38811826705932617 create new chi : 8.316291093826294 time to delete rle : 0.0019249916076660156 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 12964 TO DO : save crop sub photo not yet done ! save time : 0.8506786823272705 nb_obj : 10 nb_hashtags : 4 time to prepare the origin masks : 10.473000764846802 time for calcul the mask position with numpy : 1.3469164371490479 nb_pixel_total : 5505442 time to create 1 rle with new method : 0.9726049900054932 time for calcul the mask position with numpy : 0.020833969116210938 nb_pixel_total : 3918 time to create 1 rle with old method : 0.00438380241394043 time for calcul the mask position with numpy : 0.021671056747436523 nb_pixel_total : 23061 time to create 1 rle with old method : 0.025701045989990234 time for calcul the mask position with numpy : 0.03373312950134277 nb_pixel_total : 260332 time to create 1 rle with new method : 4.042466163635254 time for calcul the mask position with numpy : 0.03436088562011719 nb_pixel_total : 18563 time to create 1 rle with old method : 0.020560264587402344 time for calcul the mask position with numpy : 0.030992984771728516 nb_pixel_total : 344667 time to create 1 rle with new method : 1.4551665782928467 time for calcul the mask position with numpy : 0.020480871200561523 nb_pixel_total : 39506 time to create 1 rle with old method : 0.04117727279663086 time for calcul the mask position with numpy : 0.021669387817382812 nb_pixel_total : 120156 time to create 1 rle with old method : 0.126220703125 time for calcul the mask position with numpy : 0.021097421646118164 nb_pixel_total : 57505 time to create 1 rle with old method : 0.05892515182495117 time for calcul the mask position with numpy : 0.022056102752685547 nb_pixel_total : 114958 time to create 1 rle with old method : 0.12076878547668457 time for calcul the mask position with numpy : 0.025892972946166992 nb_pixel_total : 562132 time to create 1 rle with new method : 1.2041819095611572 create new chi : 9.780916452407837 time to delete rle : 0.0019850730895996094 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 12689 TO DO : save crop sub photo not yet done ! save time : 0.8292796611785889 nb_obj : 12 nb_hashtags : 3 time to prepare the origin masks : 12.373295307159424 time for calcul the mask position with numpy : 0.872241735458374 nb_pixel_total : 5917294 time to create 1 rle with new method : 2.1056878566741943 time for calcul the mask position with numpy : 0.02874159812927246 nb_pixel_total : 115111 time to create 1 rle with old method : 0.13150596618652344 time for calcul the mask position with numpy : 0.02971673011779785 nb_pixel_total : 34101 time to create 1 rle with old method : 0.037520408630371094 time for calcul the mask position with numpy : 0.0227353572845459 nb_pixel_total : 241238 time to create 1 rle with new method : 0.8539979457855225 time for calcul the mask position with numpy : 0.024329185485839844 nb_pixel_total : 145455 time to create 1 rle with old method : 0.15935683250427246 time for calcul the mask position with numpy : 0.022428274154663086 nb_pixel_total : 50019 time to create 1 rle with old method : 0.054810285568237305 time for calcul the mask position with numpy : 0.022304058074951172 nb_pixel_total : 136690 time to create 1 rle with old method : 0.16699576377868652 time for calcul the mask position with numpy : 0.024386167526245117 nb_pixel_total : 15489 time to create 1 rle with old method : 0.017116069793701172 time for calcul the mask position with numpy : 0.022927045822143555 nb_pixel_total : 1943 time to create 1 rle with old method : 0.0023164749145507812 time for calcul the mask position with numpy : 0.022580623626708984 nb_pixel_total : 125555 time to create 1 rle with old method : 0.13604211807250977 time for calcul the mask position with numpy : 0.023149728775024414 nb_pixel_total : 206220 time to create 1 rle with new method : 1.332768440246582 time for calcul the mask position with numpy : 0.023089170455932617 nb_pixel_total : 52244 time to create 1 rle with old method : 0.05760526657104492 time for calcul the mask position with numpy : 0.024238109588623047 nb_pixel_total : 8881 time to create 1 rle with old method : 0.010196208953857422 create new chi : 6.317440748214722 time to delete rle : 0.0023980140686035156 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++Number RLEs to save : 10468 TO DO : save crop sub photo not yet done ! save time : 0.716172456741333 map_output_result : {1360010499: (0.0, 'Should be the crop_list due to order', 0), 1360010359: (0.0, 'Should be the crop_list due to order', 0), 1360010227: (0.0, 'Should be the crop_list due to order', 0), 1360010194: (0.0, 'Should be the crop_list due to order', 0), 1360010164: (0.0, 'Should be the crop_list due to order', 0), 1360009929: (0.0, 'Should be the crop_list due to order', 0), 1360009865: (0.0, 'Should be the crop_list due to order', 0), 1360009849: (0.0, 'Should be the crop_list due to order', 0), 1360009846: (0.0, 'Should be the crop_list due to order', 0), 1360009843: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1360010499, 1360010359, 1360010227, 1360010194, 1360010164, 1360009929, 1360009865, 1360009849, 1360009846, 1360009843] Looping around the photos to save general results len do output : 10 /1360010499.Didn't retrieve data . /1360010359.Didn't retrieve data . /1360010227.Didn't retrieve data . /1360010194.Didn't retrieve data . /1360010164.Didn't retrieve data . /1360009929.Didn't retrieve data . /1360009865.Didn't retrieve data . /1360009849.Didn't retrieve data . /1360009846.Didn't retrieve data . /1360009843.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010499', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010359', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010227', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010194', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010164', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009929', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009865', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009849', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009846', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009843', None, None, None, None, None, '2927958') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.013477087020874023 save_final save missing photos in datou_result : time spend for datou_step_exec : 180.08939337730408 time spend to save output : 0.013915777206420898 total time spend for step 3 : 180.1033091545105 step4:ventilate_hashtags_in_portfolio Wed May 21 18:36:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23219795 get user id for portfolio 23219795 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23219795 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','autre','mal_croppe','flou','papier','metal','carton','pehd','background','environnement','pet_fonce')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23219795 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','autre','mal_croppe','flou','papier','metal','carton','pehd','background','environnement','pet_fonce')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23219795 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_clair','autre','mal_croppe','flou','papier','metal','carton','pehd','background','environnement','pet_fonce')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23221331,23221332,23221333,23221334,23221335,23221336,23221337,23221338,23221339,23221340,23221341?tags=pet_clair,autre,mal_croppe,flou,papier,metal,carton,pehd,background,environnement,pet_fonce Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1360010499, 1360010359, 1360010227, 1360010194, 1360010164, 1360009929, 1360009865, 1360009849, 1360009846, 1360009843] Looping around the photos to save general results len do output : 1 /23219795. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010499', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010359', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010227', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010194', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010164', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009929', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009865', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009849', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009846', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009843', None, None, None, None, None, '2927958') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.01734137535095215 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.5733895301818848 time spend to save output : 0.01767706871032715 total time spend for step 4 : 1.591066598892212 step5:final Wed May 21 18:36:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1360010499: ('0.1417862796160131',), 1360010359: ('0.1417862796160131',), 1360010227: ('0.1417862796160131',), 1360010194: ('0.1417862796160131',), 1360010164: ('0.1417862796160131',), 1360009929: ('0.1417862796160131',), 1360009865: ('0.1417862796160131',), 1360009849: ('0.1417862796160131',), 1360009846: ('0.1417862796160131',), 1360009843: ('0.1417862796160131',)} new output for save of step final : {1360010499: ('0.1417862796160131',), 1360010359: ('0.1417862796160131',), 1360010227: ('0.1417862796160131',), 1360010194: ('0.1417862796160131',), 1360010164: ('0.1417862796160131',), 1360009929: ('0.1417862796160131',), 1360009865: ('0.1417862796160131',), 1360009849: ('0.1417862796160131',), 1360009846: ('0.1417862796160131',), 1360009843: ('0.1417862796160131',)} [1360010499, 1360010359, 1360010227, 1360010194, 1360010164, 1360009929, 1360009865, 1360009849, 1360009846, 1360009843] Looping around the photos to save general results len do output : 10 /1360010499.Didn't retrieve data . /1360010359.Didn't retrieve data . /1360010227.Didn't retrieve data . /1360010194.Didn't retrieve data . /1360010164.Didn't retrieve data . /1360009929.Didn't retrieve data . /1360009865.Didn't retrieve data . /1360009849.Didn't retrieve data . /1360009846.Didn't retrieve data . /1360009843.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010499', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010359', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010227', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010194', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010164', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009929', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009865', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009849', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009846', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009843', None, None, None, None, None, '2927958') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.015290021896362305 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12493348121643066 time spend to save output : 0.015827178955078125 total time spend for step 5 : 0.1407606601715088 step6:blur_detection Wed May 21 18:36:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1.jpg resize: (2160, 3264) 1360010499 -0.5142647405528484 treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997.jpg resize: (2160, 3264) 1360010359 4.849497744869146 treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d.jpg resize: (2160, 3264) 1360010227 -2.052418785101762 treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230.jpg resize: (2160, 3264) 1360010194 -0.902503227884836 treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a.jpg resize: (2160, 3264) 1360010164 1.3934756308065943 treat image : temp/1747845030_3788586_1360009929_fa358367112b7ce9f91f5217b05f5787.jpg resize: (2160, 3264) 1360009929 -1.684369335893391 treat image : temp/1747845030_3788586_1360009865_5c808df3157ea2ab08aa85f000aec7e3.jpg resize: (2160, 3264) 1360009865 3.1542005481517323 treat image : temp/1747845030_3788586_1360009849_c9fcff2e5cbf4d191dd4cd8fe5866c27.jpg resize: (2160, 3264) 1360009849 -1.3587214906542189 treat image : temp/1747845030_3788586_1360009846_100cba5d6bd50cbdc118222725d21095.jpg resize: (2160, 3264) 1360009846 -1.1948448605724726 treat image : temp/1747845030_3788586_1360009843_c7a2d3bfb20c9c25a734d914d69dac73.jpg resize: (2160, 3264) 1360009843 -0.7217168915703177 treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955208_0.png resize: (140, 227) 1360104500 0.6738805078330548 treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955209_0.png resize: (118, 147) 1360104502 0.8193383021527685 treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955210_0.png resize: (222, 373) 1360104504 -0.6241268803652883 treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955211_0.png resize: (163, 215) 1360104505 0.9675271514567975 treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955213_0.png resize: (270, 177) 1360104507 1.6857603850203104 treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955214_0.png resize: (231, 158) 1360104509 -0.7831482356931998 treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955215_0.png resize: (201, 178) 1360104510 -1.2484520734704956 treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955216_0.png resize: (249, 201) 1360104512 -1.114408446005942 treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955218_0.png resize: (251, 191) 1360104514 -0.44814327416967975 treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955220_0.png resize: (170, 151) 1360104515 -0.6090090794582455 treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955221_0.png resize: (318, 442) 1360104517 -0.6888698078918333 treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955225_0.png resize: (122, 107) 1360104519 -1.1622546811314065 treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955227_0.png resize: (95, 92) 1360104520 1.340865393558612 treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955228_0.png resize: (175, 245) 1360104522 -1.2029040293168756 treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955229_0.png resize: (139, 131) 1360104524 -0.33833398877592047 treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955230_0.png resize: (114, 128) 1360104525 -2.273114363403712 treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997_rle_crop_3807955232_0.png resize: (1113, 1092) 1360104527 1.2290254788460815 treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997_rle_crop_3807955233_0.png resize: (544, 625) 1360104528 -0.31264564520529003 treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997_rle_crop_3807955234_0.png resize: (189, 303) 1360104529 -1.7307810314013776 treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997_rle_crop_3807955237_0.png resize: (248, 139) 1360104531 -1.8346812638291383 treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997_rle_crop_3807955238_0.png resize: (566, 256) 1360104532 -0.31936624498243527 treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997_rle_crop_3807955239_0.png resize: (158, 145) 1360104533 -0.53543013061043 treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997_rle_crop_3807955240_0.png resize: (144, 116) 1360104535 -2.2216229877761635 treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997_rle_crop_3807955242_0.png resize: (239, 255) 1360104536 -0.4855628237971493 treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955246_0.png resize: (277, 198) 1360104538 -1.7928131132870069 treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955247_0.png resize: (141, 139) 1360104541 -1.065904728962424 treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955249_0.png resize: (294, 137) 1360104542 -0.07188727032205708 treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955250_0.png resize: (130, 93) 1360104543 -1.859996170684757 treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955251_0.png resize: (122, 190) 1360104545 0.32735866167754224 treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955252_0.png resize: (268, 271) 1360104546 -1.227820109306983 treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955254_0.png resize: (172, 159) 1360104547 -0.9385771294524956 treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955256_0.png resize: (223, 156) 1360104549 -2.8167103196137515 treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955258_0.png resize: (241, 182) 1360104550 -0.9338949406778114 treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955260_0.png resize: (153, 149) 1360104551 -1.8974666007963623 treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955262_0.png resize: (118, 160) 1360104553 -0.09495130887514158 treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955263_0.png resize: (97, 99) 1360104554 1.8082287326841868 treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955264_0.png resize: (173, 205) 1360104555 -1.3896719695738113 treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955265_0.png resize: (160, 210) 1360104556 -1.2759661249132828 treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955267_0.png resize: (93, 259) 1360104558 -1.7744381648477554 treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955268_0.png resize: (156, 194) 1360104559 -1.8991382528205871 treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955270_0.png resize: (103, 67) 1360104560 -0.8133358498203475 treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955271_0.png resize: (358, 123) 1360104562 -1.9182715004016728 treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955272_0.png resize: (534, 142) 1360104563 -1.0177968454973303 treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955274_0.png resize: (219, 176) 1360104564 -1.0567272328393575 treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955275_0.png resize: (324, 321) 1360104566 -1.379643387900835 treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955277_0.png resize: (328, 385) 1360104567 -1.2511186261534233 treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a_rle_crop_3807955279_0.png resize: (156, 173) 1360104568 -0.3354850191930816 treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a_rle_crop_3807955280_0.png resize: (271, 256) 1360104570 -0.6466903810445714 treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a_rle_crop_3807955281_0.png resize: (176, 163) 1360104571 -1.199018971716932 treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a_rle_crop_3807955282_0.png resize: (131, 163) 1360104572 -1.3509535990575632 treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a_rle_crop_3807955284_0.png resize: (220, 238) 1360104574 -1.6994069789329476 treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a_rle_crop_3807955285_0.png resize: (257, 128) 1360104575 -0.99223717534253 treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a_rle_crop_3807955287_0.png resize: (151, 168) 1360104576 -1.1627300242540322 treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a_rle_crop_3807955289_0.png resize: (164, 721) 1360104578 0.7912945597315603 treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a_rle_crop_3807955290_0.png resize: (135, 130) 1360104579 0.1267595035758876 treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a_rle_crop_3807955291_0.png resize: (245, 178) 1360104580 -0.214715935944871 treat image : temp/1747845030_3788586_1360009929_fa358367112b7ce9f91f5217b05f5787_rle_crop_3807955292_0.png resize: (189, 213) 1360104582 1.0476541522958205 treat image : temp/1747845030_3788586_1360009929_fa358367112b7ce9f91f5217b05f5787_rle_crop_3807955301_0.png resize: (587, 530) 1360104583 -1.5410834446482857 treat image : temp/1747845030_3788586_1360009865_5c808df3157ea2ab08aa85f000aec7e3_rle_crop_3807955304_0.png resize: (368, 291) 1360104584 0.009596193746390322 treat image : temp/1747845030_3788586_1360009865_5c808df3157ea2ab08aa85f000aec7e3_rle_crop_3807955305_0.png resize: (150, 279) 1360104586 -0.26133229029912874 treat image : temp/1747845030_3788586_1360009865_5c808df3157ea2ab08aa85f000aec7e3_rle_crop_3807955306_0.png resize: (394, 401) 1360104587 -0.5613745033989539 treat image : temp/1747845030_3788586_1360009865_5c808df3157ea2ab08aa85f000aec7e3_rle_crop_3807955307_0.png resize: (199, 182) 1360104588 -0.4824999944341467 treat image : temp/1747845030_3788586_1360009865_5c808df3157ea2ab08aa85f000aec7e3_rle_crop_3807955308_0.png resize: (294, 443) 1360104590 -0.18296405727107795 treat image : temp/1747845030_3788586_1360009865_5c808df3157ea2ab08aa85f000aec7e3_rle_crop_3807955309_0.png resize: (398, 584) 1360104591 0.41178840433059244 treat image : temp/1747845030_3788586_1360009865_5c808df3157ea2ab08aa85f000aec7e3_rle_crop_3807955310_0.png resize: (220, 117) 1360104592 -0.8090835907463392 treat image : temp/1747845030_3788586_1360009849_c9fcff2e5cbf4d191dd4cd8fe5866c27_rle_crop_3807955312_0.png resize: (902, 1177) 1360104594 -1.1634200888653472 treat image : temp/1747845030_3788586_1360009849_c9fcff2e5cbf4d191dd4cd8fe5866c27_rle_crop_3807955316_0.png resize: (110, 130) 1360104595 -1.1485675615593904 treat image : temp/1747845030_3788586_1360009849_c9fcff2e5cbf4d191dd4cd8fe5866c27_rle_crop_3807955317_0.png resize: (188, 97) 1360104596 -2.7670756307517403 treat image : temp/1747845030_3788586_1360009849_c9fcff2e5cbf4d191dd4cd8fe5866c27_rle_crop_3807955322_0.png resize: (234, 216) 1360104598 0.1475494289981215 treat image : temp/1747845030_3788586_1360009846_100cba5d6bd50cbdc118222725d21095_rle_crop_3807955324_0.png resize: (1269, 532) 1360104599 -0.2894997826318551 treat image : temp/1747845030_3788586_1360009846_100cba5d6bd50cbdc118222725d21095_rle_crop_3807955325_0.png resize: (445, 463) 1360104600 -0.48757496698499614 treat image : temp/1747845030_3788586_1360009846_100cba5d6bd50cbdc118222725d21095_rle_crop_3807955327_0.png resize: (461, 346) 1360104602 0.039907029100800906 treat image : temp/1747845030_3788586_1360009846_100cba5d6bd50cbdc118222725d21095_rle_crop_3807955328_0.png resize: (162, 420) 1360104603 -0.129889811830239 treat image : temp/1747845030_3788586_1360009846_100cba5d6bd50cbdc118222725d21095_rle_crop_3807955329_0.png resize: (874, 662) 1360104604 -0.33756506489313653 treat image : temp/1747845030_3788586_1360009843_c7a2d3bfb20c9c25a734d914d69dac73_rle_crop_3807955334_0.png resize: (88, 134) 1360104606 -0.06764873982729391 treat image : temp/1747845030_3788586_1360009843_c7a2d3bfb20c9c25a734d914d69dac73_rle_crop_3807955335_0.png resize: (324, 236) 1360104607 -2.4602362392148747 treat image : temp/1747845030_3788586_1360009843_c7a2d3bfb20c9c25a734d914d69dac73_rle_crop_3807955337_0.png resize: (332, 433) 1360104608 0.8202113551311314 treat image : temp/1747845030_3788586_1360009843_c7a2d3bfb20c9c25a734d914d69dac73_rle_crop_3807955338_0.png resize: (133, 179) 1360104610 -0.324660698880674 treat image : temp/1747845030_3788586_1360009843_c7a2d3bfb20c9c25a734d914d69dac73_rle_crop_3807955339_0.png resize: (197, 144) 1360104611 -1.194098788321044 treat image : temp/1747845030_3788586_1360009843_c7a2d3bfb20c9c25a734d914d69dac73_rle_crop_3807955340_0.png resize: (453, 468) 1360104612 0.06713767054046746 treat image : temp/1747845030_3788586_1360009843_c7a2d3bfb20c9c25a734d914d69dac73_rle_crop_3807955343_0.png resize: (567, 715) 1360104614 0.4728679584814497 treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955217_0.png resize: (131, 65) 1360104714 -0.8758619436195781 treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955222_0.png resize: (181, 259) 1360104716 -0.9949495090148955 treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955223_0.png resize: (108, 130) 1360104717 -1.9131333146102105 treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955224_0.png resize: (218, 125) 1360104718 -0.328030243515065 treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997_rle_crop_3807955241_0.png resize: (216, 441) 1360104721 -0.7948914642903417 treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997_rle_crop_3807955244_0.png resize: (454, 823) 1360104722 -0.2495543948758586 treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955245_0.png resize: (97, 107) 1360104723 0.29672030116129267 treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955248_0.png resize: (162, 127) 1360104725 -0.6756994983524999 treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955253_0.png resize: (220, 102) 1360104727 -0.32393963724107705 treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955259_0.png resize: (94, 102) 1360104728 -0.2763785313469404 treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955261_0.png resize: (194, 462) 1360104729 -1.8555450324374458 treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955269_0.png resize: (325, 633) 1360104732 -0.7728909209396856 treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a_rle_crop_3807955286_0.png resize: (118, 212) 1360104733 -1.5553537488586133 treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a_rle_crop_3807955288_0.png resize: (105, 112) 1360104734 -0.3396289808792207 treat image : temp/1747845030_3788586_1360009929_fa358367112b7ce9f91f5217b05f5787_rle_crop_3807955298_0.png resize: (181, 209) 1360104737 -0.601896618133175 treat image : temp/1747845030_3788586_1360009865_5c808df3157ea2ab08aa85f000aec7e3_rle_crop_3807955302_0.png resize: (536, 1093) 1360104738 -0.20526362034149423 treat image : temp/1747845030_3788586_1360009865_5c808df3157ea2ab08aa85f000aec7e3_rle_crop_3807955303_0.png resize: (49, 241) 1360104739 -1.5384314720673002 treat image : temp/1747845030_3788586_1360009849_c9fcff2e5cbf4d191dd4cd8fe5866c27_rle_crop_3807955318_0.png resize: (859, 661) 1360104741 -0.8795846792818953 treat image : temp/1747845030_3788586_1360009849_c9fcff2e5cbf4d191dd4cd8fe5866c27_rle_crop_3807955320_0.png resize: (404, 546) 1360104744 -0.7846078470277675 treat image : temp/1747845030_3788586_1360009849_c9fcff2e5cbf4d191dd4cd8fe5866c27_rle_crop_3807955323_0.png resize: (468, 436) 1360104745 -0.38383086309922665 treat image : temp/1747845030_3788586_1360009846_100cba5d6bd50cbdc118222725d21095_rle_crop_3807955330_0.png resize: (179, 197) 1360104748 -2.2098646611656885 treat image : temp/1747845030_3788586_1360009843_c7a2d3bfb20c9c25a734d914d69dac73_rle_crop_3807955344_0.png resize: (147, 342) 1360104749 0.6253284278347576 treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955212_0.png resize: (278, 277) 1360104822 -1.1186041558585569 treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955219_0.png resize: (269, 496) 1360104823 -0.6496041938388064 treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955226_0.png resize: (357, 212) 1360104824 -2.771874391313482 treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955231_0.png resize: (144, 124) 1360104826 -1.3877521983474315 treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997_rle_crop_3807955235_0.png resize: (361, 420) 1360104827 -0.1465780870596928 treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997_rle_crop_3807955236_0.png resize: (187, 141) 1360104828 -0.33900104553192084 treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997_rle_crop_3807955243_0.png resize: (132, 222) 1360104829 -0.2242862573876114 treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955255_0.png resize: (267, 180) 1360104830 -3.6282034809921595 treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955257_0.png resize: (374, 276) 1360104831 -2.5668243374844226 treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955266_0.png resize: (178, 190) 1360104833 -0.29306364025964926 treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955273_0.png resize: (238, 147) 1360104834 -0.9049400408464222 treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955276_0.png resize: (419, 349) 1360104835 -1.967719953960877 treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955278_0.png resize: (352, 354) 1360104836 -0.5029796957531096 treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a_rle_crop_3807955283_0.png resize: (613, 841) 1360104837 -0.1712724604060068 treat image : temp/1747845030_3788586_1360009929_fa358367112b7ce9f91f5217b05f5787_rle_crop_3807955293_0.png resize: (328, 876) 1360104838 -0.41737344931076087 treat image : temp/1747845030_3788586_1360009929_fa358367112b7ce9f91f5217b05f5787_rle_crop_3807955294_0.png resize: (186, 364) 1360104839 -1.5761533320861425 treat image : temp/1747845030_3788586_1360009929_fa358367112b7ce9f91f5217b05f5787_rle_crop_3807955295_0.png resize: (201, 356) 1360104840 -0.46002839501090576 treat image : temp/1747845030_3788586_1360009929_fa358367112b7ce9f91f5217b05f5787_rle_crop_3807955296_0.png resize: (223, 138) 1360104841 -1.785346929034307 treat image : temp/1747845030_3788586_1360009929_fa358367112b7ce9f91f5217b05f5787_rle_crop_3807955297_0.png resize: (332, 723) 1360104842 -1.50932837310054 treat image : temp/1747845030_3788586_1360009929_fa358367112b7ce9f91f5217b05f5787_rle_crop_3807955299_0.png resize: (278, 213) 1360104843 -1.0331448672218493 treat image : temp/1747845030_3788586_1360009929_fa358367112b7ce9f91f5217b05f5787_rle_crop_3807955300_0.png resize: (181, 253) 1360104844 -2.4542172416807584 treat image : temp/1747845030_3788586_1360009865_5c808df3157ea2ab08aa85f000aec7e3_rle_crop_3807955311_0.png resize: (565, 431) 1360104845 0.9834479729453726 treat image : temp/1747845030_3788586_1360009849_c9fcff2e5cbf4d191dd4cd8fe5866c27_rle_crop_3807955313_0.png resize: (290, 727) 1360104846 -0.9971018920629001 treat image : temp/1747845030_3788586_1360009849_c9fcff2e5cbf4d191dd4cd8fe5866c27_rle_crop_3807955314_0.png resize: (278, 221) 1360104847 -2.659882766315709 treat image : temp/1747845030_3788586_1360009849_c9fcff2e5cbf4d191dd4cd8fe5866c27_rle_crop_3807955315_0.png resize: (272, 386) 1360104848 -1.0655398722538214 treat image : temp/1747845030_3788586_1360009849_c9fcff2e5cbf4d191dd4cd8fe5866c27_rle_crop_3807955319_0.png resize: (279, 221) 1360104849 -1.9748768049521095 treat image : temp/1747845030_3788586_1360009849_c9fcff2e5cbf4d191dd4cd8fe5866c27_rle_crop_3807955321_0.png resize: (842, 484) 1360104850 -2.8759764271795656 treat image : temp/1747845030_3788586_1360009846_100cba5d6bd50cbdc118222725d21095_rle_crop_3807955326_0.png resize: (217, 334) 1360104851 -1.4782224654000997 treat image : temp/1747845030_3788586_1360009846_100cba5d6bd50cbdc118222725d21095_rle_crop_3807955331_0.png resize: (971, 656) 1360104852 -0.3082122331575182 treat image : temp/1747845030_3788586_1360009846_100cba5d6bd50cbdc118222725d21095_rle_crop_3807955332_0.png resize: (196, 191) 1360104853 -1.9266109086412453 treat image : temp/1747845030_3788586_1360009843_c7a2d3bfb20c9c25a734d914d69dac73_rle_crop_3807955336_0.png resize: (588, 511) 1360104854 0.15911090073168613 treat image : temp/1747845030_3788586_1360009843_c7a2d3bfb20c9c25a734d914d69dac73_rle_crop_3807955341_0.png resize: (308, 261) 1360104855 -0.9863083575259799 treat image : temp/1747845030_3788586_1360009843_c7a2d3bfb20c9c25a734d914d69dac73_rle_crop_3807955342_0.png resize: (427, 455) 1360104856 -1.4972234738959487 treat image : temp/1747845030_3788586_1360009843_c7a2d3bfb20c9c25a734d914d69dac73_rle_crop_3807955345_0.png resize: (476, 347) 1360104857 0.10402034923305677 treat image : temp/1747845030_3788586_1360009846_100cba5d6bd50cbdc118222725d21095_rle_crop_3807955333_0.png resize: (74, 79) 1360104859 3.2200982618395373 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 148 time used for this insertion : 0.019460201263427734 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 148 time used for this insertion : 0.031009912490844727 save missing photos in datou_result : time spend for datou_step_exec : 42.796666622161865 time spend to save output : 0.05554795265197754 total time spend for step 6 : 42.85221457481384 step7:brightness Wed May 21 18:36:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1.jpg treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997.jpg treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d.jpg treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230.jpg treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a.jpg treat image : temp/1747845030_3788586_1360009929_fa358367112b7ce9f91f5217b05f5787.jpg treat image : temp/1747845030_3788586_1360009865_5c808df3157ea2ab08aa85f000aec7e3.jpg treat image : temp/1747845030_3788586_1360009849_c9fcff2e5cbf4d191dd4cd8fe5866c27.jpg treat image : temp/1747845030_3788586_1360009846_100cba5d6bd50cbdc118222725d21095.jpg treat image : temp/1747845030_3788586_1360009843_c7a2d3bfb20c9c25a734d914d69dac73.jpg treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955208_0.png treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955209_0.png treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955210_0.png treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955211_0.png treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955213_0.png treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955214_0.png treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955215_0.png treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955216_0.png treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955218_0.png treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955220_0.png treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955221_0.png treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955225_0.png treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955227_0.png treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955228_0.png treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955229_0.png treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955230_0.png treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997_rle_crop_3807955232_0.png treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997_rle_crop_3807955233_0.png treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997_rle_crop_3807955234_0.png treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997_rle_crop_3807955237_0.png treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997_rle_crop_3807955238_0.png treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997_rle_crop_3807955239_0.png treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997_rle_crop_3807955240_0.png treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997_rle_crop_3807955242_0.png treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955246_0.png treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955247_0.png treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955249_0.png treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955250_0.png treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955251_0.png treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955252_0.png treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955254_0.png treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955256_0.png treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955258_0.png treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955260_0.png treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955262_0.png treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955263_0.png treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955264_0.png treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955265_0.png treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955267_0.png treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955268_0.png treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955270_0.png treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955271_0.png treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955272_0.png treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955274_0.png treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955275_0.png treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955277_0.png treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a_rle_crop_3807955279_0.png treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a_rle_crop_3807955280_0.png treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a_rle_crop_3807955281_0.png treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a_rle_crop_3807955282_0.png treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a_rle_crop_3807955284_0.png treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a_rle_crop_3807955285_0.png treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a_rle_crop_3807955287_0.png treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a_rle_crop_3807955289_0.png treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a_rle_crop_3807955290_0.png treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a_rle_crop_3807955291_0.png treat image : temp/1747845030_3788586_1360009929_fa358367112b7ce9f91f5217b05f5787_rle_crop_3807955292_0.png treat image : temp/1747845030_3788586_1360009929_fa358367112b7ce9f91f5217b05f5787_rle_crop_3807955301_0.png treat image : temp/1747845030_3788586_1360009865_5c808df3157ea2ab08aa85f000aec7e3_rle_crop_3807955304_0.png treat image : temp/1747845030_3788586_1360009865_5c808df3157ea2ab08aa85f000aec7e3_rle_crop_3807955305_0.png treat image : temp/1747845030_3788586_1360009865_5c808df3157ea2ab08aa85f000aec7e3_rle_crop_3807955306_0.png treat image : temp/1747845030_3788586_1360009865_5c808df3157ea2ab08aa85f000aec7e3_rle_crop_3807955307_0.png treat image : temp/1747845030_3788586_1360009865_5c808df3157ea2ab08aa85f000aec7e3_rle_crop_3807955308_0.png treat image : temp/1747845030_3788586_1360009865_5c808df3157ea2ab08aa85f000aec7e3_rle_crop_3807955309_0.png treat image : temp/1747845030_3788586_1360009865_5c808df3157ea2ab08aa85f000aec7e3_rle_crop_3807955310_0.png treat image : temp/1747845030_3788586_1360009849_c9fcff2e5cbf4d191dd4cd8fe5866c27_rle_crop_3807955312_0.png treat image : temp/1747845030_3788586_1360009849_c9fcff2e5cbf4d191dd4cd8fe5866c27_rle_crop_3807955316_0.png treat image : temp/1747845030_3788586_1360009849_c9fcff2e5cbf4d191dd4cd8fe5866c27_rle_crop_3807955317_0.png treat image : temp/1747845030_3788586_1360009849_c9fcff2e5cbf4d191dd4cd8fe5866c27_rle_crop_3807955322_0.png treat image : temp/1747845030_3788586_1360009846_100cba5d6bd50cbdc118222725d21095_rle_crop_3807955324_0.png treat image : temp/1747845030_3788586_1360009846_100cba5d6bd50cbdc118222725d21095_rle_crop_3807955325_0.png treat image : temp/1747845030_3788586_1360009846_100cba5d6bd50cbdc118222725d21095_rle_crop_3807955327_0.png treat image : temp/1747845030_3788586_1360009846_100cba5d6bd50cbdc118222725d21095_rle_crop_3807955328_0.png treat image : temp/1747845030_3788586_1360009846_100cba5d6bd50cbdc118222725d21095_rle_crop_3807955329_0.png treat image : temp/1747845030_3788586_1360009843_c7a2d3bfb20c9c25a734d914d69dac73_rle_crop_3807955334_0.png treat image : temp/1747845030_3788586_1360009843_c7a2d3bfb20c9c25a734d914d69dac73_rle_crop_3807955335_0.png treat image : temp/1747845030_3788586_1360009843_c7a2d3bfb20c9c25a734d914d69dac73_rle_crop_3807955337_0.png treat image : temp/1747845030_3788586_1360009843_c7a2d3bfb20c9c25a734d914d69dac73_rle_crop_3807955338_0.png treat image : temp/1747845030_3788586_1360009843_c7a2d3bfb20c9c25a734d914d69dac73_rle_crop_3807955339_0.png treat image : temp/1747845030_3788586_1360009843_c7a2d3bfb20c9c25a734d914d69dac73_rle_crop_3807955340_0.png treat image : temp/1747845030_3788586_1360009843_c7a2d3bfb20c9c25a734d914d69dac73_rle_crop_3807955343_0.png treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955217_0.png treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955222_0.png treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955223_0.png treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955224_0.png treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997_rle_crop_3807955241_0.png treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997_rle_crop_3807955244_0.png treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955245_0.png treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955248_0.png treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955253_0.png treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955259_0.png treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955261_0.png treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955269_0.png treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a_rle_crop_3807955286_0.png treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a_rle_crop_3807955288_0.png treat image : temp/1747845030_3788586_1360009929_fa358367112b7ce9f91f5217b05f5787_rle_crop_3807955298_0.png treat image : temp/1747845030_3788586_1360009865_5c808df3157ea2ab08aa85f000aec7e3_rle_crop_3807955302_0.png treat image : temp/1747845030_3788586_1360009865_5c808df3157ea2ab08aa85f000aec7e3_rle_crop_3807955303_0.png treat image : temp/1747845030_3788586_1360009849_c9fcff2e5cbf4d191dd4cd8fe5866c27_rle_crop_3807955318_0.png treat image : temp/1747845030_3788586_1360009849_c9fcff2e5cbf4d191dd4cd8fe5866c27_rle_crop_3807955320_0.png treat image : temp/1747845030_3788586_1360009849_c9fcff2e5cbf4d191dd4cd8fe5866c27_rle_crop_3807955323_0.png treat image : temp/1747845030_3788586_1360009846_100cba5d6bd50cbdc118222725d21095_rle_crop_3807955330_0.png treat image : temp/1747845030_3788586_1360009843_c7a2d3bfb20c9c25a734d914d69dac73_rle_crop_3807955344_0.png treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955212_0.png treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955219_0.png treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955226_0.png treat image : temp/1747845030_3788586_1360010499_d45b9f0f1c967f6945a872531fde78c1_rle_crop_3807955231_0.png treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997_rle_crop_3807955235_0.png treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997_rle_crop_3807955236_0.png treat image : temp/1747845030_3788586_1360010359_5354d57624b3af4525b702d8ad184997_rle_crop_3807955243_0.png treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955255_0.png treat image : temp/1747845030_3788586_1360010227_f06f5b3299277d01006fa43b68c71a8d_rle_crop_3807955257_0.png treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955266_0.png treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955273_0.png treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955276_0.png treat image : temp/1747845030_3788586_1360010194_f013a13a41ab60863605938674a0f230_rle_crop_3807955278_0.png treat image : temp/1747845030_3788586_1360010164_43116e855fd44059ce39314daf94074a_rle_crop_3807955283_0.png treat image : temp/1747845030_3788586_1360009929_fa358367112b7ce9f91f5217b05f5787_rle_crop_3807955293_0.png treat image : temp/1747845030_3788586_1360009929_fa358367112b7ce9f91f5217b05f5787_rle_crop_3807955294_0.png treat image : temp/1747845030_3788586_1360009929_fa358367112b7ce9f91f5217b05f5787_rle_crop_3807955295_0.png treat image : temp/1747845030_3788586_1360009929_fa358367112b7ce9f91f5217b05f5787_rle_crop_3807955296_0.png treat image : temp/1747845030_3788586_1360009929_fa358367112b7ce9f91f5217b05f5787_rle_crop_3807955297_0.png treat image : temp/1747845030_3788586_1360009929_fa358367112b7ce9f91f5217b05f5787_rle_crop_3807955299_0.png treat image : temp/1747845030_3788586_1360009929_fa358367112b7ce9f91f5217b05f5787_rle_crop_3807955300_0.png treat image : temp/1747845030_3788586_1360009865_5c808df3157ea2ab08aa85f000aec7e3_rle_crop_3807955311_0.png treat image : temp/1747845030_3788586_1360009849_c9fcff2e5cbf4d191dd4cd8fe5866c27_rle_crop_3807955313_0.png treat image : temp/1747845030_3788586_1360009849_c9fcff2e5cbf4d191dd4cd8fe5866c27_rle_crop_3807955314_0.png treat image : temp/1747845030_3788586_1360009849_c9fcff2e5cbf4d191dd4cd8fe5866c27_rle_crop_3807955315_0.png treat image : temp/1747845030_3788586_1360009849_c9fcff2e5cbf4d191dd4cd8fe5866c27_rle_crop_3807955319_0.png treat image : temp/1747845030_3788586_1360009849_c9fcff2e5cbf4d191dd4cd8fe5866c27_rle_crop_3807955321_0.png treat image : temp/1747845030_3788586_1360009846_100cba5d6bd50cbdc118222725d21095_rle_crop_3807955326_0.png treat image : temp/1747845030_3788586_1360009846_100cba5d6bd50cbdc118222725d21095_rle_crop_3807955331_0.png treat image : temp/1747845030_3788586_1360009846_100cba5d6bd50cbdc118222725d21095_rle_crop_3807955332_0.png treat image : temp/1747845030_3788586_1360009843_c7a2d3bfb20c9c25a734d914d69dac73_rle_crop_3807955336_0.png treat image : temp/1747845030_3788586_1360009843_c7a2d3bfb20c9c25a734d914d69dac73_rle_crop_3807955341_0.png treat image : temp/1747845030_3788586_1360009843_c7a2d3bfb20c9c25a734d914d69dac73_rle_crop_3807955342_0.png treat image : temp/1747845030_3788586_1360009843_c7a2d3bfb20c9c25a734d914d69dac73_rle_crop_3807955345_0.png treat image : temp/1747845030_3788586_1360009846_100cba5d6bd50cbdc118222725d21095_rle_crop_3807955333_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 148 time used for this insertion : 0.020650148391723633 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 148 time used for this insertion : 0.03863811492919922 save missing photos in datou_result : time spend for datou_step_exec : 9.440249681472778 time spend to save output : 0.06446480751037598 total time spend for step 7 : 9.504714488983154 step8:velours_tree Wed May 21 18:37:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.1422257423400879 time spend to save output : 3.528594970703125e-05 total time spend for step 8 : 0.14226102828979492 step9:send_mail_cod Wed May 21 18:37:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23219795_21-05-2025_18_37_05.pdf 23221331 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232213311747845425 23221332 change filename to text .imagette232213321747845426 23221333 imagette232213331747845426 23221334 imagette232213341747845426 23221335 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232213351747845426 23221336 imagette232213361747845428 23221337 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232213371747845428 23221338 imagette232213381747845429 23221339 imagette232213391747845429 23221341 imagette232213411747845429 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23219795 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23221331,23221332,23221333,23221334,23221335,23221336,23221337,23221338,23221339,23221340,23221341?tags=pet_clair,autre,mal_croppe,flou,papier,metal,carton,pehd,background,environnement,pet_fonce args[1360010499] : ((1360010499, -0.5142647405528484, 492688767), (1360010499, 0.03490463777079829, 2107752395), '0.1417862796160131') We are sending mail with results at report@fotonower.com args[1360010359] : ((1360010359, 4.849497744869146, 492688767), (1360010359, -0.18212554458521218, 496442774), '0.1417862796160131') We are sending mail with results at report@fotonower.com args[1360010227] : ((1360010227, -2.052418785101762, 492609224), (1360010227, 0.27651592631463995, 2107752395), '0.1417862796160131') We are sending mail with results at report@fotonower.com args[1360010194] : ((1360010194, -0.902503227884836, 492688767), (1360010194, 0.1981493827887483, 2107752395), '0.1417862796160131') We are sending mail with results at report@fotonower.com args[1360010164] : ((1360010164, 1.3934756308065943, 492688767), (1360010164, -0.13524652066384002, 496442774), '0.1417862796160131') We are sending mail with results at report@fotonower.com args[1360009929] : ((1360009929, -1.684369335893391, 492688767), (1360009929, 0.3638242778698085, 2107752395), '0.1417862796160131') We are sending mail with results at report@fotonower.com args[1360009865] : ((1360009865, 3.1542005481517323, 492688767), (1360009865, 0.05520181822715918, 2107752395), '0.1417862796160131') We are sending mail with results at report@fotonower.com args[1360009849] : ((1360009849, -1.3587214906542189, 492688767), (1360009849, 0.07239622466790889, 2107752395), '0.1417862796160131') We are sending mail with results at report@fotonower.com args[1360009846] : ((1360009846, -1.1948448605724726, 492688767), (1360009846, 0.22246826535179307, 2107752395), '0.1417862796160131') We are sending mail with results at report@fotonower.com args[1360009843] : ((1360009843, -0.7217168915703177, 492688767), (1360009843, 0.48263552742018895, 2107752395), '0.1417862796160131') We are sending mail with results at report@fotonower.com refus_total : 0.1417862796160131 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23219795 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23219795_21-05-2025_18_37_05.pdf results_Auto_P23219795_21-05-2025_18_37_05.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23219795_21-05-2025_18_37_05.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23219795','results_Auto_P23219795_21-05-2025_18_37_05.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23219795_21-05-2025_18_37_05.pdf','pdf','','0.7','0.1417862796160131') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23219795

https://www.fotonower.com/image?json=false&list_photos_id=1360010499
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360010359
La photo est trop floue, merci de reprendre une photo.(avec le score = 4.849497744869146)
https://www.fotonower.com/image?json=false&list_photos_id=1360010227
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360010194
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360010164
La photo est trop floue, merci de reprendre une photo.(avec le score = 1.3934756308065943)
https://www.fotonower.com/image?json=false&list_photos_id=1360009929
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360009865
La photo est trop floue, merci de reprendre une photo.(avec le score = 3.1542005481517323)
https://www.fotonower.com/image?json=false&list_photos_id=1360009849
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360009846
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360009843
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 14.18%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_clair: https://www.fotonower.com/view/23221331?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23221332?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23221335?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23221337?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23219795_21-05-2025_18_37_05.pdf.

Lien vers velours :https://www.fotonower.com/velours/23221331,23221332,23221333,23221334,23221335,23221336,23221337,23221338,23221339,23221340,23221341?tags=pet_clair,autre,mal_croppe,flou,papier,metal,carton,pehd,background,environnement,pet_fonce.


L'équipe Fotonower 202 b'' Server: nginx Date: Wed, 21 May 2025 16:37:12 GMT Content-Length: 0 Connection: close X-Message-Id: lY-zQztcRi2TSG8E64IJmQ Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1360010499, 1360010359, 1360010227, 1360010194, 1360010164, 1360009929, 1360009865, 1360009849, 1360009846, 1360009843] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010499', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010359', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010227', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010194', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010164', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009929', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009865', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009849', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009846', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009843', None, None, None, None, None, '2927958') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.014025449752807617 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.955901861190796 time spend to save output : 0.014322757720947266 total time spend for step 9 : 6.970224618911743 step10:split_time_score Wed May 21 18:37:12 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('11', 10),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 21052025 23219795 Nombre de photos uploadées : 10 / 23040 (0%) 21052025 23219795 Nombre de photos taguées (types de déchets): 0 / 10 (0%) 21052025 23219795 Nombre de photos taguées (volume) : 0 / 10 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 4.76837158203125e-06 ?????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005679130554199219 elapsed_time : insert_dashboard_record_day_entry 0.02758193016052246 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219688 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219689 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219717 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219758 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219775 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219778 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219783 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219791 order by id desc limit 1 Qualite : 0.1417862796160131 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23219795_21-05-2025_18_37_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219795 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23219795 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219802 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219856 order by id desc limit 1 Qualite : 0.1421742583028582 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23219858_21-05-2025_18_30_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219858 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23219858 AND mptpi.`type`=3594 To do Qualite : 0.09422273973246707 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23219879_21-05-2025_18_18_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219879 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23219879 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23219881 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'21052025': {'nb_upload': 10, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1360010499, 1360010359, 1360010227, 1360010194, 1360010164, 1360009929, 1360009865, 1360009849, 1360009846, 1360009843] Looping around the photos to save general results len do output : 1 /23219795Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010499', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010359', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010227', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010194', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360010164', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009929', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009865', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009849', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009846', None, None, None, None, None, '2927958') ('3318', None, None, None, None, None, None, None, '2927958') ('3318', '23219795', '1360009843', None, None, None, None, None, '2927958') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.01406407356262207 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.86439824104309 time spend to save output : 0.014236688613891602 total time spend for step 10 : 9.878634929656982 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 10 set_done_treatment 141.27user 213.61system 6:56.99elapsed 85%CPU (0avgtext+0avgdata 5118172maxresident)k 547928inputs+82584outputs (351major+12876725minor)pagefaults 0swaps