python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1952861 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2933152'] with mtr_portfolio_ids : ['23254913'] and first list_photo_ids : [] new path : /proc/1952861/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 11 ; length of list_pids : 11 ; length of list_args : 11 time to download the photos : 1.5303535461425781 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Thu May 22 08:30:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10372 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-22 08:30:34.427967: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-22 08:30:34.436858: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-22 08:30:34.438308: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fe738000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-22 08:30:34.438334: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-22 08:30:34.441525: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-22 08:30:34.703285: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x32598a60 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-22 08:30:34.703338: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-22 08:30:34.704332: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-22 08:30:34.704698: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-22 08:30:34.707185: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-22 08:30:34.709595: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-22 08:30:34.710126: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-22 08:30:34.712826: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-22 08:30:34.714392: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-22 08:30:34.720072: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-22 08:30:34.721972: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-22 08:30:34.722103: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-22 08:30:34.723110: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-22 08:30:34.723131: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-22 08:30:34.723143: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-22 08:30:34.725444: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9463 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-22 08:30:35.129095: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-22 08:30:35.129264: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-22 08:30:35.129288: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-22 08:30:35.129305: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-22 08:30:35.129321: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-22 08:30:35.129336: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-22 08:30:35.129351: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-22 08:30:35.129367: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-22 08:30:35.130695: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-22 08:30:35.132122: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-22 08:30:35.132176: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-22 08:30:35.132191: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-22 08:30:35.132206: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-22 08:30:35.132220: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-22 08:30:35.132234: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-22 08:30:35.132247: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-22 08:30:35.132262: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-22 08:30:35.133552: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-22 08:30:35.133594: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-22 08:30:35.133603: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-22 08:30:35.133611: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-22 08:30:35.134960: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9463 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-22 08:30:47.906471: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-22 08:30:48.120026: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 11 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 45.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 37 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 28 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 35 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 11 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 39.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 10 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 13.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 24 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 26 Detection mask done ! Trying to reset tf kernel 1953580 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5083 tf kernel not reseted sub process len(results) : 11 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 11 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 8279 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0006809234619140625 nb_pixel_total : 13503 time to create 1 rle with old method : 0.017007827758789062 length of segment : 205 time for calcul the mask position with numpy : 0.002955198287963867 nb_pixel_total : 119426 time to create 1 rle with old method : 0.13408446311950684 length of segment : 583 time for calcul the mask position with numpy : 0.00042724609375 nb_pixel_total : 23234 time to create 1 rle with old method : 0.02640557289123535 length of segment : 174 time for calcul the mask position with numpy : 0.00040411949157714844 nb_pixel_total : 26368 time to create 1 rle with old method : 0.0297391414642334 length of segment : 192 time for calcul the mask position with numpy : 0.000362396240234375 nb_pixel_total : 22290 time to create 1 rle with old method : 0.025912761688232422 length of segment : 226 time for calcul the mask position with numpy : 0.006357431411743164 nb_pixel_total : 261717 time to create 1 rle with new method : 0.014618158340454102 length of segment : 677 time for calcul the mask position with numpy : 0.0001881122589111328 nb_pixel_total : 10369 time to create 1 rle with old method : 0.012118101119995117 length of segment : 71 time for calcul the mask position with numpy : 0.0001614093780517578 nb_pixel_total : 9502 time to create 1 rle with old method : 0.011288881301879883 length of segment : 87 time for calcul the mask position with numpy : 0.0002474784851074219 nb_pixel_total : 10751 time to create 1 rle with old method : 0.012346982955932617 length of segment : 202 time for calcul the mask position with numpy : 0.00039386749267578125 nb_pixel_total : 21408 time to create 1 rle with old method : 0.024497032165527344 length of segment : 237 time for calcul the mask position with numpy : 0.0005421638488769531 nb_pixel_total : 28933 time to create 1 rle with old method : 0.03305244445800781 length of segment : 170 time for calcul the mask position with numpy : 0.005120038986206055 nb_pixel_total : 281376 time to create 1 rle with new method : 0.02644181251525879 length of segment : 694 time for calcul the mask position with numpy : 0.0004730224609375 nb_pixel_total : 17119 time to create 1 rle with old method : 0.019428014755249023 length of segment : 213 time for calcul the mask position with numpy : 0.0013689994812011719 nb_pixel_total : 55141 time to create 1 rle with old method : 0.06692337989807129 length of segment : 494 time for calcul the mask position with numpy : 0.0003209114074707031 nb_pixel_total : 12059 time to create 1 rle with old method : 0.013971090316772461 length of segment : 144 time for calcul the mask position with numpy : 0.0006890296936035156 nb_pixel_total : 37167 time to create 1 rle with old method : 0.04225492477416992 length of segment : 347 time for calcul the mask position with numpy : 0.0003948211669921875 nb_pixel_total : 19642 time to create 1 rle with old method : 0.023123502731323242 length of segment : 122 time for calcul the mask position with numpy : 0.002080678939819336 nb_pixel_total : 101532 time to create 1 rle with old method : 0.12024235725402832 length of segment : 585 time for calcul the mask position with numpy : 0.00031375885009765625 nb_pixel_total : 11627 time to create 1 rle with old method : 0.013633012771606445 length of segment : 145 time for calcul the mask position with numpy : 0.00042510032653808594 nb_pixel_total : 16338 time to create 1 rle with old method : 0.01930713653564453 length of segment : 228 time for calcul the mask position with numpy : 0.0014412403106689453 nb_pixel_total : 67399 time to create 1 rle with old method : 0.08125090599060059 length of segment : 292 time for calcul the mask position with numpy : 0.0010714530944824219 nb_pixel_total : 49652 time to create 1 rle with old method : 0.06078195571899414 length of segment : 308 time for calcul the mask position with numpy : 0.0009758472442626953 nb_pixel_total : 45107 time to create 1 rle with old method : 0.05129647254943848 length of segment : 304 time for calcul the mask position with numpy : 0.0005700588226318359 nb_pixel_total : 31074 time to create 1 rle with old method : 0.035498857498168945 length of segment : 228 time for calcul the mask position with numpy : 0.002508401870727539 nb_pixel_total : 146494 time to create 1 rle with old method : 0.16558146476745605 length of segment : 697 time for calcul the mask position with numpy : 0.0007429122924804688 nb_pixel_total : 11196 time to create 1 rle with old method : 0.013119220733642578 length of segment : 138 time for calcul the mask position with numpy : 0.0007367134094238281 nb_pixel_total : 16986 time to create 1 rle with old method : 0.02358698844909668 length of segment : 146 time for calcul the mask position with numpy : 0.0011756420135498047 nb_pixel_total : 29224 time to create 1 rle with old method : 0.04085850715637207 length of segment : 178 time for calcul the mask position with numpy : 0.002467632293701172 nb_pixel_total : 65501 time to create 1 rle with old method : 0.07494354248046875 length of segment : 441 time for calcul the mask position with numpy : 0.0005762577056884766 nb_pixel_total : 7269 time to create 1 rle with old method : 0.008736848831176758 length of segment : 124 time for calcul the mask position with numpy : 0.000919342041015625 nb_pixel_total : 24231 time to create 1 rle with old method : 0.02776932716369629 length of segment : 222 time for calcul the mask position with numpy : 0.002754688262939453 nb_pixel_total : 11189 time to create 1 rle with old method : 0.012721538543701172 length of segment : 105 time for calcul the mask position with numpy : 0.0017404556274414062 nb_pixel_total : 29500 time to create 1 rle with old method : 0.03300285339355469 length of segment : 281 time for calcul the mask position with numpy : 0.0052106380462646484 nb_pixel_total : 180778 time to create 1 rle with new method : 0.009367704391479492 length of segment : 368 time for calcul the mask position with numpy : 0.0022869110107421875 nb_pixel_total : 41345 time to create 1 rle with old method : 0.046567440032958984 length of segment : 291 time for calcul the mask position with numpy : 0.0006234645843505859 nb_pixel_total : 15635 time to create 1 rle with old method : 0.01766800880432129 length of segment : 199 time for calcul the mask position with numpy : 0.0007088184356689453 nb_pixel_total : 20512 time to create 1 rle with old method : 0.023445606231689453 length of segment : 165 time for calcul the mask position with numpy : 0.0003936290740966797 nb_pixel_total : 7288 time to create 1 rle with old method : 0.008656501770019531 length of segment : 112 time for calcul the mask position with numpy : 0.0004820823669433594 nb_pixel_total : 11968 time to create 1 rle with old method : 0.013755083084106445 length of segment : 159 time for calcul the mask position with numpy : 0.0021932125091552734 nb_pixel_total : 58795 time to create 1 rle with old method : 0.06391310691833496 length of segment : 474 time for calcul the mask position with numpy : 0.0010712146759033203 nb_pixel_total : 18901 time to create 1 rle with old method : 0.021316051483154297 length of segment : 239 time for calcul the mask position with numpy : 0.002024412155151367 nb_pixel_total : 43314 time to create 1 rle with old method : 0.04724884033203125 length of segment : 282 time for calcul the mask position with numpy : 0.0011119842529296875 nb_pixel_total : 34012 time to create 1 rle with old method : 0.038962602615356445 length of segment : 151 time for calcul the mask position with numpy : 0.0030269622802734375 nb_pixel_total : 81045 time to create 1 rle with old method : 0.09676623344421387 length of segment : 304 time for calcul the mask position with numpy : 0.0018384456634521484 nb_pixel_total : 77611 time to create 1 rle with old method : 0.08428359031677246 length of segment : 218 time for calcul the mask position with numpy : 0.0010726451873779297 nb_pixel_total : 35785 time to create 1 rle with old method : 0.03943324089050293 length of segment : 164 time for calcul the mask position with numpy : 0.0013413429260253906 nb_pixel_total : 36403 time to create 1 rle with old method : 0.03986167907714844 length of segment : 326 time for calcul the mask position with numpy : 0.0021648406982421875 nb_pixel_total : 60441 time to create 1 rle with old method : 0.06848835945129395 length of segment : 347 time for calcul the mask position with numpy : 0.0003859996795654297 nb_pixel_total : 7564 time to create 1 rle with old method : 0.008889436721801758 length of segment : 128 time for calcul the mask position with numpy : 0.0005145072937011719 nb_pixel_total : 10732 time to create 1 rle with old method : 0.01262044906616211 length of segment : 141 time for calcul the mask position with numpy : 0.05455923080444336 nb_pixel_total : 797033 time to create 1 rle with new method : 0.47542452812194824 length of segment : 1663 time for calcul the mask position with numpy : 0.006309986114501953 nb_pixel_total : 194110 time to create 1 rle with new method : 0.012652397155761719 length of segment : 648 time for calcul the mask position with numpy : 0.0016217231750488281 nb_pixel_total : 91046 time to create 1 rle with old method : 0.11130023002624512 length of segment : 247 time for calcul the mask position with numpy : 0.0005631446838378906 nb_pixel_total : 15527 time to create 1 rle with old method : 0.023030519485473633 length of segment : 161 time for calcul the mask position with numpy : 0.002578258514404297 nb_pixel_total : 97201 time to create 1 rle with old method : 0.1475996971130371 length of segment : 437 time for calcul the mask position with numpy : 0.0011103153228759766 nb_pixel_total : 36370 time to create 1 rle with old method : 0.054903507232666016 length of segment : 262 time for calcul the mask position with numpy : 0.0032095909118652344 nb_pixel_total : 74781 time to create 1 rle with old method : 0.08759951591491699 length of segment : 435 time for calcul the mask position with numpy : 0.010790824890136719 nb_pixel_total : 418731 time to create 1 rle with new method : 0.021932125091552734 length of segment : 1333 time for calcul the mask position with numpy : 0.0006871223449707031 nb_pixel_total : 22138 time to create 1 rle with old method : 0.02771306037902832 length of segment : 169 time for calcul the mask position with numpy : 0.0015926361083984375 nb_pixel_total : 56442 time to create 1 rle with old method : 0.06262707710266113 length of segment : 176 time for calcul the mask position with numpy : 0.00142669677734375 nb_pixel_total : 38368 time to create 1 rle with old method : 0.042938232421875 length of segment : 317 time for calcul the mask position with numpy : 0.0008413791656494141 nb_pixel_total : 29048 time to create 1 rle with old method : 0.03205227851867676 length of segment : 203 time for calcul the mask position with numpy : 0.0005254745483398438 nb_pixel_total : 15410 time to create 1 rle with old method : 0.018018007278442383 length of segment : 124 time for calcul the mask position with numpy : 0.0023648738861083984 nb_pixel_total : 72470 time to create 1 rle with old method : 0.08177852630615234 length of segment : 399 time for calcul the mask position with numpy : 0.00039505958557128906 nb_pixel_total : 11744 time to create 1 rle with old method : 0.014235258102416992 length of segment : 123 time for calcul the mask position with numpy : 0.0022530555725097656 nb_pixel_total : 79620 time to create 1 rle with old method : 0.093231201171875 length of segment : 378 time for calcul the mask position with numpy : 0.0003864765167236328 nb_pixel_total : 9094 time to create 1 rle with old method : 0.010710477828979492 length of segment : 112 time for calcul the mask position with numpy : 0.0009307861328125 nb_pixel_total : 26490 time to create 1 rle with old method : 0.03060436248779297 length of segment : 198 time for calcul the mask position with numpy : 0.0011930465698242188 nb_pixel_total : 39369 time to create 1 rle with old method : 0.04539632797241211 length of segment : 213 time for calcul the mask position with numpy : 0.0005471706390380859 nb_pixel_total : 14035 time to create 1 rle with old method : 0.016089677810668945 length of segment : 143 time for calcul the mask position with numpy : 0.00020885467529296875 nb_pixel_total : 8539 time to create 1 rle with old method : 0.010467529296875 length of segment : 53 time for calcul the mask position with numpy : 0.00041937828063964844 nb_pixel_total : 12557 time to create 1 rle with old method : 0.014663934707641602 length of segment : 145 time for calcul the mask position with numpy : 0.0007777214050292969 nb_pixel_total : 13702 time to create 1 rle with old method : 0.015818357467651367 length of segment : 405 time for calcul the mask position with numpy : 0.0005483627319335938 nb_pixel_total : 10396 time to create 1 rle with old method : 0.012327432632446289 length of segment : 139 time for calcul the mask position with numpy : 0.00075531005859375 nb_pixel_total : 16574 time to create 1 rle with old method : 0.020280122756958008 length of segment : 179 time for calcul the mask position with numpy : 0.0027856826782226562 nb_pixel_total : 75230 time to create 1 rle with old method : 0.08596372604370117 length of segment : 312 time for calcul the mask position with numpy : 0.0007388591766357422 nb_pixel_total : 8898 time to create 1 rle with old method : 0.011076927185058594 length of segment : 227 time for calcul the mask position with numpy : 0.001983642578125 nb_pixel_total : 24975 time to create 1 rle with old method : 0.028921127319335938 length of segment : 362 time for calcul the mask position with numpy : 0.0025637149810791016 nb_pixel_total : 67988 time to create 1 rle with old method : 0.08013033866882324 length of segment : 353 time for calcul the mask position with numpy : 0.002701997756958008 nb_pixel_total : 73809 time to create 1 rle with old method : 0.08694314956665039 length of segment : 262 time for calcul the mask position with numpy : 0.011420249938964844 nb_pixel_total : 261636 time to create 1 rle with new method : 0.017568588256835938 length of segment : 728 time for calcul the mask position with numpy : 0.0124359130859375 nb_pixel_total : 378778 time to create 1 rle with new method : 0.04942464828491211 length of segment : 830 time for calcul the mask position with numpy : 0.0021779537200927734 nb_pixel_total : 76274 time to create 1 rle with old method : 0.08594417572021484 length of segment : 396 time for calcul the mask position with numpy : 0.0009508132934570312 nb_pixel_total : 21615 time to create 1 rle with old method : 0.024476289749145508 length of segment : 195 time for calcul the mask position with numpy : 0.0018763542175292969 nb_pixel_total : 49318 time to create 1 rle with old method : 0.05572938919067383 length of segment : 425 time for calcul the mask position with numpy : 0.0026292800903320312 nb_pixel_total : 73021 time to create 1 rle with old method : 0.08434319496154785 length of segment : 464 time for calcul the mask position with numpy : 0.00023102760314941406 nb_pixel_total : 6310 time to create 1 rle with old method : 0.007384300231933594 length of segment : 97 time for calcul the mask position with numpy : 0.0023965835571289062 nb_pixel_total : 74337 time to create 1 rle with old method : 0.08623576164245605 length of segment : 360 time for calcul the mask position with numpy : 0.002023458480834961 nb_pixel_total : 96600 time to create 1 rle with old method : 0.10732388496398926 length of segment : 315 time for calcul the mask position with numpy : 0.0007956027984619141 nb_pixel_total : 28817 time to create 1 rle with old method : 0.03349781036376953 length of segment : 253 time for calcul the mask position with numpy : 0.0013599395751953125 nb_pixel_total : 83761 time to create 1 rle with old method : 0.09465432167053223 length of segment : 416 time for calcul the mask position with numpy : 0.0025882720947265625 nb_pixel_total : 135598 time to create 1 rle with old method : 0.15233731269836426 length of segment : 536 time for calcul the mask position with numpy : 0.0011327266693115234 nb_pixel_total : 48681 time to create 1 rle with old method : 0.0636739730834961 length of segment : 335 time for calcul the mask position with numpy : 0.00042724609375 nb_pixel_total : 10672 time to create 1 rle with old method : 0.01254582405090332 length of segment : 144 time for calcul the mask position with numpy : 0.0020470619201660156 nb_pixel_total : 96345 time to create 1 rle with old method : 0.10865592956542969 length of segment : 322 time for calcul the mask position with numpy : 0.001825571060180664 nb_pixel_total : 76931 time to create 1 rle with old method : 0.0871438980102539 length of segment : 351 time for calcul the mask position with numpy : 0.0009200572967529297 nb_pixel_total : 30739 time to create 1 rle with old method : 0.035178184509277344 length of segment : 262 time for calcul the mask position with numpy : 0.0005326271057128906 nb_pixel_total : 10788 time to create 1 rle with old method : 0.012776613235473633 length of segment : 179 time for calcul the mask position with numpy : 0.0011937618255615234 nb_pixel_total : 46464 time to create 1 rle with old method : 0.05280160903930664 length of segment : 498 time for calcul the mask position with numpy : 0.00028395652770996094 nb_pixel_total : 4116 time to create 1 rle with old method : 0.005040407180786133 length of segment : 50 time for calcul the mask position with numpy : 0.0002541542053222656 nb_pixel_total : 6584 time to create 1 rle with old method : 0.007781267166137695 length of segment : 124 time for calcul the mask position with numpy : 0.002412557601928711 nb_pixel_total : 130319 time to create 1 rle with old method : 0.14749836921691895 length of segment : 443 time for calcul the mask position with numpy : 0.0014472007751464844 nb_pixel_total : 40530 time to create 1 rle with old method : 0.04630756378173828 length of segment : 250 time for calcul the mask position with numpy : 0.004647016525268555 nb_pixel_total : 142469 time to create 1 rle with old method : 0.20546936988830566 length of segment : 364 time for calcul the mask position with numpy : 0.008775711059570312 nb_pixel_total : 282172 time to create 1 rle with new method : 0.016394615173339844 length of segment : 664 time for calcul the mask position with numpy : 0.0005168914794921875 nb_pixel_total : 14843 time to create 1 rle with old method : 0.017272472381591797 length of segment : 142 time for calcul the mask position with numpy : 0.0009086132049560547 nb_pixel_total : 27708 time to create 1 rle with old method : 0.03264427185058594 length of segment : 157 time for calcul the mask position with numpy : 0.0020041465759277344 nb_pixel_total : 58178 time to create 1 rle with old method : 0.07203984260559082 length of segment : 273 time for calcul the mask position with numpy : 0.0003910064697265625 nb_pixel_total : 20545 time to create 1 rle with old method : 0.023740053176879883 length of segment : 183 time for calcul the mask position with numpy : 0.0006163120269775391 nb_pixel_total : 12910 time to create 1 rle with old method : 0.01556849479675293 length of segment : 114 time for calcul the mask position with numpy : 0.0039730072021484375 nb_pixel_total : 144371 time to create 1 rle with old method : 0.17123937606811523 length of segment : 442 time for calcul the mask position with numpy : 0.005855083465576172 nb_pixel_total : 149496 time to create 1 rle with old method : 0.17390155792236328 length of segment : 899 time for calcul the mask position with numpy : 0.0014753341674804688 nb_pixel_total : 51488 time to create 1 rle with old method : 0.061449289321899414 length of segment : 410 time for calcul the mask position with numpy : 0.0018761157989501953 nb_pixel_total : 53495 time to create 1 rle with old method : 0.08508086204528809 length of segment : 356 time for calcul the mask position with numpy : 0.0013551712036132812 nb_pixel_total : 54636 time to create 1 rle with old method : 0.0677480697631836 length of segment : 317 time for calcul the mask position with numpy : 0.0006258487701416016 nb_pixel_total : 12676 time to create 1 rle with old method : 0.021304607391357422 length of segment : 108 time for calcul the mask position with numpy : 0.003943204879760742 nb_pixel_total : 112154 time to create 1 rle with old method : 0.1427309513092041 length of segment : 234 time for calcul the mask position with numpy : 0.0006563663482666016 nb_pixel_total : 16629 time to create 1 rle with old method : 0.019093990325927734 length of segment : 144 time for calcul the mask position with numpy : 0.003225564956665039 nb_pixel_total : 107315 time to create 1 rle with old method : 0.12080883979797363 length of segment : 474 time for calcul the mask position with numpy : 0.0008153915405273438 nb_pixel_total : 21101 time to create 1 rle with old method : 0.024813175201416016 length of segment : 149 time for calcul the mask position with numpy : 0.0008530616760253906 nb_pixel_total : 27313 time to create 1 rle with old method : 0.03203630447387695 length of segment : 146 time for calcul the mask position with numpy : 0.00030493736267089844 nb_pixel_total : 6175 time to create 1 rle with old method : 0.009291887283325195 length of segment : 56 time for calcul the mask position with numpy : 0.0033457279205322266 nb_pixel_total : 70970 time to create 1 rle with old method : 0.10012197494506836 length of segment : 472 time for calcul the mask position with numpy : 0.0014514923095703125 nb_pixel_total : 52161 time to create 1 rle with old method : 0.05926227569580078 length of segment : 281 time for calcul the mask position with numpy : 0.0003104209899902344 nb_pixel_total : 4911 time to create 1 rle with old method : 0.0058057308197021484 length of segment : 104 time for calcul the mask position with numpy : 0.0016274452209472656 nb_pixel_total : 53141 time to create 1 rle with old method : 0.062451839447021484 length of segment : 309 time for calcul the mask position with numpy : 0.006011962890625 nb_pixel_total : 236260 time to create 1 rle with new method : 0.009007453918457031 length of segment : 820 time for calcul the mask position with numpy : 0.0041882991790771484 nb_pixel_total : 168816 time to create 1 rle with new method : 0.005655050277709961 length of segment : 404 time for calcul the mask position with numpy : 0.006070375442504883 nb_pixel_total : 227704 time to create 1 rle with new method : 0.009560346603393555 length of segment : 1025 time for calcul the mask position with numpy : 0.0008416175842285156 nb_pixel_total : 24851 time to create 1 rle with old method : 0.028472900390625 length of segment : 160 time for calcul the mask position with numpy : 0.0020711421966552734 nb_pixel_total : 61386 time to create 1 rle with old method : 0.07036066055297852 length of segment : 267 time for calcul the mask position with numpy : 0.00074005126953125 nb_pixel_total : 35487 time to create 1 rle with old method : 0.04092240333557129 length of segment : 393 time for calcul the mask position with numpy : 0.0011930465698242188 nb_pixel_total : 28583 time to create 1 rle with old method : 0.033165931701660156 length of segment : 220 time for calcul the mask position with numpy : 0.0029158592224121094 nb_pixel_total : 94136 time to create 1 rle with old method : 0.10717201232910156 length of segment : 392 time for calcul the mask position with numpy : 0.0037484169006347656 nb_pixel_total : 51218 time to create 1 rle with old method : 0.058188676834106445 length of segment : 362 time for calcul the mask position with numpy : 0.0011339187622070312 nb_pixel_total : 26512 time to create 1 rle with old method : 0.03117513656616211 length of segment : 174 time for calcul the mask position with numpy : 0.005550861358642578 nb_pixel_total : 152984 time to create 1 rle with new method : 0.010221242904663086 length of segment : 785 time for calcul the mask position with numpy : 0.0012531280517578125 nb_pixel_total : 40174 time to create 1 rle with old method : 0.04677557945251465 length of segment : 145 time for calcul the mask position with numpy : 0.00021457672119140625 nb_pixel_total : 10141 time to create 1 rle with old method : 0.01342320442199707 length of segment : 134 time for calcul the mask position with numpy : 0.0014061927795410156 nb_pixel_total : 63382 time to create 1 rle with old method : 0.07258319854736328 length of segment : 320 time for calcul the mask position with numpy : 0.0034332275390625 nb_pixel_total : 60885 time to create 1 rle with old method : 0.07020115852355957 length of segment : 580 time spent for convertir_results : 15.13012957572937 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 141 chid ids of type : 3594 Number RLEs to save : 44458 save missing photos in datou_result : time spend for datou_step_exec : 99.24514818191528 time spend to save output : 18.17308783531189 total time spend for step 1 : 117.41823601722717 step2:crop_condition Thu May 22 08:32:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 11 ! batch 1 Loaded 141 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 88 About to insert : list_path_to_insert length 88 new photo from crops ! About to upload 88 photos upload in portfolio : 3736932 init cache_photo without model_param we have 88 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747895577_1952861 we have uploaded 88 photos in the portfolio 3736932 time of upload the photos Elapsed time : 25.576234102249146 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 16 About to insert : list_path_to_insert length 16 new photo from crops ! About to upload 16 photos upload in portfolio : 3736932 init cache_photo without model_param we have 16 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747895608_1952861 we have uploaded 16 photos in the portfolio 3736932 time of upload the photos Elapsed time : 3.698993682861328 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747895613_1952861 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.823969841003418 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 31 About to insert : list_path_to_insert length 31 new photo from crops ! About to upload 31 photos upload in portfolio : 3736932 init cache_photo without model_param we have 31 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747895627_1952861 we have uploaded 31 photos in the portfolio 3736932 time of upload the photos Elapsed time : 7.098951816558838 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747895636_1952861 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8565895557403564 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747895639_1952861 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.770684003829956 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1360423397, 1360423392, 1360423153, 1360423136, 1360423098, 1360423023, 1360423012, 1360422992, 1360422967, 1360422951, 1360422948] Looping around the photos to save general results len do output : 141 /1360446599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1360446776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423397', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423392', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423153', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423136', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423098', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423023', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423012', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360422992', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360422967', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360422951', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360422948', None, None, None, None, None, '2933152') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 434 time used for this insertion : 0.4249730110168457 save_final save missing photos in datou_result : time spend for datou_step_exec : 90.92973256111145 time spend to save output : 0.4313805103302002 total time spend for step 2 : 91.36111307144165 step3:rle_unique_nms_with_priority Thu May 22 08:34:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 141 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 10 nb_hashtags : 4 time to prepare the origin masks : 7.122307300567627 time for calcul the mask position with numpy : 0.7689716815948486 nb_pixel_total : 6531672 time to create 1 rle with new method : 1.702702283859253 time for calcul the mask position with numpy : 0.023728609085083008 nb_pixel_total : 21408 time to create 1 rle with old method : 0.024266481399536133 time for calcul the mask position with numpy : 0.024167537689208984 nb_pixel_total : 10751 time to create 1 rle with old method : 0.012268543243408203 time for calcul the mask position with numpy : 0.021106481552124023 nb_pixel_total : 9502 time to create 1 rle with old method : 0.01097249984741211 time for calcul the mask position with numpy : 0.02205514907836914 nb_pixel_total : 10369 time to create 1 rle with old method : 0.011832237243652344 time for calcul the mask position with numpy : 0.025364160537719727 nb_pixel_total : 261717 time to create 1 rle with new method : 1.7033419609069824 time for calcul the mask position with numpy : 0.022043704986572266 nb_pixel_total : 22290 time to create 1 rle with old method : 0.025373458862304688 time for calcul the mask position with numpy : 0.03661346435546875 nb_pixel_total : 26368 time to create 1 rle with old method : 0.03537178039550781 time for calcul the mask position with numpy : 0.03908109664916992 nb_pixel_total : 23234 time to create 1 rle with old method : 0.026617050170898438 time for calcul the mask position with numpy : 0.04002547264099121 nb_pixel_total : 119426 time to create 1 rle with old method : 0.13482022285461426 time for calcul the mask position with numpy : 0.042201995849609375 nb_pixel_total : 13503 time to create 1 rle with old method : 0.015385866165161133 create new chi : 4.833805799484253 time to delete rle : 0.019465208053588867 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++Number RLEs to save : 7468 TO DO : save crop sub photo not yet done ! save time : 1.5950467586517334 nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 9.720626831054688 time for calcul the mask position with numpy : 0.5599040985107422 nb_pixel_total : 6006917 time to create 1 rle with new method : 1.8835887908935547 time for calcul the mask position with numpy : 0.04155278205871582 nb_pixel_total : 65501 time to create 1 rle with old method : 0.07735395431518555 time for calcul the mask position with numpy : 0.038698673248291016 nb_pixel_total : 29224 time to create 1 rle with old method : 0.034432411193847656 time for calcul the mask position with numpy : 0.04590797424316406 nb_pixel_total : 16986 time to create 1 rle with old method : 0.028856992721557617 time for calcul the mask position with numpy : 0.07408308982849121 nb_pixel_total : 11196 time to create 1 rle with old method : 0.014998912811279297 time for calcul the mask position with numpy : 0.042894601821899414 nb_pixel_total : 146494 time to create 1 rle with old method : 0.17134904861450195 time for calcul the mask position with numpy : 0.03489422798156738 nb_pixel_total : 31074 time to create 1 rle with old method : 0.03722500801086426 time for calcul the mask position with numpy : 0.030948638916015625 nb_pixel_total : 45107 time to create 1 rle with old method : 0.05440926551818848 time for calcul the mask position with numpy : 0.023406505584716797 nb_pixel_total : 49652 time to create 1 rle with old method : 0.0562593936920166 time for calcul the mask position with numpy : 0.025220155715942383 nb_pixel_total : 67399 time to create 1 rle with old method : 0.08487749099731445 time for calcul the mask position with numpy : 0.023411035537719727 nb_pixel_total : 16094 time to create 1 rle with old method : 0.018298625946044922 time for calcul the mask position with numpy : 0.021619081497192383 nb_pixel_total : 11627 time to create 1 rle with old method : 0.013368368148803711 time for calcul the mask position with numpy : 0.02225947380065918 nb_pixel_total : 101532 time to create 1 rle with old method : 0.1179955005645752 time for calcul the mask position with numpy : 0.02440786361694336 nb_pixel_total : 19642 time to create 1 rle with old method : 0.022643327713012695 time for calcul the mask position with numpy : 0.03167843818664551 nb_pixel_total : 37167 time to create 1 rle with old method : 0.04241681098937988 time for calcul the mask position with numpy : 0.027808427810668945 nb_pixel_total : 12059 time to create 1 rle with old method : 0.014086246490478516 time for calcul the mask position with numpy : 0.03127861022949219 nb_pixel_total : 55141 time to create 1 rle with old method : 0.061563730239868164 time for calcul the mask position with numpy : 0.03537464141845703 nb_pixel_total : 17119 time to create 1 rle with old method : 0.019735336303710938 time for calcul the mask position with numpy : 0.03937959671020508 nb_pixel_total : 281376 time to create 1 rle with new method : 0.7588365077972412 time for calcul the mask position with numpy : 0.038582563400268555 nb_pixel_total : 28933 time to create 1 rle with old method : 0.03266263008117676 create new chi : 4.844855308532715 time to delete rle : 0.0021195411682128906 batch 1 Loaded 39 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 13879 TO DO : save crop sub photo not yet done ! save time : 3.1107051372528076 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 8.709712743759155 time for calcul the mask position with numpy : 1.0623526573181152 nb_pixel_total : 6579515 time to create 1 rle with new method : 1.2458784580230713 time for calcul the mask position with numpy : 0.02248549461364746 nb_pixel_total : 43314 time to create 1 rle with old method : 0.04685544967651367 time for calcul the mask position with numpy : 0.024149417877197266 nb_pixel_total : 18901 time to create 1 rle with old method : 0.024202585220336914 time for calcul the mask position with numpy : 0.0242459774017334 nb_pixel_total : 58795 time to create 1 rle with old method : 0.06411051750183105 time for calcul the mask position with numpy : 0.023420333862304688 nb_pixel_total : 11968 time to create 1 rle with old method : 0.01358652114868164 time for calcul the mask position with numpy : 0.024892330169677734 nb_pixel_total : 7288 time to create 1 rle with old method : 0.008229255676269531 time for calcul the mask position with numpy : 0.023087263107299805 nb_pixel_total : 20512 time to create 1 rle with old method : 0.02637457847595215 time for calcul the mask position with numpy : 0.022937297821044922 nb_pixel_total : 15635 time to create 1 rle with old method : 0.01732182502746582 time for calcul the mask position with numpy : 0.022806167602539062 nb_pixel_total : 41345 time to create 1 rle with old method : 0.04534745216369629 time for calcul the mask position with numpy : 0.02281355857849121 nb_pixel_total : 180778 time to create 1 rle with new method : 1.0679311752319336 time for calcul the mask position with numpy : 0.02513885498046875 nb_pixel_total : 29500 time to create 1 rle with old method : 0.033521413803100586 time for calcul the mask position with numpy : 0.02176976203918457 nb_pixel_total : 11189 time to create 1 rle with old method : 0.012545585632324219 time for calcul the mask position with numpy : 0.03575563430786133 nb_pixel_total : 24231 time to create 1 rle with old method : 0.037592172622680664 time for calcul the mask position with numpy : 0.04156494140625 nb_pixel_total : 7269 time to create 1 rle with old method : 0.010874748229980469 create new chi : 4.11519455909729 time to delete rle : 0.001965761184692383 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 8202 TO DO : save crop sub photo not yet done ! save time : 3.008784770965576 nb_obj : 15 nb_hashtags : 3 time to prepare the origin masks : 10.462574005126953 time for calcul the mask position with numpy : 0.8962550163269043 nb_pixel_total : 5438408 time to create 1 rle with new method : 1.5769317150115967 time for calcul the mask position with numpy : 0.03938937187194824 nb_pixel_total : 74781 time to create 1 rle with old method : 0.08320951461791992 time for calcul the mask position with numpy : 0.034800052642822266 nb_pixel_total : 36370 time to create 1 rle with old method : 0.04121065139770508 time for calcul the mask position with numpy : 0.03794550895690918 nb_pixel_total : 97201 time to create 1 rle with old method : 0.10827827453613281 time for calcul the mask position with numpy : 0.039521217346191406 nb_pixel_total : 15527 time to create 1 rle with old method : 0.017489194869995117 time for calcul the mask position with numpy : 0.03690528869628906 nb_pixel_total : 91046 time to create 1 rle with old method : 0.10145974159240723 time for calcul the mask position with numpy : 0.03886818885803223 nb_pixel_total : 157226 time to create 1 rle with new method : 1.6774346828460693 time for calcul the mask position with numpy : 0.043831586837768555 nb_pixel_total : 796088 time to create 1 rle with new method : 0.8922839164733887 time for calcul the mask position with numpy : 0.036611080169677734 nb_pixel_total : 10732 time to create 1 rle with old method : 0.012056112289428711 time for calcul the mask position with numpy : 0.03682875633239746 nb_pixel_total : 7564 time to create 1 rle with old method : 0.008520126342773438 time for calcul the mask position with numpy : 0.03672051429748535 nb_pixel_total : 60441 time to create 1 rle with old method : 0.06818866729736328 time for calcul the mask position with numpy : 0.03918123245239258 nb_pixel_total : 36403 time to create 1 rle with old method : 0.040694236755371094 time for calcul the mask position with numpy : 0.036592721939086914 nb_pixel_total : 35785 time to create 1 rle with old method : 0.0401456356048584 time for calcul the mask position with numpy : 0.03717231750488281 nb_pixel_total : 77611 time to create 1 rle with old method : 0.08374810218811035 time for calcul the mask position with numpy : 0.03536677360534668 nb_pixel_total : 81045 time to create 1 rle with old method : 0.08870196342468262 time for calcul the mask position with numpy : 0.03949260711669922 nb_pixel_total : 34012 time to create 1 rle with old method : 0.038179874420166016 create new chi : 6.44938063621521 time to delete rle : 0.0027697086334228516 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 12867 TO DO : save crop sub photo not yet done ! save time : 4.284044981002808 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 9.858940362930298 time for calcul the mask position with numpy : 0.5503480434417725 nb_pixel_total : 6186135 time to create 1 rle with new method : 1.1097700595855713 time for calcul the mask position with numpy : 0.037496328353881836 nb_pixel_total : 10067 time to create 1 rle with old method : 0.01144719123840332 time for calcul the mask position with numpy : 0.03762555122375488 nb_pixel_total : 12557 time to create 1 rle with old method : 0.015362262725830078 time for calcul the mask position with numpy : 0.03585386276245117 nb_pixel_total : 8539 time to create 1 rle with old method : 0.00966954231262207 time for calcul the mask position with numpy : 0.03604698181152344 nb_pixel_total : 14035 time to create 1 rle with old method : 0.015879154205322266 time for calcul the mask position with numpy : 0.03787398338317871 nb_pixel_total : 39369 time to create 1 rle with old method : 0.04448390007019043 time for calcul the mask position with numpy : 0.02730393409729004 nb_pixel_total : 26490 time to create 1 rle with old method : 0.030931472778320312 time for calcul the mask position with numpy : 0.030020952224731445 nb_pixel_total : 9094 time to create 1 rle with old method : 0.010423421859741211 time for calcul the mask position with numpy : 0.02592611312866211 nb_pixel_total : 79603 time to create 1 rle with old method : 0.09132885932922363 time for calcul the mask position with numpy : 0.023298025131225586 nb_pixel_total : 11744 time to create 1 rle with old method : 0.01350259780883789 time for calcul the mask position with numpy : 0.022611141204833984 nb_pixel_total : 72470 time to create 1 rle with old method : 0.08182621002197266 time for calcul the mask position with numpy : 0.021757841110229492 nb_pixel_total : 15410 time to create 1 rle with old method : 0.017377376556396484 time for calcul the mask position with numpy : 0.023332595825195312 nb_pixel_total : 29048 time to create 1 rle with old method : 0.03413724899291992 time for calcul the mask position with numpy : 0.023058414459228516 nb_pixel_total : 38368 time to create 1 rle with old method : 0.04665732383728027 time for calcul the mask position with numpy : 0.02538585662841797 nb_pixel_total : 56442 time to create 1 rle with old method : 0.08172726631164551 time for calcul the mask position with numpy : 0.024805068969726562 nb_pixel_total : 22138 time to create 1 rle with old method : 0.03650832176208496 time for calcul the mask position with numpy : 0.02753615379333496 nb_pixel_total : 418731 time to create 1 rle with new method : 1.6711053848266602 create new chi : 4.406832456588745 time to delete rle : 0.0019576549530029297 batch 1 Loaded 33 chid ids of type : 3594 +++++++++++++++++++++++Number RLEs to save : 10981 TO DO : save crop sub photo not yet done ! save time : 1.5122175216674805 nb_obj : 14 nb_hashtags : 5 time to prepare the origin masks : 10.826587677001953 time for calcul the mask position with numpy : 1.102102279663086 nb_pixel_total : 5905418 time to create 1 rle with new method : 1.271498441696167 time for calcul the mask position with numpy : 0.023510217666625977 nb_pixel_total : 6310 time to create 1 rle with old method : 0.007088184356689453 time for calcul the mask position with numpy : 0.02251458168029785 nb_pixel_total : 73021 time to create 1 rle with old method : 0.08150959014892578 time for calcul the mask position with numpy : 0.02367568016052246 nb_pixel_total : 49318 time to create 1 rle with old method : 0.07156991958618164 time for calcul the mask position with numpy : 0.023699522018432617 nb_pixel_total : 21615 time to create 1 rle with old method : 0.024515151977539062 time for calcul the mask position with numpy : 0.029550790786743164 nb_pixel_total : 76274 time to create 1 rle with old method : 0.0850532054901123 time for calcul the mask position with numpy : 0.02521991729736328 nb_pixel_total : 378778 time to create 1 rle with new method : 1.5416538715362549 time for calcul the mask position with numpy : 0.025228023529052734 nb_pixel_total : 261636 time to create 1 rle with new method : 1.0297565460205078 time for calcul the mask position with numpy : 0.023705720901489258 nb_pixel_total : 73809 time to create 1 rle with old method : 0.08200907707214355 time for calcul the mask position with numpy : 0.02284550666809082 nb_pixel_total : 67988 time to create 1 rle with old method : 0.07542157173156738 time for calcul the mask position with numpy : 0.02328777313232422 nb_pixel_total : 24975 time to create 1 rle with old method : 0.02934098243713379 time for calcul the mask position with numpy : 0.0261690616607666 nb_pixel_total : 8898 time to create 1 rle with old method : 0.010786771774291992 time for calcul the mask position with numpy : 0.025144338607788086 nb_pixel_total : 75230 time to create 1 rle with old method : 0.08724474906921387 time for calcul the mask position with numpy : 0.023576974868774414 nb_pixel_total : 16574 time to create 1 rle with old method : 0.018738985061645508 time for calcul the mask position with numpy : 0.025749921798706055 nb_pixel_total : 10396 time to create 1 rle with old method : 0.01188206672668457 create new chi : 5.968543767929077 time to delete rle : 0.002184629440307617 batch 1 Loaded 29 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 12098 TO DO : save crop sub photo not yet done ! save time : 1.1125919818878174 nb_obj : 6 nb_hashtags : 2 time to prepare the origin masks : 5.563863277435303 time for calcul the mask position with numpy : 1.0562615394592285 nb_pixel_total : 6585404 time to create 1 rle with new method : 1.8706002235412598 time for calcul the mask position with numpy : 0.027504920959472656 nb_pixel_total : 48681 time to create 1 rle with old method : 0.07576346397399902 time for calcul the mask position with numpy : 0.028830766677856445 nb_pixel_total : 132655 time to create 1 rle with old method : 0.16558074951171875 time for calcul the mask position with numpy : 0.026137351989746094 nb_pixel_total : 83746 time to create 1 rle with old method : 0.11081194877624512 time for calcul the mask position with numpy : 0.024030208587646484 nb_pixel_total : 28817 time to create 1 rle with old method : 0.04855513572692871 time for calcul the mask position with numpy : 0.025815963745117188 nb_pixel_total : 96600 time to create 1 rle with old method : 0.12601161003112793 time for calcul the mask position with numpy : 0.02632427215576172 nb_pixel_total : 74337 time to create 1 rle with old method : 0.0896148681640625 create new chi : 3.749664306640625 time to delete rle : 0.001695871353149414 batch 1 Loaded 13 chid ids of type : 3594 ++++++++Number RLEs to save : 6363 TO DO : save crop sub photo not yet done ! save time : 1.111433982849121 nb_obj : 9 nb_hashtags : 3 time to prepare the origin masks : 7.957587003707886 time for calcul the mask position with numpy : 1.3070564270019531 nb_pixel_total : 6642171 time to create 1 rle with new method : 1.2565300464630127 time for calcul the mask position with numpy : 0.04262351989746094 nb_pixel_total : 125430 time to create 1 rle with old method : 0.16766762733459473 time for calcul the mask position with numpy : 0.04400920867919922 nb_pixel_total : 6584 time to create 1 rle with old method : 0.009241819381713867 time for calcul the mask position with numpy : 0.03996610641479492 nb_pixel_total : 4116 time to create 1 rle with old method : 0.006797313690185547 time for calcul the mask position with numpy : 0.04064512252807617 nb_pixel_total : 46464 time to create 1 rle with old method : 0.052521705627441406 time for calcul the mask position with numpy : 0.03780841827392578 nb_pixel_total : 10788 time to create 1 rle with old method : 0.012512683868408203 time for calcul the mask position with numpy : 0.03883004188537598 nb_pixel_total : 30739 time to create 1 rle with old method : 0.03620624542236328 time for calcul the mask position with numpy : 0.041582584381103516 nb_pixel_total : 76931 time to create 1 rle with old method : 0.09025740623474121 time for calcul the mask position with numpy : 0.03728485107421875 nb_pixel_total : 96345 time to create 1 rle with old method : 0.11571812629699707 time for calcul the mask position with numpy : 0.036531686782836914 nb_pixel_total : 10672 time to create 1 rle with old method : 0.012141704559326172 create new chi : 3.4751193523406982 time to delete rle : 0.0013642311096191406 batch 1 Loaded 19 chid ids of type : 3594 ++++++++++Number RLEs to save : 6727 TO DO : save crop sub photo not yet done ! save time : 2.493669033050537 nb_obj : 14 nb_hashtags : 3 time to prepare the origin masks : 7.8980937004089355 time for calcul the mask position with numpy : 0.7455310821533203 nb_pixel_total : 5988281 time to create 1 rle with new method : 1.0694873332977295 time for calcul the mask position with numpy : 0.03871655464172363 nb_pixel_total : 12676 time to create 1 rle with old method : 0.016674280166625977 time for calcul the mask position with numpy : 0.03812432289123535 nb_pixel_total : 51295 time to create 1 rle with old method : 0.06778573989868164 time for calcul the mask position with numpy : 0.037726402282714844 nb_pixel_total : 53495 time to create 1 rle with old method : 0.09136199951171875 time for calcul the mask position with numpy : 0.035132646560668945 nb_pixel_total : 51488 time to create 1 rle with old method : 0.08401775360107422 time for calcul the mask position with numpy : 0.029446125030517578 nb_pixel_total : 149496 time to create 1 rle with old method : 0.1742701530456543 time for calcul the mask position with numpy : 0.03407931327819824 nb_pixel_total : 144371 time to create 1 rle with old method : 0.1691300868988037 time for calcul the mask position with numpy : 0.030434846878051758 nb_pixel_total : 12902 time to create 1 rle with old method : 0.014964580535888672 time for calcul the mask position with numpy : 0.03920793533325195 nb_pixel_total : 20336 time to create 1 rle with old method : 0.023675918579101562 time for calcul the mask position with numpy : 0.03953099250793457 nb_pixel_total : 58178 time to create 1 rle with old method : 0.06639766693115234 time for calcul the mask position with numpy : 0.027585744857788086 nb_pixel_total : 27708 time to create 1 rle with old method : 0.03084874153137207 time for calcul the mask position with numpy : 0.026347637176513672 nb_pixel_total : 14843 time to create 1 rle with old method : 0.016668319702148438 time for calcul the mask position with numpy : 0.02453160285949707 nb_pixel_total : 282172 time to create 1 rle with new method : 0.7564384937286377 time for calcul the mask position with numpy : 0.024564027786254883 nb_pixel_total : 142469 time to create 1 rle with old method : 0.17144775390625 time for calcul the mask position with numpy : 0.03217124938964844 nb_pixel_total : 40530 time to create 1 rle with old method : 0.045096635818481445 create new chi : 4.0712292194366455 time to delete rle : 0.0021674633026123047 batch 1 Loaded 29 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 11430 TO DO : save crop sub photo not yet done ! save time : 3.143815279006958 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 6.504604816436768 time for calcul the mask position with numpy : 0.4342460632324219 nb_pixel_total : 6578370 time to create 1 rle with new method : 1.2376375198364258 time for calcul the mask position with numpy : 0.03900480270385742 nb_pixel_total : 53141 time to create 1 rle with old method : 0.06421208381652832 time for calcul the mask position with numpy : 0.03687453269958496 nb_pixel_total : 4911 time to create 1 rle with old method : 0.0199124813079834 time for calcul the mask position with numpy : 0.03981733322143555 nb_pixel_total : 52161 time to create 1 rle with old method : 0.058687448501586914 time for calcul the mask position with numpy : 0.03655266761779785 nb_pixel_total : 70970 time to create 1 rle with old method : 0.09472036361694336 time for calcul the mask position with numpy : 0.037283897399902344 nb_pixel_total : 6175 time to create 1 rle with old method : 0.008324384689331055 time for calcul the mask position with numpy : 0.032048702239990234 nb_pixel_total : 27313 time to create 1 rle with old method : 0.0306241512298584 time for calcul the mask position with numpy : 0.037950754165649414 nb_pixel_total : 21101 time to create 1 rle with old method : 0.024578332901000977 time for calcul the mask position with numpy : 0.03765869140625 nb_pixel_total : 107315 time to create 1 rle with old method : 0.12543058395385742 time for calcul the mask position with numpy : 0.03722643852233887 nb_pixel_total : 16629 time to create 1 rle with old method : 0.01857304573059082 time for calcul the mask position with numpy : 0.03740954399108887 nb_pixel_total : 112154 time to create 1 rle with old method : 0.12467527389526367 create new chi : 2.664470672607422 time to delete rle : 0.0011701583862304688 batch 1 Loaded 21 chid ids of type : 3594 +++++++++++++Number RLEs to save : 6898 TO DO : save crop sub photo not yet done ! save time : 2.0164244174957275 nb_obj : 15 nb_hashtags : 4 time to prepare the origin masks : 10.745362997055054 time for calcul the mask position with numpy : 0.7789850234985352 nb_pixel_total : 5817387 time to create 1 rle with new method : 0.7619245052337646 time for calcul the mask position with numpy : 0.036107540130615234 nb_pixel_total : 60688 time to create 1 rle with old method : 0.09333348274230957 time for calcul the mask position with numpy : 0.034804344177246094 nb_pixel_total : 43154 time to create 1 rle with old method : 0.10803055763244629 time for calcul the mask position with numpy : 0.04397106170654297 nb_pixel_total : 10141 time to create 1 rle with old method : 0.011406660079956055 time for calcul the mask position with numpy : 0.03489041328430176 nb_pixel_total : 40174 time to create 1 rle with old method : 0.0455470085144043 time for calcul the mask position with numpy : 0.03599071502685547 nb_pixel_total : 152984 time to create 1 rle with new method : 1.1713268756866455 time for calcul the mask position with numpy : 0.03454136848449707 nb_pixel_total : 26512 time to create 1 rle with old method : 0.029520511627197266 time for calcul the mask position with numpy : 0.0348966121673584 nb_pixel_total : 51218 time to create 1 rle with old method : 0.05742621421813965 time for calcul the mask position with numpy : 0.03526878356933594 nb_pixel_total : 94136 time to create 1 rle with old method : 0.10518527030944824 time for calcul the mask position with numpy : 0.03554415702819824 nb_pixel_total : 28583 time to create 1 rle with old method : 0.03356766700744629 time for calcul the mask position with numpy : 0.04547882080078125 nb_pixel_total : 6246 time to create 1 rle with old method : 0.007831335067749023 time for calcul the mask position with numpy : 0.03691577911376953 nb_pixel_total : 61386 time to create 1 rle with old method : 0.07271051406860352 time for calcul the mask position with numpy : 0.03471493721008301 nb_pixel_total : 24851 time to create 1 rle with old method : 0.027719974517822266 time for calcul the mask position with numpy : 0.03447365760803223 nb_pixel_total : 227704 time to create 1 rle with new method : 0.9586343765258789 time for calcul the mask position with numpy : 0.03588509559631348 nb_pixel_total : 168816 time to create 1 rle with new method : 0.6001460552215576 time for calcul the mask position with numpy : 0.03529858589172363 nb_pixel_total : 236260 time to create 1 rle with new method : 1.70145845413208 create new chi : 7.248699426651001 time to delete rle : 0.003616809844970703 batch 1 Loaded 31 chid ids of type : 3594 +++++++++++++++++++++++++++++++Number RLEs to save : 13951 TO DO : save crop sub photo not yet done ! save time : 4.657726526260376 map_output_result : {1360423397: (0.0, 'Should be the crop_list due to order', 0), 1360423392: (0.0, 'Should be the crop_list due to order', 0), 1360423153: (0.0, 'Should be the crop_list due to order', 0), 1360423136: (0.0, 'Should be the crop_list due to order', 0), 1360423098: (0.0, 'Should be the crop_list due to order', 0), 1360423023: (0.0, 'Should be the crop_list due to order', 0), 1360423012: (0.0, 'Should be the crop_list due to order', 0), 1360422992: (0.0, 'Should be the crop_list due to order', 0), 1360422967: (0.0, 'Should be the crop_list due to order', 0), 1360422951: (0.0, 'Should be the crop_list due to order', 0), 1360422948: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1360423397, 1360423392, 1360423153, 1360423136, 1360423098, 1360423023, 1360423012, 1360422992, 1360422967, 1360422951, 1360422948] Looping around the photos to save general results len do output : 11 /1360423397.Didn't retrieve data . /1360423392.Didn't retrieve data . /1360423153.Didn't retrieve data . /1360423136.Didn't retrieve data . /1360423098.Didn't retrieve data . /1360423023.Didn't retrieve data . /1360423012.Didn't retrieve data . /1360422992.Didn't retrieve data . /1360422967.Didn't retrieve data . /1360422951.Didn't retrieve data . /1360422948.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423397', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423392', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423153', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423136', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423098', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423023', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423012', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360422992', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360422967', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360422951', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360422948', None, None, None, None, None, '2933152') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.01682138442993164 save_final save missing photos in datou_result : time spend for datou_step_exec : 177.18878746032715 time spend to save output : 0.018221139907836914 total time spend for step 3 : 177.20700860023499 step4:ventilate_hashtags_in_portfolio Thu May 22 08:36:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23254913 get user id for portfolio 23254913 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23254913 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','autre','carton','pet_clair','pet_fonce','mal_croppe','background','pehd','papier','flou','metal')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23254913 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','autre','carton','pet_clair','pet_fonce','mal_croppe','background','pehd','papier','flou','metal')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23254913 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('environnement','autre','carton','pet_clair','pet_fonce','mal_croppe','background','pehd','papier','flou','metal')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23255823,23255824,23255825,23255826,23255827,23255828,23255829,23255830,23255831,23255832,23255833?tags=environnement,autre,carton,pet_clair,pet_fonce,mal_croppe,background,pehd,papier,flou,metal Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1360423397, 1360423392, 1360423153, 1360423136, 1360423098, 1360423023, 1360423012, 1360422992, 1360422967, 1360422951, 1360422948] Looping around the photos to save general results len do output : 1 /23254913. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423397', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423392', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423153', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423136', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423098', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423023', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423012', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360422992', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360422967', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360422951', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360422948', None, None, None, None, None, '2933152') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.019452571868896484 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.9588768482208252 time spend to save output : 0.019775867462158203 total time spend for step 4 : 1.9786527156829834 step5:final Thu May 22 08:36:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1360423397: ('0.11982779696474558',), 1360423392: ('0.11982779696474558',), 1360423153: ('0.11982779696474558',), 1360423136: ('0.11982779696474558',), 1360423098: ('0.11982779696474558',), 1360423023: ('0.11982779696474558',), 1360423012: ('0.11982779696474558',), 1360422992: ('0.11982779696474558',), 1360422967: ('0.11982779696474558',), 1360422951: ('0.11982779696474558',), 1360422948: ('0.11982779696474558',)} new output for save of step final : {1360423397: ('0.11982779696474558',), 1360423392: ('0.11982779696474558',), 1360423153: ('0.11982779696474558',), 1360423136: ('0.11982779696474558',), 1360423098: ('0.11982779696474558',), 1360423023: ('0.11982779696474558',), 1360423012: ('0.11982779696474558',), 1360422992: ('0.11982779696474558',), 1360422967: ('0.11982779696474558',), 1360422951: ('0.11982779696474558',), 1360422948: ('0.11982779696474558',)} [1360423397, 1360423392, 1360423153, 1360423136, 1360423098, 1360423023, 1360423012, 1360422992, 1360422967, 1360422951, 1360422948] Looping around the photos to save general results len do output : 11 /1360423397.Didn't retrieve data . /1360423392.Didn't retrieve data . /1360423153.Didn't retrieve data . /1360423136.Didn't retrieve data . /1360423098.Didn't retrieve data . /1360423023.Didn't retrieve data . /1360423012.Didn't retrieve data . /1360422992.Didn't retrieve data . /1360422967.Didn't retrieve data . /1360422951.Didn't retrieve data . /1360422948.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423397', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423392', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423153', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423136', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423098', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423023', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423012', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360422992', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360422967', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360422951', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360422948', None, None, None, None, None, '2933152') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.016256332397460938 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12076139450073242 time spend to save output : 0.01682901382446289 total time spend for step 5 : 0.1375904083251953 step6:blur_detection Thu May 22 08:36:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747895429_1952861_1360423397_11dc169de5a50b2e55d3e42c982951f6.jpg resize: (2160, 3264) 1360423397 -1.3838006076275986 treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0.jpg resize: (2160, 3264) 1360423392 -1.9875520126048989 treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c.jpg resize: (2160, 3264) 1360423153 0.9260334973280148 treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5.jpg resize: (2160, 3264) 1360423136 0.9011555164460692 treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93.jpg resize: (2160, 3264) 1360423098 -1.7519423000111933 treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1.jpg resize: (2160, 3264) 1360423023 -3.090181040833738 treat image : temp/1747895429_1952861_1360423012_617cb57887bf641fdc6389eff54ebc0b.jpg resize: (2160, 3264) 1360423012 -3.2805447315130642 treat image : temp/1747895429_1952861_1360422992_097b84bedf3e135a2849476acf166cc2.jpg resize: (2160, 3264) 1360422992 -1.4419497290889125 treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56.jpg resize: (2160, 3264) 1360422967 0.039547325506745445 treat image : temp/1747895429_1952861_1360422951_c46131b234304e382c00819527fd89d0.jpg resize: (2160, 3264) 1360422951 -0.5883789473927161 treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9.jpg resize: (2160, 3264) 1360422948 0.7451346173218512 treat image : temp/1747895429_1952861_1360423397_11dc169de5a50b2e55d3e42c982951f6_rle_crop_3809730436_0.png resize: (174, 225) 1360446599 -1.0107139921469972 treat image : temp/1747895429_1952861_1360423397_11dc169de5a50b2e55d3e42c982951f6_rle_crop_3809730440_0.png resize: (69, 178) 1360446600 1.3765776623753174 treat image : temp/1747895429_1952861_1360423397_11dc169de5a50b2e55d3e42c982951f6_rle_crop_3809730434_0.png resize: (205, 94) 1360446601 -1.1182681867551654 treat image : temp/1747895429_1952861_1360423397_11dc169de5a50b2e55d3e42c982951f6_rle_crop_3809730443_0.png resize: (225, 157) 1360446602 -0.7408865562849759 treat image : temp/1747895429_1952861_1360423397_11dc169de5a50b2e55d3e42c982951f6_rle_crop_3809730437_0.png resize: (191, 163) 1360446603 0.6510792820761998 treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730449_0.png resize: (292, 176) 1360446604 -1.9969772553050602 treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730448_0.png resize: (126, 158) 1360446605 -1.7688888544447645 treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730450_0.png resize: (118, 215) 1360446607 -1.51648759359042 treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730452_0.png resize: (139, 123) 1360446608 -1.4991618919322223 treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730461_0.png resize: (175, 253) 1360446609 -0.6006328493780613 treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730462_0.png resize: (441, 203) 1360446610 -1.051726643082899 treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730456_0.png resize: (259, 307) 1360446611 -1.1489940364875124 treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730460_0.png resize: (145, 171) 1360446612 -1.0800905258548816 treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730444_0.png resize: (169, 231) 1360446613 -2.279223999553211 treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730453_0.png resize: (184, 196) 1360446615 -1.8683877495392744 treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730458_0.png resize: (647, 268) 1360446616 -1.4911424429801454 treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730447_0.png resize: (494, 183) 1360446617 -1.3864610885702955 treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c_rle_crop_3809730465_0.png resize: (103, 171) 1360446618 -0.8473409164583474 treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c_rle_crop_3809730470_0.png resize: (164, 162) 1360446619 -0.35042167732397017 treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c_rle_crop_3809730463_0.png resize: (124, 105) 1360446620 -1.1792812425509092 treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c_rle_crop_3809730472_0.png resize: (155, 101) 1360446621 0.9879629490458769 treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c_rle_crop_3809730468_0.png resize: (263, 259) 1360446622 -0.3056249198331943 treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c_rle_crop_3809730474_0.png resize: (176, 190) 1360446623 -1.3979559854449994 treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c_rle_crop_3809730473_0.png resize: (474, 231) 1360446624 0.005755515836163122 treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c_rle_crop_3809730471_0.png resize: (92, 151) 1360446625 0.11554790496284899 treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c_rle_crop_3809730475_0.png resize: (282, 279) 1360446626 1.1344445388409592 treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730486_0.png resize: (242, 432) 1360446627 0.1563027826285815 treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730483_0.png resize: (141, 109) 1360446628 -1.6179110101704066 treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730487_0.png resize: (161, 130) 1360446629 -1.2514318805859541 treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730484_0.png resize: (1140, 1146) 1360446630 -0.2825311323908536 treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730485_0.png resize: (647, 552) 1360446631 -0.10063299602578575 treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730489_0.png resize: (244, 234) 1360446632 -0.781778748832331 treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730482_0.png resize: (128, 92) 1360446633 -0.4331914640140848 treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730479_0.png resize: (160, 277) 1360446634 0.816852597351344 treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730491_0.png resize: (698, 785) 1360446636 -1.8130025975678072 treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730495_0.png resize: (192, 212) 1360446637 -1.3515971621440437 treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730505_0.png resize: (138, 103) 1360446638 1.5087477108389553 treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730506_0.png resize: (357, 84) 1360446639 -2.9886217431864184 treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730493_0.png resize: (164, 436) 1360446640 -1.1806775824773263 treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730492_0.png resize: (143, 232) 1360446641 -0.1141629434217331 treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730500_0.png resize: (110, 104) 1360446642 1.3419228358243218 treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730501_0.png resize: (191, 188) 1360446643 -0.44251329844728854 treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730494_0.png resize: (301, 215) 1360446644 -1.3038602030365283 treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730504_0.png resize: (51, 214) 1360446645 0.9198062226936454 treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730498_0.png resize: (120, 132) 1360446646 -1.5975949744835858 treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730502_0.png resize: (196, 291) 1360446647 -0.7555851479021535 treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730496_0.png resize: (122, 193) 1360446648 0.4032276499355665 treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730510_0.png resize: (227, 55) 1360446649 -1.7831344420595734 treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730519_0.png resize: (436, 263) 1360446650 -2.087534149364057 treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730508_0.png resize: (178, 122) 1360446651 -2.2381389658406894 treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730520_0.png resize: (97, 97) 1360446652 -2.088580957567222 treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730507_0.png resize: (139, 117) 1360446653 -3.380512854598514 treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730515_0.png resize: (753, 758) 1360446654 -1.2208552778120418 treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730514_0.png resize: (553, 683) 1360446655 -2.302711575207034 treat image : temp/1747895429_1952861_1360423012_617cb57887bf641fdc6389eff54ebc0b_rle_crop_3809730524_0.png resize: (416, 274) 1360446656 -4.7041369092930685 treat image : temp/1747895429_1952861_1360423012_617cb57887bf641fdc6389eff54ebc0b_rle_crop_3809730522_0.png resize: (312, 428) 1360446657 -3.065273264779047 treat image : temp/1747895429_1952861_1360423012_617cb57887bf641fdc6389eff54ebc0b_rle_crop_3809730526_0.png resize: (290, 247) 1360446659 -3.7676797996064244 treat image : temp/1747895429_1952861_1360423012_617cb57887bf641fdc6389eff54ebc0b_rle_crop_3809730523_0.png resize: (253, 136) 1360446660 0.07411836122559695 treat image : temp/1747895429_1952861_1360422992_097b84bedf3e135a2849476acf166cc2_rle_crop_3809730528_0.png resize: (310, 417) 1360446661 -1.2149346311191462 treat image : temp/1747895429_1952861_1360422992_097b84bedf3e135a2849476acf166cc2_rle_crop_3809730532_0.png resize: (272, 263) 1360446662 -1.9711122562150278 treat image : temp/1747895429_1952861_1360422992_097b84bedf3e135a2849476acf166cc2_rle_crop_3809730534_0.png resize: (123, 74) 1360446663 -1.43736194551301 treat image : temp/1747895429_1952861_1360422992_097b84bedf3e135a2849476acf166cc2_rle_crop_3809730531_0.png resize: (178, 159) 1360446664 -0.9916839941118463 treat image : temp/1747895429_1952861_1360422992_097b84bedf3e135a2849476acf166cc2_rle_crop_3809730530_0.png resize: (258, 140) 1360446665 0.39733594800770594 treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730545_0.png resize: (784, 325) 1360446666 -1.397436499282726 treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730537_0.png resize: (360, 491) 1360446667 -0.3404602961092516 treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730548_0.png resize: (315, 309) 1360446668 -1.057591406458804 treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730543_0.png resize: (112, 195) 1360446669 -1.369128703184671 treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730549_0.png resize: (98, 172) 1360446671 -0.6611600696992842 treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730539_0.png resize: (142, 127) 1360446672 1.7914720487091065 treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730536_0.png resize: (250, 273) 1360446673 -1.0947110723238183 treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730546_0.png resize: (352, 224) 1360446674 -0.00860051355563429 treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730547_0.png resize: (273, 326) 1360446675 -1.8189839237125616 treat image : temp/1747895429_1952861_1360422951_c46131b234304e382c00819527fd89d0_rle_crop_3809730556_0.png resize: (472, 328) 1360446677 -0.7108049300741145 treat image : temp/1747895429_1952861_1360422951_c46131b234304e382c00819527fd89d0_rle_crop_3809730558_0.png resize: (104, 62) 1360446678 0.12744703601577637 treat image : temp/1747895429_1952861_1360422951_c46131b234304e382c00819527fd89d0_rle_crop_3809730555_0.png resize: (56, 132) 1360446679 0.6936440036057104 treat image : temp/1747895429_1952861_1360422951_c46131b234304e382c00819527fd89d0_rle_crop_3809730559_0.png resize: (294, 327) 1360446680 -0.2830839900299762 treat image : temp/1747895429_1952861_1360422951_c46131b234304e382c00819527fd89d0_rle_crop_3809730557_0.png resize: (281, 216) 1360446681 1.3415961499534221 treat image : temp/1747895429_1952861_1360422951_c46131b234304e382c00819527fd89d0_rle_crop_3809730552_0.png resize: (459, 372) 1360446682 -0.06474431005685241 treat image : temp/1747895429_1952861_1360422951_c46131b234304e382c00819527fd89d0_rle_crop_3809730550_0.png resize: (177, 986) 1360446683 0.19831259341293841 treat image : temp/1747895429_1952861_1360422951_c46131b234304e382c00819527fd89d0_rle_crop_3809730551_0.png resize: (144, 167) 1360446684 -1.2831368598585469 treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730560_0.png resize: (523, 574) 1360446685 -1.4675513658667676 treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730565_0.png resize: (381, 188) 1360446686 -2.0027131572861854 treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730573_0.png resize: (269, 339) 1360446687 -1.0042413714029792 treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730561_0.png resize: (404, 560) 1360446688 0.08335141881786927 treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730574_0.png resize: (441, 519) 1360446689 -0.8362012251774056 treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730567_0.png resize: (378, 351) 1360446691 0.5259837447483605 treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730563_0.png resize: (160, 229) 1360446692 -0.5511380973119415 treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730562_0.png resize: (800, 431) 1360446693 0.20047150057934218 treat image : temp/1747895429_1952861_1360423397_11dc169de5a50b2e55d3e42c982951f6_rle_crop_3809730441_0.png resize: (87, 130) 1360446702 1.5286832407243525 treat image : temp/1747895429_1952861_1360423397_11dc169de5a50b2e55d3e42c982951f6_rle_crop_3809730439_0.png resize: (663, 539) 1360446703 -1.596240294730238 treat image : temp/1747895429_1952861_1360423397_11dc169de5a50b2e55d3e42c982951f6_rle_crop_3809730435_0.png resize: (554, 392) 1360446704 -1.169446560836815 treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c_rle_crop_3809730466_0.png resize: (263, 185) 1360446705 -0.631287447420642 treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c_rle_crop_3809730469_0.png resize: (197, 122) 1360446706 -0.022078408799549552 treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c_rle_crop_3809730464_0.png resize: (221, 139) 1360446707 -0.22267844550451435 treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730488_0.png resize: (432, 382) 1360446708 -1.0165379181148764 treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730476_0.png resize: (125, 422) 1360446709 -1.3019630312750856 treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730503_0.png resize: (143, 143) 1360446710 -1.332135040805215 treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730511_0.png resize: (362, 199) 1360446711 -3.3577506040905316 treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730516_0.png resize: (316, 446) 1360446712 -1.8035531720556024 treat image : temp/1747895429_1952861_1360422992_097b84bedf3e135a2849476acf166cc2_rle_crop_3809730527_0.png resize: (144, 91) 1360446713 -0.06335222526204545 treat image : temp/1747895429_1952861_1360422992_097b84bedf3e135a2849476acf166cc2_rle_crop_3809730533_0.png resize: (50, 100) 1360446714 1.3794807242886264 treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730540_0.png resize: (157, 240) 1360446715 -1.1026020792426605 treat image : temp/1747895429_1952861_1360422951_c46131b234304e382c00819527fd89d0_rle_crop_3809730554_0.png resize: (141, 235) 1360446716 -0.14658098692285862 treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730570_0.png resize: (668, 551) 1360446717 -1.025749600581569 treat image : temp/1747895429_1952861_1360422951_c46131b234304e382c00819527fd89d0_rle_crop_3809730553_0.png resize: (123, 247) 1360446720 -0.7679923465838666 treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730572_0.png resize: (134, 88) 1360446721 -1.0653379939165986 treat image : temp/1747895429_1952861_1360423397_11dc169de5a50b2e55d3e42c982951f6_rle_crop_3809730438_0.png resize: (226, 114) 1360446734 -2.916983933261887 treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730455_0.png resize: (253, 311) 1360446736 -1.9062404049795403 treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730454_0.png resize: (289, 397) 1360446737 -1.8097516601723387 treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730445_0.png resize: (650, 694) 1360446738 -1.8357708078824475 treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730451_0.png resize: (379, 439) 1360446739 -2.0537887037963585 treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730446_0.png resize: (210, 101) 1360446740 -1.8765988421920718 treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730457_0.png resize: (228, 195) 1360446741 -1.2046932067882028 treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c_rle_crop_3809730467_0.png resize: (300, 783) 1360446742 -0.8946794156658974 treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730477_0.png resize: (254, 434) 1360446743 -1.8909302802897052 treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730490_0.png resize: (435, 367) 1360446744 -1.410927237145026 treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730478_0.png resize: (210, 537) 1360446745 -1.2240003230203755 treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730481_0.png resize: (292, 255) 1360446746 -1.5746458045337872 treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730480_0.png resize: (318, 178) 1360446747 -0.9055615981915933 treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730497_0.png resize: (233, 483) 1360446748 -2.003924913122109 treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730499_0.png resize: (378, 314) 1360446749 -3.0020288071774712 treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730509_0.png resize: (312, 353) 1360446750 -2.3356764403483075 treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730518_0.png resize: (425, 146) 1360446751 -3.4544188742973754 treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730512_0.png resize: (353, 319) 1360446752 -2.1315259224726693 treat image : temp/1747895429_1952861_1360423012_617cb57887bf641fdc6389eff54ebc0b_rle_crop_3809730521_0.png resize: (336, 467) 1360446753 -3.3456428602923 treat image : temp/1747895429_1952861_1360423012_617cb57887bf641fdc6389eff54ebc0b_rle_crop_3809730525_0.png resize: (431, 445) 1360446754 -4.595107567681374 treat image : temp/1747895429_1952861_1360422992_097b84bedf3e135a2849476acf166cc2_rle_crop_3809730529_0.png resize: (313, 420) 1360446756 -2.43348676144091 treat image : temp/1747895429_1952861_1360422992_097b84bedf3e135a2849476acf166cc2_rle_crop_3809730535_0.png resize: (418, 433) 1360446757 -2.738585365065969 treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730541_0.png resize: (271, 298) 1360446758 -1.8709976736407243 treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730538_0.png resize: (664, 569) 1360446759 -1.6303210386144145 treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730544_0.png resize: (442, 403) 1360446760 -0.46215189822744507 treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730542_0.png resize: (183, 162) 1360446761 -2.0524340280500315 treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730564_0.png resize: (267, 379) 1360446762 -1.252136002110929 treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730569_0.png resize: (165, 223) 1360446763 -1.713628271224648 treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730568_0.png resize: (309, 388) 1360446764 0.009726390441015604 treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730571_0.png resize: (141, 432) 1360446765 -0.015446235850926122 treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730566_0.png resize: (170, 277) 1360446766 -1.0050398467292658 treat image : temp/1747895429_1952861_1360423397_11dc169de5a50b2e55d3e42c982951f6_rle_crop_3809730442_0.png resize: (202, 119) 1360446769 -1.0270482719580587 treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730517_0.png resize: (193, 134) 1360446770 -1.5669828944419082 treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730459_0.png resize: (138, 156) 1360446775 -1.9152094654679364 treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730513_0.png resize: (261, 415) 1360446776 -3.063409072640985 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 152 time used for this insertion : 0.024747133255004883 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 152 time used for this insertion : 0.4419677257537842 save missing photos in datou_result : time spend for datou_step_exec : 48.39668035507202 time spend to save output : 0.47472381591796875 total time spend for step 6 : 48.87140417098999 step7:brightness Thu May 22 08:37:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747895429_1952861_1360423397_11dc169de5a50b2e55d3e42c982951f6.jpg treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0.jpg treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c.jpg treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5.jpg treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93.jpg treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1.jpg treat image : temp/1747895429_1952861_1360423012_617cb57887bf641fdc6389eff54ebc0b.jpg treat image : temp/1747895429_1952861_1360422992_097b84bedf3e135a2849476acf166cc2.jpg treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56.jpg treat image : temp/1747895429_1952861_1360422951_c46131b234304e382c00819527fd89d0.jpg treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9.jpg treat image : temp/1747895429_1952861_1360423397_11dc169de5a50b2e55d3e42c982951f6_rle_crop_3809730436_0.png treat image : temp/1747895429_1952861_1360423397_11dc169de5a50b2e55d3e42c982951f6_rle_crop_3809730440_0.png treat image : temp/1747895429_1952861_1360423397_11dc169de5a50b2e55d3e42c982951f6_rle_crop_3809730434_0.png treat image : temp/1747895429_1952861_1360423397_11dc169de5a50b2e55d3e42c982951f6_rle_crop_3809730443_0.png treat image : temp/1747895429_1952861_1360423397_11dc169de5a50b2e55d3e42c982951f6_rle_crop_3809730437_0.png treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730449_0.png treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730448_0.png treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730450_0.png treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730452_0.png treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730461_0.png treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730462_0.png treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730456_0.png treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730460_0.png treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730444_0.png treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730453_0.png treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730458_0.png treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730447_0.png treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c_rle_crop_3809730465_0.png treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c_rle_crop_3809730470_0.png treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c_rle_crop_3809730463_0.png treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c_rle_crop_3809730472_0.png treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c_rle_crop_3809730468_0.png treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c_rle_crop_3809730474_0.png treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c_rle_crop_3809730473_0.png treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c_rle_crop_3809730471_0.png treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c_rle_crop_3809730475_0.png treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730486_0.png treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730483_0.png treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730487_0.png treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730484_0.png treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730485_0.png treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730489_0.png treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730482_0.png treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730479_0.png treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730491_0.png treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730495_0.png treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730505_0.png treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730506_0.png treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730493_0.png treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730492_0.png treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730500_0.png treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730501_0.png treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730494_0.png treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730504_0.png treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730498_0.png treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730502_0.png treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730496_0.png treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730510_0.png treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730519_0.png treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730508_0.png treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730520_0.png treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730507_0.png treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730515_0.png treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730514_0.png treat image : temp/1747895429_1952861_1360423012_617cb57887bf641fdc6389eff54ebc0b_rle_crop_3809730524_0.png treat image : temp/1747895429_1952861_1360423012_617cb57887bf641fdc6389eff54ebc0b_rle_crop_3809730522_0.png treat image : temp/1747895429_1952861_1360423012_617cb57887bf641fdc6389eff54ebc0b_rle_crop_3809730526_0.png treat image : temp/1747895429_1952861_1360423012_617cb57887bf641fdc6389eff54ebc0b_rle_crop_3809730523_0.png treat image : temp/1747895429_1952861_1360422992_097b84bedf3e135a2849476acf166cc2_rle_crop_3809730528_0.png treat image : temp/1747895429_1952861_1360422992_097b84bedf3e135a2849476acf166cc2_rle_crop_3809730532_0.png treat image : temp/1747895429_1952861_1360422992_097b84bedf3e135a2849476acf166cc2_rle_crop_3809730534_0.png treat image : temp/1747895429_1952861_1360422992_097b84bedf3e135a2849476acf166cc2_rle_crop_3809730531_0.png treat image : temp/1747895429_1952861_1360422992_097b84bedf3e135a2849476acf166cc2_rle_crop_3809730530_0.png treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730545_0.png treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730537_0.png treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730548_0.png treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730543_0.png treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730549_0.png treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730539_0.png treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730536_0.png treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730546_0.png treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730547_0.png treat image : temp/1747895429_1952861_1360422951_c46131b234304e382c00819527fd89d0_rle_crop_3809730556_0.png treat image : temp/1747895429_1952861_1360422951_c46131b234304e382c00819527fd89d0_rle_crop_3809730558_0.png treat image : temp/1747895429_1952861_1360422951_c46131b234304e382c00819527fd89d0_rle_crop_3809730555_0.png treat image : temp/1747895429_1952861_1360422951_c46131b234304e382c00819527fd89d0_rle_crop_3809730559_0.png treat image : temp/1747895429_1952861_1360422951_c46131b234304e382c00819527fd89d0_rle_crop_3809730557_0.png treat image : temp/1747895429_1952861_1360422951_c46131b234304e382c00819527fd89d0_rle_crop_3809730552_0.png treat image : temp/1747895429_1952861_1360422951_c46131b234304e382c00819527fd89d0_rle_crop_3809730550_0.png treat image : temp/1747895429_1952861_1360422951_c46131b234304e382c00819527fd89d0_rle_crop_3809730551_0.png treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730560_0.png treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730565_0.png treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730573_0.png treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730561_0.png treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730574_0.png treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730567_0.png treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730563_0.png treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730562_0.png treat image : temp/1747895429_1952861_1360423397_11dc169de5a50b2e55d3e42c982951f6_rle_crop_3809730441_0.png treat image : temp/1747895429_1952861_1360423397_11dc169de5a50b2e55d3e42c982951f6_rle_crop_3809730439_0.png treat image : temp/1747895429_1952861_1360423397_11dc169de5a50b2e55d3e42c982951f6_rle_crop_3809730435_0.png treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c_rle_crop_3809730466_0.png treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c_rle_crop_3809730469_0.png treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c_rle_crop_3809730464_0.png treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730488_0.png treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730476_0.png treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730503_0.png treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730511_0.png treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730516_0.png treat image : temp/1747895429_1952861_1360422992_097b84bedf3e135a2849476acf166cc2_rle_crop_3809730527_0.png treat image : temp/1747895429_1952861_1360422992_097b84bedf3e135a2849476acf166cc2_rle_crop_3809730533_0.png treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730540_0.png treat image : temp/1747895429_1952861_1360422951_c46131b234304e382c00819527fd89d0_rle_crop_3809730554_0.png treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730570_0.png treat image : temp/1747895429_1952861_1360422951_c46131b234304e382c00819527fd89d0_rle_crop_3809730553_0.png treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730572_0.png treat image : temp/1747895429_1952861_1360423397_11dc169de5a50b2e55d3e42c982951f6_rle_crop_3809730438_0.png treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730455_0.png treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730454_0.png treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730445_0.png treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730451_0.png treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730446_0.png treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730457_0.png treat image : temp/1747895429_1952861_1360423153_c86168b683148e03fed302456001283c_rle_crop_3809730467_0.png treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730477_0.png treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730490_0.png treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730478_0.png treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730481_0.png treat image : temp/1747895429_1952861_1360423136_f0ad974949db5fcbad31605af12863c5_rle_crop_3809730480_0.png treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730497_0.png treat image : temp/1747895429_1952861_1360423098_df3b9e056497235799827017b812cb93_rle_crop_3809730499_0.png treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730509_0.png treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730518_0.png treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730512_0.png treat image : temp/1747895429_1952861_1360423012_617cb57887bf641fdc6389eff54ebc0b_rle_crop_3809730521_0.png treat image : temp/1747895429_1952861_1360423012_617cb57887bf641fdc6389eff54ebc0b_rle_crop_3809730525_0.png treat image : temp/1747895429_1952861_1360422992_097b84bedf3e135a2849476acf166cc2_rle_crop_3809730529_0.png treat image : temp/1747895429_1952861_1360422992_097b84bedf3e135a2849476acf166cc2_rle_crop_3809730535_0.png treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730541_0.png treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730538_0.png treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730544_0.png treat image : temp/1747895429_1952861_1360422967_1d73e84c98ceaad88e8459223a4c0a56_rle_crop_3809730542_0.png treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730564_0.png treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730569_0.png treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730568_0.png treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730571_0.png treat image : temp/1747895429_1952861_1360422948_671636c6296e07c39299fb9a60fd5fc9_rle_crop_3809730566_0.png treat image : temp/1747895429_1952861_1360423397_11dc169de5a50b2e55d3e42c982951f6_rle_crop_3809730442_0.png treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730517_0.png treat image : temp/1747895429_1952861_1360423392_3fbfeaca7eda3dd6a6231d6798e049e0_rle_crop_3809730459_0.png treat image : temp/1747895429_1952861_1360423023_3a410fc49e5db72da2afddad4896dff1_rle_crop_3809730513_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 152 time used for this insertion : 0.02408885955810547 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 152 time used for this insertion : 0.3164365291595459 save missing photos in datou_result : time spend for datou_step_exec : 10.665534734725952 time spend to save output : 0.34572935104370117 total time spend for step 7 : 11.011264085769653 step8:velours_tree Thu May 22 08:37:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.3840978145599365 time spend to save output : 5.030632019042969e-05 total time spend for step 8 : 0.38414812088012695 step9:send_mail_cod Thu May 22 08:37:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23254913_22-05-2025_08_37_59.pdf 23255824 change filename to text .change filename to text .imagette232558241747895879 23255825 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232558251747895879 23255826 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232558261747895880 23255827 change filename to text .change filename to text .imagette232558271747895882 23255828 imagette232558281747895882 23255829 imagette232558291747895882 23255830 imagette232558301747895882 23255831 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette232558311747895882 23255832 imagette232558321747895884 23255833 change filename to text .change filename to text .imagette232558331747895884 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23254913 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23255823,23255824,23255825,23255826,23255827,23255828,23255829,23255830,23255831,23255832,23255833?tags=environnement,autre,carton,pet_clair,pet_fonce,mal_croppe,background,pehd,papier,flou,metal args[1360423397] : ((1360423397, -1.3838006076275986, 492688767), (1360423397, 0.4444111841352276, 2107752395), '0.11982779696474558') We are sending mail with results at report@fotonower.com args[1360423392] : ((1360423392, -1.9875520126048989, 492688767), (1360423392, -0.15025951507077073, 496442774), '0.11982779696474558') We are sending mail with results at report@fotonower.com args[1360423153] : ((1360423153, 0.9260334973280148, 492688767), (1360423153, 0.2696384699567463, 2107752395), '0.11982779696474558') We are sending mail with results at report@fotonower.com args[1360423136] : ((1360423136, 0.9011555164460692, 492688767), (1360423136, 0.029496194244601148, 2107752395), '0.11982779696474558') We are sending mail with results at report@fotonower.com args[1360423098] : ((1360423098, -1.7519423000111933, 492688767), (1360423098, 0.031554089798859965, 2107752395), '0.11982779696474558') We are sending mail with results at report@fotonower.com args[1360423023] : ((1360423023, -3.090181040833738, 492609224), (1360423023, -0.2623457647408435, 496442774), '0.11982779696474558') We are sending mail with results at report@fotonower.com args[1360423012] : ((1360423012, -3.2805447315130642, 492609224), (1360423012, 0.35824694663358386, 2107752395), '0.11982779696474558') We are sending mail with results at report@fotonower.com args[1360422992] : ((1360422992, -1.4419497290889125, 492688767), (1360422992, 0.35715174203938965, 2107752395), '0.11982779696474558') We are sending mail with results at report@fotonower.com args[1360422967] : ((1360422967, 0.039547325506745445, 492688767), (1360422967, 0.09669558916689742, 2107752395), '0.11982779696474558') We are sending mail with results at report@fotonower.com args[1360422951] : ((1360422951, -0.5883789473927161, 492688767), (1360422951, -0.05325281631301003, 2107752395), '0.11982779696474558') We are sending mail with results at report@fotonower.com args[1360422948] : ((1360422948, 0.7451346173218512, 492688767), (1360422948, -0.1828068311997238, 496442774), '0.11982779696474558') We are sending mail with results at report@fotonower.com refus_total : 0.11982779696474558 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23254913 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23254913_22-05-2025_08_37_59.pdf results_Auto_P23254913_22-05-2025_08_37_59.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23254913_22-05-2025_08_37_59.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23254913','results_Auto_P23254913_22-05-2025_08_37_59.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23254913_22-05-2025_08_37_59.pdf','pdf','','0.71','0.11982779696474558') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23254913

https://www.fotonower.com/image?json=false&list_photos_id=1360423397
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360423392
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360423153
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360423136
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360423098
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360423023
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360423012
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360422992
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360422967
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360422951
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1360422948
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 11.98%
Veuillez trouver les photos des contaminants.

exemples de contaminants: autre: https://www.fotonower.com/view/23255824?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23255825?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23255826?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/23255827?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23255831?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/23255833?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23254913_22-05-2025_08_37_59.pdf.

Lien vers velours :https://www.fotonower.com/velours/23255823,23255824,23255825,23255826,23255827,23255828,23255829,23255830,23255831,23255832,23255833?tags=environnement,autre,carton,pet_clair,pet_fonce,mal_croppe,background,pehd,papier,flou,metal.


L'équipe Fotonower 202 b'' Server: nginx Date: Thu, 22 May 2025 06:38:07 GMT Content-Length: 0 Connection: close X-Message-Id: sMP2mKGPSk2zkFojEPRvpA Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1360423397, 1360423392, 1360423153, 1360423136, 1360423098, 1360423023, 1360423012, 1360422992, 1360422967, 1360422951, 1360422948] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423397', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423392', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423153', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423136', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423098', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423023', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423012', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360422992', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360422967', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360422951', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360422948', None, None, None, None, None, '2933152') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.07256245613098145 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.109180927276611 time spend to save output : 0.07281875610351562 total time spend for step 9 : 8.181999683380127 step10:split_time_score Thu May 22 08:38:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('07', 11),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 22052025 23254913 Nombre de photos uploadées : 11 / 23040 (0%) 22052025 23254913 Nombre de photos taguées (types de déchets): 0 / 11 (0%) 22052025 23254913 Nombre de photos taguées (volume) : 0 / 11 (0%) elapsed_time : load_data_split_time_score 3.814697265625e-06 elapsed_time : order_list_meta_photo_and_scores 1.049041748046875e-05 ??????????? elapsed_time : fill_and_build_computed_from_old_data 0.0007028579711914062 elapsed_time : insert_dashboard_record_day_entry 0.03152060508728027 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.11982779696474558 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23254913_22-05-2025_08_37_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23254913 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23254913 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'22052025': {'nb_upload': 11, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1360423397, 1360423392, 1360423153, 1360423136, 1360423098, 1360423023, 1360423012, 1360422992, 1360422967, 1360422951, 1360422948] Looping around the photos to save general results len do output : 1 /23254913Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423397', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423392', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423153', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423136', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423098', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423023', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360423012', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360422992', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360422967', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360422951', None, None, None, None, None, '2933152') ('3318', None, None, None, None, None, None, None, '2933152') ('3318', '23254913', '1360422948', None, None, None, None, None, '2933152') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.06432056427001953 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.2924344539642334 time spend to save output : 0.06467795372009277 total time spend for step 10 : 0.35711240768432617 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 11 set_done_treatment 162.26user 212.51system 7:43.45elapsed 80%CPU (0avgtext+0avgdata 5285060maxresident)k 1532360inputs+96000outputs (24787major+15169029minor)pagefaults 0swaps