python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3677893 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2899960'] with mtr_portfolio_ids : ['23141034'] and first list_photo_ids : [] new path : /proc/3677893/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 11 ; length of list_pids : 11 ; length of list_args : 11 time to download the photos : 1.6129498481750488 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Mon May 19 22:00:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10593 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-05-19 22:00:32.879073: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-05-19 22:00:32.890419: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-05-19 22:00:32.892260: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f7c90000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-05-19 22:00:32.892289: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-05-19 22:00:32.895985: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-05-19 22:00:33.157647: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x341169f0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-05-19 22:00:33.157691: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-05-19 22:00:33.158707: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-19 22:00:33.159095: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-19 22:00:33.165048: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-19 22:00:33.167324: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-19 22:00:33.167785: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-19 22:00:33.170263: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-19 22:00:33.171665: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-19 22:00:33.176856: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-19 22:00:33.201254: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-19 22:00:33.201739: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-19 22:00:33.203343: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-19 22:00:33.203377: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-19 22:00:33.203394: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-19 22:00:33.208072: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9805 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-05-19 22:00:33.531675: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-19 22:00:33.531762: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-19 22:00:33.531783: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-19 22:00:33.531801: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-19 22:00:33.531819: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-19 22:00:33.531837: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-19 22:00:33.531854: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-19 22:00:33.531872: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-19 22:00:33.533686: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-19 22:00:33.536048: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-05-19 22:00:33.536149: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-05-19 22:00:33.536177: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-19 22:00:33.536202: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-05-19 22:00:33.536227: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-05-19 22:00:33.536251: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-05-19 22:00:33.536275: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-05-19 22:00:33.536299: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-05-19 22:00:33.538397: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-05-19 22:00:33.538464: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-05-19 22:00:33.538481: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-05-19 22:00:33.538495: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-05-19 22:00:33.539948: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9805 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-05-19 22:00:45.903011: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-05-19 22:00:46.114851: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 11 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 26 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 7.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 61.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 27 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 33 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 21 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 21.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 41 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 20.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 36 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 36 Detection mask done ! Trying to reset tf kernel 3680554 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5304 tf kernel not reseted sub process len(results) : 11 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 11 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10372 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.0006968975067138672 nb_pixel_total : 15808 time to create 1 rle with old method : 0.01832866668701172 length of segment : 135 time for calcul the mask position with numpy : 0.0010461807250976562 nb_pixel_total : 25802 time to create 1 rle with old method : 0.03040790557861328 length of segment : 227 time for calcul the mask position with numpy : 0.0016794204711914062 nb_pixel_total : 26936 time to create 1 rle with old method : 0.03274846076965332 length of segment : 164 time for calcul the mask position with numpy : 0.00026869773864746094 nb_pixel_total : 10337 time to create 1 rle with old method : 0.012869596481323242 length of segment : 157 time for calcul the mask position with numpy : 0.00042700767517089844 nb_pixel_total : 25211 time to create 1 rle with old method : 0.03125596046447754 length of segment : 220 time for calcul the mask position with numpy : 0.011338949203491211 nb_pixel_total : 222099 time to create 1 rle with new method : 0.020823001861572266 length of segment : 1039 time for calcul the mask position with numpy : 0.021952390670776367 nb_pixel_total : 304349 time to create 1 rle with new method : 0.029229164123535156 length of segment : 433 time for calcul the mask position with numpy : 0.0019328594207763672 nb_pixel_total : 86733 time to create 1 rle with old method : 0.13986992835998535 length of segment : 426 time for calcul the mask position with numpy : 0.0007760524749755859 nb_pixel_total : 9694 time to create 1 rle with old method : 0.016557931900024414 length of segment : 141 time for calcul the mask position with numpy : 0.0020940303802490234 nb_pixel_total : 60502 time to create 1 rle with old method : 0.07493948936462402 length of segment : 198 time for calcul the mask position with numpy : 0.008732318878173828 nb_pixel_total : 286198 time to create 1 rle with new method : 0.01621222496032715 length of segment : 624 time for calcul the mask position with numpy : 0.006021976470947266 nb_pixel_total : 142294 time to create 1 rle with old method : 0.16730451583862305 length of segment : 805 time for calcul the mask position with numpy : 0.0010457038879394531 nb_pixel_total : 61580 time to create 1 rle with old method : 0.07228994369506836 length of segment : 265 time for calcul the mask position with numpy : 0.0006287097930908203 nb_pixel_total : 23836 time to create 1 rle with old method : 0.04026985168457031 length of segment : 190 time for calcul the mask position with numpy : 0.03473067283630371 nb_pixel_total : 457600 time to create 1 rle with new method : 0.05514097213745117 length of segment : 1274 time for calcul the mask position with numpy : 0.0018491744995117188 nb_pixel_total : 83301 time to create 1 rle with old method : 0.1000068187713623 length of segment : 702 time for calcul the mask position with numpy : 0.00048732757568359375 nb_pixel_total : 21494 time to create 1 rle with old method : 0.028360605239868164 length of segment : 206 time for calcul the mask position with numpy : 0.0012717247009277344 nb_pixel_total : 18082 time to create 1 rle with old method : 0.02184581756591797 length of segment : 219 time for calcul the mask position with numpy : 0.002986431121826172 nb_pixel_total : 68114 time to create 1 rle with old method : 0.07925868034362793 length of segment : 371 time for calcul the mask position with numpy : 0.0011417865753173828 nb_pixel_total : 33774 time to create 1 rle with old method : 0.04041576385498047 length of segment : 197 time for calcul the mask position with numpy : 0.0009446144104003906 nb_pixel_total : 19103 time to create 1 rle with old method : 0.024613380432128906 length of segment : 186 time for calcul the mask position with numpy : 0.0019307136535644531 nb_pixel_total : 43132 time to create 1 rle with old method : 0.05114269256591797 length of segment : 275 time for calcul the mask position with numpy : 0.0005054473876953125 nb_pixel_total : 21933 time to create 1 rle with old method : 0.02639031410217285 length of segment : 155 time for calcul the mask position with numpy : 0.0012254714965820312 nb_pixel_total : 26412 time to create 1 rle with old method : 0.03428530693054199 length of segment : 204 time for calcul the mask position with numpy : 0.005782604217529297 nb_pixel_total : 197619 time to create 1 rle with new method : 0.008086442947387695 length of segment : 551 time for calcul the mask position with numpy : 0.002084493637084961 nb_pixel_total : 42792 time to create 1 rle with old method : 0.051233530044555664 length of segment : 238 time for calcul the mask position with numpy : 0.0016186237335205078 nb_pixel_total : 51092 time to create 1 rle with old method : 0.063446044921875 length of segment : 163 time for calcul the mask position with numpy : 0.0016601085662841797 nb_pixel_total : 45839 time to create 1 rle with old method : 0.05320286750793457 length of segment : 252 time for calcul the mask position with numpy : 0.0004725456237792969 nb_pixel_total : 11058 time to create 1 rle with old method : 0.013657093048095703 length of segment : 114 time for calcul the mask position with numpy : 0.0013163089752197266 nb_pixel_total : 33650 time to create 1 rle with old method : 0.04180741310119629 length of segment : 266 time for calcul the mask position with numpy : 0.0007352828979492188 nb_pixel_total : 6231 time to create 1 rle with old method : 0.010705232620239258 length of segment : 130 time for calcul the mask position with numpy : 0.0008585453033447266 nb_pixel_total : 11750 time to create 1 rle with old method : 0.020516633987426758 length of segment : 158 time for calcul the mask position with numpy : 0.0019788742065429688 nb_pixel_total : 39893 time to create 1 rle with old method : 0.05303359031677246 length of segment : 234 time for calcul the mask position with numpy : 0.0024139881134033203 nb_pixel_total : 69031 time to create 1 rle with old method : 0.08388614654541016 length of segment : 345 time for calcul the mask position with numpy : 0.0020554065704345703 nb_pixel_total : 54712 time to create 1 rle with old method : 0.06392836570739746 length of segment : 389 time for calcul the mask position with numpy : 0.0004918575286865234 nb_pixel_total : 11959 time to create 1 rle with old method : 0.01578068733215332 length of segment : 176 time for calcul the mask position with numpy : 0.0012252330780029297 nb_pixel_total : 34232 time to create 1 rle with old method : 0.04330849647521973 length of segment : 191 time for calcul the mask position with numpy : 0.0012969970703125 nb_pixel_total : 33571 time to create 1 rle with old method : 0.04155874252319336 length of segment : 240 time for calcul the mask position with numpy : 0.0016515254974365234 nb_pixel_total : 45835 time to create 1 rle with old method : 0.05571746826171875 length of segment : 255 time for calcul the mask position with numpy : 0.001924276351928711 nb_pixel_total : 59201 time to create 1 rle with old method : 0.07405877113342285 length of segment : 211 time for calcul the mask position with numpy : 0.0023283958435058594 nb_pixel_total : 71304 time to create 1 rle with old method : 0.08265042304992676 length of segment : 265 time for calcul the mask position with numpy : 0.0007712841033935547 nb_pixel_total : 21118 time to create 1 rle with old method : 0.027548789978027344 length of segment : 132 time for calcul the mask position with numpy : 0.0007524490356445312 nb_pixel_total : 22979 time to create 1 rle with old method : 0.028766393661499023 length of segment : 165 time for calcul the mask position with numpy : 0.0004088878631591797 nb_pixel_total : 12524 time to create 1 rle with old method : 0.0162203311920166 length of segment : 90 time for calcul the mask position with numpy : 0.009535551071166992 nb_pixel_total : 298636 time to create 1 rle with new method : 0.016005754470825195 length of segment : 447 time for calcul the mask position with numpy : 0.0013027191162109375 nb_pixel_total : 31352 time to create 1 rle with old method : 0.036553144454956055 length of segment : 312 time for calcul the mask position with numpy : 0.0003104209899902344 nb_pixel_total : 11753 time to create 1 rle with old method : 0.013881683349609375 length of segment : 149 time for calcul the mask position with numpy : 0.0005908012390136719 nb_pixel_total : 10414 time to create 1 rle with old method : 0.013400554656982422 length of segment : 176 time for calcul the mask position with numpy : 0.002994060516357422 nb_pixel_total : 110327 time to create 1 rle with old method : 0.13187456130981445 length of segment : 364 time for calcul the mask position with numpy : 0.0010623931884765625 nb_pixel_total : 22696 time to create 1 rle with old method : 0.02661275863647461 length of segment : 311 time for calcul the mask position with numpy : 0.0010590553283691406 nb_pixel_total : 34537 time to create 1 rle with old method : 0.041168212890625 length of segment : 172 time for calcul the mask position with numpy : 0.0013735294342041016 nb_pixel_total : 41045 time to create 1 rle with old method : 0.049144744873046875 length of segment : 278 time for calcul the mask position with numpy : 0.000812530517578125 nb_pixel_total : 15066 time to create 1 rle with old method : 0.018601417541503906 length of segment : 176 time for calcul the mask position with numpy : 0.0017497539520263672 nb_pixel_total : 40103 time to create 1 rle with old method : 0.04867362976074219 length of segment : 220 time for calcul the mask position with numpy : 0.0005438327789306641 nb_pixel_total : 12683 time to create 1 rle with old method : 0.016232728958129883 length of segment : 74 time for calcul the mask position with numpy : 0.0006079673767089844 nb_pixel_total : 12478 time to create 1 rle with old method : 0.018027067184448242 length of segment : 144 time for calcul the mask position with numpy : 0.00032591819763183594 nb_pixel_total : 6680 time to create 1 rle with old method : 0.008426904678344727 length of segment : 77 time for calcul the mask position with numpy : 0.0007207393646240234 nb_pixel_total : 19407 time to create 1 rle with old method : 0.022612810134887695 length of segment : 175 time for calcul the mask position with numpy : 0.0009036064147949219 nb_pixel_total : 15968 time to create 1 rle with old method : 0.019001245498657227 length of segment : 196 time for calcul the mask position with numpy : 0.0004398822784423828 nb_pixel_total : 10961 time to create 1 rle with old method : 0.018306255340576172 length of segment : 112 time for calcul the mask position with numpy : 0.0021338462829589844 nb_pixel_total : 63877 time to create 1 rle with old method : 0.08837485313415527 length of segment : 286 time for calcul the mask position with numpy : 0.0032987594604492188 nb_pixel_total : 122746 time to create 1 rle with old method : 0.14870119094848633 length of segment : 315 time for calcul the mask position with numpy : 0.0006017684936523438 nb_pixel_total : 21412 time to create 1 rle with old method : 0.026607990264892578 length of segment : 126 time for calcul the mask position with numpy : 0.000614166259765625 nb_pixel_total : 18097 time to create 1 rle with old method : 0.022163867950439453 length of segment : 216 time for calcul the mask position with numpy : 0.0016109943389892578 nb_pixel_total : 52683 time to create 1 rle with old method : 0.06167936325073242 length of segment : 281 time for calcul the mask position with numpy : 0.001886606216430664 nb_pixel_total : 66291 time to create 1 rle with old method : 0.07888293266296387 length of segment : 238 time for calcul the mask position with numpy : 0.003793001174926758 nb_pixel_total : 158673 time to create 1 rle with new method : 0.007311820983886719 length of segment : 386 time for calcul the mask position with numpy : 0.0024323463439941406 nb_pixel_total : 63980 time to create 1 rle with old method : 0.0738825798034668 length of segment : 350 time for calcul the mask position with numpy : 0.00682830810546875 nb_pixel_total : 253267 time to create 1 rle with new method : 0.01438283920288086 length of segment : 782 time for calcul the mask position with numpy : 0.004323720932006836 nb_pixel_total : 142900 time to create 1 rle with old method : 0.19173359870910645 length of segment : 607 time for calcul the mask position with numpy : 0.0012540817260742188 nb_pixel_total : 33533 time to create 1 rle with old method : 0.039774179458618164 length of segment : 213 time for calcul the mask position with numpy : 0.00464177131652832 nb_pixel_total : 105801 time to create 1 rle with old method : 0.12304544448852539 length of segment : 505 time for calcul the mask position with numpy : 0.0005393028259277344 nb_pixel_total : 19879 time to create 1 rle with old method : 0.023415565490722656 length of segment : 194 time for calcul the mask position with numpy : 0.0020477771759033203 nb_pixel_total : 78276 time to create 1 rle with old method : 0.09056806564331055 length of segment : 211 time for calcul the mask position with numpy : 0.006340742111206055 nb_pixel_total : 210802 time to create 1 rle with new method : 0.011672019958496094 length of segment : 869 time for calcul the mask position with numpy : 0.0046269893646240234 nb_pixel_total : 152378 time to create 1 rle with new method : 0.006622791290283203 length of segment : 529 time for calcul the mask position with numpy : 0.0023424625396728516 nb_pixel_total : 73730 time to create 1 rle with old method : 0.08538818359375 length of segment : 330 time for calcul the mask position with numpy : 0.0015256404876708984 nb_pixel_total : 34110 time to create 1 rle with old method : 0.04017925262451172 length of segment : 340 time for calcul the mask position with numpy : 0.0006895065307617188 nb_pixel_total : 17071 time to create 1 rle with old method : 0.02374124526977539 length of segment : 235 time for calcul the mask position with numpy : 0.0031332969665527344 nb_pixel_total : 67813 time to create 1 rle with old method : 0.08341526985168457 length of segment : 359 time for calcul the mask position with numpy : 0.0014965534210205078 nb_pixel_total : 20497 time to create 1 rle with old method : 0.024782657623291016 length of segment : 251 time for calcul the mask position with numpy : 0.0019156932830810547 nb_pixel_total : 49522 time to create 1 rle with old method : 0.05874204635620117 length of segment : 300 time for calcul the mask position with numpy : 0.00429987907409668 nb_pixel_total : 105907 time to create 1 rle with old method : 0.1222541332244873 length of segment : 486 time for calcul the mask position with numpy : 0.003757476806640625 nb_pixel_total : 107537 time to create 1 rle with old method : 0.12392473220825195 length of segment : 508 time for calcul the mask position with numpy : 0.0017783641815185547 nb_pixel_total : 65192 time to create 1 rle with old method : 0.0755620002746582 length of segment : 409 time for calcul the mask position with numpy : 0.0014765262603759766 nb_pixel_total : 49392 time to create 1 rle with old method : 0.05930328369140625 length of segment : 187 time for calcul the mask position with numpy : 0.0015287399291992188 nb_pixel_total : 54540 time to create 1 rle with old method : 0.06587672233581543 length of segment : 214 time for calcul the mask position with numpy : 0.0004773139953613281 nb_pixel_total : 9466 time to create 1 rle with old method : 0.011539459228515625 length of segment : 93 time for calcul the mask position with numpy : 0.0004737377166748047 nb_pixel_total : 11511 time to create 1 rle with old method : 0.016487836837768555 length of segment : 107 time for calcul the mask position with numpy : 0.00046563148498535156 nb_pixel_total : 8305 time to create 1 rle with old method : 0.01013326644897461 length of segment : 126 time for calcul the mask position with numpy : 0.0015590190887451172 nb_pixel_total : 47297 time to create 1 rle with old method : 0.05563163757324219 length of segment : 269 time for calcul the mask position with numpy : 0.0017888545989990234 nb_pixel_total : 47088 time to create 1 rle with old method : 0.055114030838012695 length of segment : 329 time for calcul the mask position with numpy : 0.0010411739349365234 nb_pixel_total : 17270 time to create 1 rle with old method : 0.020641088485717773 length of segment : 234 time for calcul the mask position with numpy : 0.0008203983306884766 nb_pixel_total : 15653 time to create 1 rle with old method : 0.01876378059387207 length of segment : 153 time for calcul the mask position with numpy : 0.0009558200836181641 nb_pixel_total : 28470 time to create 1 rle with old method : 0.04695582389831543 length of segment : 194 time for calcul the mask position with numpy : 0.00157928466796875 nb_pixel_total : 40803 time to create 1 rle with old method : 0.04779195785522461 length of segment : 243 time for calcul the mask position with numpy : 0.0007283687591552734 nb_pixel_total : 15564 time to create 1 rle with old method : 0.01815342903137207 length of segment : 169 time for calcul the mask position with numpy : 0.0007996559143066406 nb_pixel_total : 23471 time to create 1 rle with old method : 0.02741837501525879 length of segment : 193 time for calcul the mask position with numpy : 0.0038068294525146484 nb_pixel_total : 110484 time to create 1 rle with old method : 0.14336943626403809 length of segment : 492 time for calcul the mask position with numpy : 0.0014755725860595703 nb_pixel_total : 34213 time to create 1 rle with old method : 0.060164690017700195 length of segment : 282 time for calcul the mask position with numpy : 0.0009791851043701172 nb_pixel_total : 25490 time to create 1 rle with old method : 0.03082895278930664 length of segment : 184 time for calcul the mask position with numpy : 0.0023956298828125 nb_pixel_total : 49698 time to create 1 rle with old method : 0.05727648735046387 length of segment : 681 time for calcul the mask position with numpy : 0.001012563705444336 nb_pixel_total : 21725 time to create 1 rle with old method : 0.02554035186767578 length of segment : 275 time for calcul the mask position with numpy : 0.0017981529235839844 nb_pixel_total : 43876 time to create 1 rle with old method : 0.05318045616149902 length of segment : 393 time for calcul the mask position with numpy : 0.0015788078308105469 nb_pixel_total : 50739 time to create 1 rle with old method : 0.05874228477478027 length of segment : 418 time for calcul the mask position with numpy : 0.00026488304138183594 nb_pixel_total : 5806 time to create 1 rle with old method : 0.007298707962036133 length of segment : 72 time for calcul the mask position with numpy : 0.003776073455810547 nb_pixel_total : 86121 time to create 1 rle with old method : 0.10088515281677246 length of segment : 371 time for calcul the mask position with numpy : 0.0025277137756347656 nb_pixel_total : 99375 time to create 1 rle with old method : 0.1162574291229248 length of segment : 449 time for calcul the mask position with numpy : 0.0059893131256103516 nb_pixel_total : 246222 time to create 1 rle with new method : 0.014024019241333008 length of segment : 833 time for calcul the mask position with numpy : 0.0009338855743408203 nb_pixel_total : 35718 time to create 1 rle with old method : 0.0497896671295166 length of segment : 202 time for calcul the mask position with numpy : 0.0013980865478515625 nb_pixel_total : 40426 time to create 1 rle with old method : 0.04938912391662598 length of segment : 257 time for calcul the mask position with numpy : 0.0011425018310546875 nb_pixel_total : 50291 time to create 1 rle with old method : 0.05893230438232422 length of segment : 229 time for calcul the mask position with numpy : 0.0002830028533935547 nb_pixel_total : 7009 time to create 1 rle with old method : 0.00935220718383789 length of segment : 94 time for calcul the mask position with numpy : 0.0010266304016113281 nb_pixel_total : 27194 time to create 1 rle with old method : 0.03234100341796875 length of segment : 341 time for calcul the mask position with numpy : 0.0013115406036376953 nb_pixel_total : 30281 time to create 1 rle with old method : 0.03542923927307129 length of segment : 236 time for calcul the mask position with numpy : 0.0008318424224853516 nb_pixel_total : 20346 time to create 1 rle with old method : 0.026891708374023438 length of segment : 150 time for calcul the mask position with numpy : 0.0013577938079833984 nb_pixel_total : 46103 time to create 1 rle with old method : 0.05306720733642578 length of segment : 232 time for calcul the mask position with numpy : 0.0008561611175537109 nb_pixel_total : 22197 time to create 1 rle with old method : 0.02600550651550293 length of segment : 189 time for calcul the mask position with numpy : 0.0071620941162109375 nb_pixel_total : 200871 time to create 1 rle with new method : 0.012452125549316406 length of segment : 342 time for calcul the mask position with numpy : 0.0006136894226074219 nb_pixel_total : 10117 time to create 1 rle with old method : 0.013341188430786133 length of segment : 154 time for calcul the mask position with numpy : 0.0032303333282470703 nb_pixel_total : 90067 time to create 1 rle with old method : 0.11111140251159668 length of segment : 253 time for calcul the mask position with numpy : 0.0038073062896728516 nb_pixel_total : 109054 time to create 1 rle with old method : 0.1258237361907959 length of segment : 372 time for calcul the mask position with numpy : 0.0007016658782958984 nb_pixel_total : 13380 time to create 1 rle with old method : 0.015865802764892578 length of segment : 152 time for calcul the mask position with numpy : 0.0029387474060058594 nb_pixel_total : 93410 time to create 1 rle with old method : 0.11908769607543945 length of segment : 452 time for calcul the mask position with numpy : 0.00024366378784179688 nb_pixel_total : 4587 time to create 1 rle with old method : 0.0061376094818115234 length of segment : 64 time for calcul the mask position with numpy : 0.0009455680847167969 nb_pixel_total : 25214 time to create 1 rle with old method : 0.02965092658996582 length of segment : 160 time for calcul the mask position with numpy : 0.0002982616424560547 nb_pixel_total : 6996 time to create 1 rle with old method : 0.008479833602905273 length of segment : 60 time for calcul the mask position with numpy : 0.0005869865417480469 nb_pixel_total : 13667 time to create 1 rle with old method : 0.016442298889160156 length of segment : 124 time for calcul the mask position with numpy : 0.005596637725830078 nb_pixel_total : 143824 time to create 1 rle with old method : 0.16536593437194824 length of segment : 659 time for calcul the mask position with numpy : 0.002835512161254883 nb_pixel_total : 92523 time to create 1 rle with old method : 0.10682272911071777 length of segment : 568 time for calcul the mask position with numpy : 0.0007524490356445312 nb_pixel_total : 23550 time to create 1 rle with old method : 0.029138803482055664 length of segment : 192 time for calcul the mask position with numpy : 0.0004208087921142578 nb_pixel_total : 8400 time to create 1 rle with old method : 0.011337995529174805 length of segment : 58 time for calcul the mask position with numpy : 0.0011055469512939453 nb_pixel_total : 30230 time to create 1 rle with old method : 0.04006528854370117 length of segment : 148 time for calcul the mask position with numpy : 0.001477956771850586 nb_pixel_total : 53045 time to create 1 rle with old method : 0.0655527114868164 length of segment : 205 time for calcul the mask position with numpy : 0.0002467632293701172 nb_pixel_total : 5323 time to create 1 rle with old method : 0.008679389953613281 length of segment : 85 time for calcul the mask position with numpy : 0.0008368492126464844 nb_pixel_total : 17951 time to create 1 rle with old method : 0.022995471954345703 length of segment : 224 time for calcul the mask position with numpy : 0.0010204315185546875 nb_pixel_total : 30963 time to create 1 rle with old method : 0.03613734245300293 length of segment : 235 time for calcul the mask position with numpy : 0.0006706714630126953 nb_pixel_total : 17482 time to create 1 rle with old method : 0.020598173141479492 length of segment : 177 time for calcul the mask position with numpy : 0.0016171932220458984 nb_pixel_total : 46071 time to create 1 rle with old method : 0.05638718605041504 length of segment : 229 time for calcul the mask position with numpy : 0.002955198287963867 nb_pixel_total : 97859 time to create 1 rle with old method : 0.11921191215515137 length of segment : 293 time for calcul the mask position with numpy : 0.0021462440490722656 nb_pixel_total : 77880 time to create 1 rle with old method : 0.09026002883911133 length of segment : 395 time for calcul the mask position with numpy : 0.002515077590942383 nb_pixel_total : 84240 time to create 1 rle with old method : 0.09779167175292969 length of segment : 379 time for calcul the mask position with numpy : 0.0063092708587646484 nb_pixel_total : 164795 time to create 1 rle with new method : 0.01016855239868164 length of segment : 944 time for calcul the mask position with numpy : 0.0003514289855957031 nb_pixel_total : 5996 time to create 1 rle with old method : 0.007767200469970703 length of segment : 94 time for calcul the mask position with numpy : 0.00039386749267578125 nb_pixel_total : 7563 time to create 1 rle with old method : 0.008986234664916992 length of segment : 102 time for calcul the mask position with numpy : 0.002251148223876953 nb_pixel_total : 67145 time to create 1 rle with old method : 0.08089995384216309 length of segment : 254 time for calcul the mask position with numpy : 0.00029778480529785156 nb_pixel_total : 6733 time to create 1 rle with old method : 0.008058309555053711 length of segment : 145 time for calcul the mask position with numpy : 0.0019481182098388672 nb_pixel_total : 56657 time to create 1 rle with old method : 0.0658729076385498 length of segment : 423 time for calcul the mask position with numpy : 0.00044918060302734375 nb_pixel_total : 7494 time to create 1 rle with old method : 0.011237382888793945 length of segment : 127 time for calcul the mask position with numpy : 0.0008244514465332031 nb_pixel_total : 16025 time to create 1 rle with old method : 0.019318342208862305 length of segment : 142 time for calcul the mask position with numpy : 0.0019516944885253906 nb_pixel_total : 71195 time to create 1 rle with old method : 0.08210062980651855 length of segment : 332 time for calcul the mask position with numpy : 0.00037217140197753906 nb_pixel_total : 9024 time to create 1 rle with old method : 0.01180887222290039 length of segment : 105 time for calcul the mask position with numpy : 0.018950700759887695 nb_pixel_total : 621910 time to create 1 rle with new method : 0.05277538299560547 length of segment : 924 time for calcul the mask position with numpy : 0.008913993835449219 nb_pixel_total : 152212 time to create 1 rle with new method : 0.017776966094970703 length of segment : 880 time for calcul the mask position with numpy : 0.0024089813232421875 nb_pixel_total : 82993 time to create 1 rle with old method : 0.09813404083251953 length of segment : 437 time for calcul the mask position with numpy : 0.00443720817565918 nb_pixel_total : 139937 time to create 1 rle with old method : 0.18801093101501465 length of segment : 526 time for calcul the mask position with numpy : 0.0005869865417480469 nb_pixel_total : 14199 time to create 1 rle with old method : 0.01718282699584961 length of segment : 95 time for calcul the mask position with numpy : 0.0002605915069580078 nb_pixel_total : 11248 time to create 1 rle with old method : 0.014730215072631836 length of segment : 122 time for calcul the mask position with numpy : 0.001500844955444336 nb_pixel_total : 29709 time to create 1 rle with old method : 0.035627126693725586 length of segment : 251 time for calcul the mask position with numpy : 0.0017557144165039062 nb_pixel_total : 53229 time to create 1 rle with old method : 0.06182551383972168 length of segment : 400 time for calcul the mask position with numpy : 0.0028738975524902344 nb_pixel_total : 52530 time to create 1 rle with old method : 0.06439590454101562 length of segment : 507 time for calcul the mask position with numpy : 0.001024007797241211 nb_pixel_total : 26327 time to create 1 rle with old method : 0.031769514083862305 length of segment : 162 time for calcul the mask position with numpy : 0.007091522216796875 nb_pixel_total : 221070 time to create 1 rle with new method : 0.012477636337280273 length of segment : 677 time for calcul the mask position with numpy : 0.0007548332214355469 nb_pixel_total : 37196 time to create 1 rle with old method : 0.047570228576660156 length of segment : 144 time for calcul the mask position with numpy : 0.0019767284393310547 nb_pixel_total : 80530 time to create 1 rle with old method : 0.09168386459350586 length of segment : 378 time for calcul the mask position with numpy : 0.0013248920440673828 nb_pixel_total : 58062 time to create 1 rle with old method : 0.06842780113220215 length of segment : 300 time for calcul the mask position with numpy : 0.0006194114685058594 nb_pixel_total : 20895 time to create 1 rle with old method : 0.026722431182861328 length of segment : 226 time for calcul the mask position with numpy : 0.0029268264770507812 nb_pixel_total : 79664 time to create 1 rle with old method : 0.09377551078796387 length of segment : 558 time for calcul the mask position with numpy : 0.0003592967987060547 nb_pixel_total : 9430 time to create 1 rle with old method : 0.012530088424682617 length of segment : 71 time for calcul the mask position with numpy : 0.002319812774658203 nb_pixel_total : 84416 time to create 1 rle with old method : 0.10377192497253418 length of segment : 578 time for calcul the mask position with numpy : 0.0006000995635986328 nb_pixel_total : 13183 time to create 1 rle with old method : 0.01572871208190918 length of segment : 131 time for calcul the mask position with numpy : 0.0038504600524902344 nb_pixel_total : 132274 time to create 1 rle with old method : 0.1552896499633789 length of segment : 513 time for calcul the mask position with numpy : 0.0012736320495605469 nb_pixel_total : 69454 time to create 1 rle with old method : 0.08165812492370605 length of segment : 234 time for calcul the mask position with numpy : 0.001967191696166992 nb_pixel_total : 61454 time to create 1 rle with old method : 0.07421350479125977 length of segment : 284 time for calcul the mask position with numpy : 0.0018587112426757812 nb_pixel_total : 40506 time to create 1 rle with old method : 0.05046272277832031 length of segment : 211 time for calcul the mask position with numpy : 0.001764059066772461 nb_pixel_total : 87401 time to create 1 rle with old method : 0.0991508960723877 length of segment : 494 time for calcul the mask position with numpy : 0.0018591880798339844 nb_pixel_total : 72553 time to create 1 rle with old method : 0.08611559867858887 length of segment : 329 time for calcul the mask position with numpy : 0.0009350776672363281 nb_pixel_total : 21715 time to create 1 rle with old method : 0.024958372116088867 length of segment : 289 time for calcul the mask position with numpy : 0.0234220027923584 nb_pixel_total : 641394 time to create 1 rle with new method : 0.05680489540100098 length of segment : 957 time for calcul the mask position with numpy : 0.008317232131958008 nb_pixel_total : 154419 time to create 1 rle with new method : 0.31385183334350586 length of segment : 677 time for calcul the mask position with numpy : 0.000720977783203125 nb_pixel_total : 14180 time to create 1 rle with old method : 0.0242922306060791 length of segment : 95 time for calcul the mask position with numpy : 0.0023980140686035156 nb_pixel_total : 48237 time to create 1 rle with old method : 0.05729508399963379 length of segment : 307 time for calcul the mask position with numpy : 0.0006692409515380859 nb_pixel_total : 20805 time to create 1 rle with old method : 0.028251171112060547 length of segment : 134 time for calcul the mask position with numpy : 0.004580974578857422 nb_pixel_total : 143794 time to create 1 rle with old method : 0.16421842575073242 length of segment : 531 time for calcul the mask position with numpy : 0.0033507347106933594 nb_pixel_total : 98830 time to create 1 rle with old method : 0.11755251884460449 length of segment : 482 time for calcul the mask position with numpy : 0.011960268020629883 nb_pixel_total : 254508 time to create 1 rle with new method : 0.037999629974365234 length of segment : 766 time for calcul the mask position with numpy : 0.0021512508392333984 nb_pixel_total : 67306 time to create 1 rle with old method : 0.08048629760742188 length of segment : 388 time for calcul the mask position with numpy : 0.001130819320678711 nb_pixel_total : 51959 time to create 1 rle with old method : 0.06320333480834961 length of segment : 305 time for calcul the mask position with numpy : 0.0016396045684814453 nb_pixel_total : 46740 time to create 1 rle with old method : 0.05497312545776367 length of segment : 382 time for calcul the mask position with numpy : 0.00030612945556640625 nb_pixel_total : 11542 time to create 1 rle with old method : 0.014772415161132812 length of segment : 122 time for calcul the mask position with numpy : 0.0009875297546386719 nb_pixel_total : 20818 time to create 1 rle with old method : 0.02445507049560547 length of segment : 234 time for calcul the mask position with numpy : 0.001967906951904297 nb_pixel_total : 53432 time to create 1 rle with old method : 0.0638275146484375 length of segment : 375 time for calcul the mask position with numpy : 0.00026607513427734375 nb_pixel_total : 6454 time to create 1 rle with old method : 0.007950067520141602 length of segment : 66 time for calcul the mask position with numpy : 0.0009927749633789062 nb_pixel_total : 25841 time to create 1 rle with old method : 0.030971288681030273 length of segment : 234 time for calcul the mask position with numpy : 0.003912925720214844 nb_pixel_total : 77446 time to create 1 rle with old method : 0.10776567459106445 length of segment : 503 time for calcul the mask position with numpy : 0.0037131309509277344 nb_pixel_total : 124691 time to create 1 rle with old method : 0.14470696449279785 length of segment : 483 time for calcul the mask position with numpy : 0.0039920806884765625 nb_pixel_total : 222522 time to create 1 rle with new method : 0.014207601547241211 length of segment : 630 time for calcul the mask position with numpy : 0.0005216598510742188 nb_pixel_total : 15998 time to create 1 rle with old method : 0.01955699920654297 length of segment : 231 time for calcul the mask position with numpy : 0.0020294189453125 nb_pixel_total : 73657 time to create 1 rle with old method : 0.0864248275756836 length of segment : 336 time for calcul the mask position with numpy : 0.0003466606140136719 nb_pixel_total : 13300 time to create 1 rle with old method : 0.016054153442382812 length of segment : 127 time spent for convertir_results : 20.56607985496521 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 200 chid ids of type : 3594 Number RLEs to save : 61712 save missing photos in datou_result : time spend for datou_step_exec : 97.74775671958923 time spend to save output : 3.8245365619659424 total time spend for step 1 : 101.57229328155518 step2:crop_condition Mon May 19 22:02:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 11 ! batch 1 Loaded 200 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 121 About to insert : list_path_to_insert length 121 new photo from crops ! About to upload 121 photos upload in portfolio : 3736932 init cache_photo without model_param we have 121 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747684964_3677893 we have uploaded 121 photos in the portfolio 3736932 time of upload the photos Elapsed time : 32.00225782394409 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 23 About to insert : list_path_to_insert length 23 new photo from crops ! About to upload 23 photos upload in portfolio : 3736932 init cache_photo without model_param we have 23 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747685007_3677893 we have uploaded 23 photos in the portfolio 3736932 time of upload the photos Elapsed time : 5.369958162307739 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 53 About to insert : list_path_to_insert length 53 new photo from crops ! About to upload 53 photos upload in portfolio : 3736932 init cache_photo without model_param we have 53 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747685032_3677893 we have uploaded 53 photos in the portfolio 3736932 time of upload the photos Elapsed time : 13.270434141159058 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747685047_3677893 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.9495081901550293 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1747685050_3677893 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.4785130023956299 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1359519042, 1359518650, 1359518619, 1359518588, 1359518554, 1359515154, 1359515150, 1359515144, 1359515137, 1359515092, 1359514939] Looping around the photos to save general results len do output : 200 /1359559642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359559843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560068Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560072Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560074Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560076Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560078Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560080Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560082Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560086Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560090Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560094Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1359560409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359519042', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359518650', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359518619', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359518588', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359518554', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515154', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515150', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515144', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515137', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515092', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359514939', None, None, None, None, None, '2899960') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 611 time used for this insertion : 0.03049468994140625 save_final save missing photos in datou_result : time spend for datou_step_exec : 119.23823833465576 time spend to save output : 0.034934043884277344 total time spend for step 2 : 119.27317237854004 step3:rle_unique_nms_with_priority Mon May 19 22:04:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 200 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 5.983195781707764 time for calcul the mask position with numpy : 0.5002989768981934 nb_pixel_total : 5186468 time to create 1 rle with new method : 0.6839613914489746 time for calcul the mask position with numpy : 0.029798030853271484 nb_pixel_total : 21494 time to create 1 rle with old method : 0.023644447326660156 time for calcul the mask position with numpy : 0.02138829231262207 nb_pixel_total : 83301 time to create 1 rle with old method : 0.09234619140625 time for calcul the mask position with numpy : 0.025756120681762695 nb_pixel_total : 457600 time to create 1 rle with new method : 0.7310779094696045 time for calcul the mask position with numpy : 0.020238399505615234 nb_pixel_total : 23836 time to create 1 rle with old method : 0.0253598690032959 time for calcul the mask position with numpy : 0.020375728607177734 nb_pixel_total : 61580 time to create 1 rle with old method : 0.06728529930114746 time for calcul the mask position with numpy : 0.021351099014282227 nb_pixel_total : 142294 time to create 1 rle with old method : 0.14948630332946777 time for calcul the mask position with numpy : 0.021029949188232422 nb_pixel_total : 286198 time to create 1 rle with new method : 0.6395518779754639 time for calcul the mask position with numpy : 0.019868135452270508 nb_pixel_total : 60502 time to create 1 rle with old method : 0.06412315368652344 time for calcul the mask position with numpy : 0.020070791244506836 nb_pixel_total : 9694 time to create 1 rle with old method : 0.010851621627807617 time for calcul the mask position with numpy : 0.022444486618041992 nb_pixel_total : 86733 time to create 1 rle with old method : 0.0936131477355957 time for calcul the mask position with numpy : 0.022124528884887695 nb_pixel_total : 304347 time to create 1 rle with new method : 0.5316219329833984 time for calcul the mask position with numpy : 0.022179841995239258 nb_pixel_total : 222099 time to create 1 rle with new method : 0.7722790241241455 time for calcul the mask position with numpy : 0.020531177520751953 nb_pixel_total : 25211 time to create 1 rle with old method : 0.02674412727355957 time for calcul the mask position with numpy : 0.020956754684448242 nb_pixel_total : 10337 time to create 1 rle with old method : 0.011399269104003906 time for calcul the mask position with numpy : 0.020478487014770508 nb_pixel_total : 26936 time to create 1 rle with old method : 0.02886795997619629 time for calcul the mask position with numpy : 0.020854473114013672 nb_pixel_total : 25802 time to create 1 rle with old method : 0.027584552764892578 time for calcul the mask position with numpy : 0.020852088928222656 nb_pixel_total : 15808 time to create 1 rle with old method : 0.016706228256225586 create new chi : 4.977673053741455 time to delete rle : 0.027002334594726562 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 16562 TO DO : save crop sub photo not yet done ! save time : 1.0203139781951904 nb_obj : 19 nb_hashtags : 3 time to prepare the origin masks : 7.93701696395874 time for calcul the mask position with numpy : 0.44857144355773926 nb_pixel_total : 6244142 time to create 1 rle with new method : 0.7363097667694092 time for calcul the mask position with numpy : 0.03219771385192871 nb_pixel_total : 11959 time to create 1 rle with old method : 0.012923955917358398 time for calcul the mask position with numpy : 0.02014303207397461 nb_pixel_total : 54712 time to create 1 rle with old method : 0.05875515937805176 time for calcul the mask position with numpy : 0.019793033599853516 nb_pixel_total : 69031 time to create 1 rle with old method : 0.07547402381896973 time for calcul the mask position with numpy : 0.021451234817504883 nb_pixel_total : 39893 time to create 1 rle with old method : 0.043894290924072266 time for calcul the mask position with numpy : 0.020709514617919922 nb_pixel_total : 11750 time to create 1 rle with old method : 0.012583017349243164 time for calcul the mask position with numpy : 0.019832611083984375 nb_pixel_total : 6231 time to create 1 rle with old method : 0.006650447845458984 time for calcul the mask position with numpy : 0.02065896987915039 nb_pixel_total : 33650 time to create 1 rle with old method : 0.03695845603942871 time for calcul the mask position with numpy : 0.02128148078918457 nb_pixel_total : 11058 time to create 1 rle with old method : 0.012291908264160156 time for calcul the mask position with numpy : 0.02017951011657715 nb_pixel_total : 45839 time to create 1 rle with old method : 0.049268484115600586 time for calcul the mask position with numpy : 0.020159006118774414 nb_pixel_total : 51092 time to create 1 rle with old method : 0.05481076240539551 time for calcul the mask position with numpy : 0.02027606964111328 nb_pixel_total : 42792 time to create 1 rle with old method : 0.050037384033203125 time for calcul the mask position with numpy : 0.02424144744873047 nb_pixel_total : 197619 time to create 1 rle with new method : 0.6990160942077637 time for calcul the mask position with numpy : 0.10057878494262695 nb_pixel_total : 26412 time to create 1 rle with old method : 0.02899765968322754 time for calcul the mask position with numpy : 0.05366063117980957 nb_pixel_total : 21855 time to create 1 rle with old method : 0.023454666137695312 time for calcul the mask position with numpy : 0.021179676055908203 nb_pixel_total : 43132 time to create 1 rle with old method : 0.04754209518432617 time for calcul the mask position with numpy : 0.02111983299255371 nb_pixel_total : 19103 time to create 1 rle with old method : 0.02194976806640625 time for calcul the mask position with numpy : 0.022066831588745117 nb_pixel_total : 33774 time to create 1 rle with old method : 0.05677080154418945 time for calcul the mask position with numpy : 0.028455734252929688 nb_pixel_total : 68114 time to create 1 rle with old method : 0.09009122848510742 time for calcul the mask position with numpy : 0.021391630172729492 nb_pixel_total : 18082 time to create 1 rle with old method : 0.02032017707824707 create new chi : 3.1733343601226807 time to delete rle : 0.0021615028381347656 batch 1 Loaded 39 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 11364 TO DO : save crop sub photo not yet done ! save time : 0.7286653518676758 nb_obj : 20 nb_hashtags : 4 time to prepare the origin masks : 7.092595815658569 time for calcul the mask position with numpy : 0.6443259716033936 nb_pixel_total : 6113473 time to create 1 rle with new method : 0.6513495445251465 time for calcul the mask position with numpy : 0.019112825393676758 nb_pixel_total : 12478 time to create 1 rle with old method : 0.013069391250610352 time for calcul the mask position with numpy : 0.03136777877807617 nb_pixel_total : 12683 time to create 1 rle with old method : 0.013382434844970703 time for calcul the mask position with numpy : 0.03161215782165527 nb_pixel_total : 35016 time to create 1 rle with old method : 0.037016868591308594 time for calcul the mask position with numpy : 0.02025628089904785 nb_pixel_total : 15066 time to create 1 rle with old method : 0.017304420471191406 time for calcul the mask position with numpy : 0.020750045776367188 nb_pixel_total : 41045 time to create 1 rle with old method : 0.04460000991821289 time for calcul the mask position with numpy : 0.02037954330444336 nb_pixel_total : 34537 time to create 1 rle with old method : 0.0376431941986084 time for calcul the mask position with numpy : 0.019668102264404297 nb_pixel_total : 22696 time to create 1 rle with old method : 0.023720502853393555 time for calcul the mask position with numpy : 0.01990818977355957 nb_pixel_total : 110327 time to create 1 rle with old method : 0.1156914234161377 time for calcul the mask position with numpy : 0.02008652687072754 nb_pixel_total : 10414 time to create 1 rle with old method : 0.011032581329345703 time for calcul the mask position with numpy : 0.019848108291625977 nb_pixel_total : 11753 time to create 1 rle with old method : 0.012391805648803711 time for calcul the mask position with numpy : 0.02004384994506836 nb_pixel_total : 31352 time to create 1 rle with old method : 0.03367733955383301 time for calcul the mask position with numpy : 0.02256155014038086 nb_pixel_total : 298636 time to create 1 rle with new method : 0.5582337379455566 time for calcul the mask position with numpy : 0.01964282989501953 nb_pixel_total : 12524 time to create 1 rle with old method : 0.013265371322631836 time for calcul the mask position with numpy : 0.019700050354003906 nb_pixel_total : 22979 time to create 1 rle with old method : 0.024462461471557617 time for calcul the mask position with numpy : 0.02001047134399414 nb_pixel_total : 21118 time to create 1 rle with old method : 0.02246236801147461 time for calcul the mask position with numpy : 0.02028369903564453 nb_pixel_total : 71304 time to create 1 rle with old method : 0.07462310791015625 time for calcul the mask position with numpy : 0.020070552825927734 nb_pixel_total : 59201 time to create 1 rle with old method : 0.06238532066345215 time for calcul the mask position with numpy : 0.020418643951416016 nb_pixel_total : 45835 time to create 1 rle with old method : 0.0482182502746582 time for calcul the mask position with numpy : 0.0203092098236084 nb_pixel_total : 33571 time to create 1 rle with old method : 0.035541534423828125 time for calcul the mask position with numpy : 0.020348548889160156 nb_pixel_total : 34232 time to create 1 rle with old method : 0.03804206848144531 create new chi : 3.01371693611145 time to delete rle : 0.0015974044799804688 batch 1 Loaded 41 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 10780 TO DO : save crop sub photo not yet done ! save time : 0.7278449535369873 nb_obj : 13 nb_hashtags : 3 time to prepare the origin masks : 5.165635108947754 time for calcul the mask position with numpy : 0.32918262481689453 nb_pixel_total : 6176198 time to create 1 rle with new method : 0.7237954139709473 time for calcul the mask position with numpy : 0.021241188049316406 nb_pixel_total : 253267 time to create 1 rle with new method : 0.6124587059020996 time for calcul the mask position with numpy : 0.019922256469726562 nb_pixel_total : 63980 time to create 1 rle with old method : 0.06632685661315918 time for calcul the mask position with numpy : 0.020128965377807617 nb_pixel_total : 158673 time to create 1 rle with new method : 0.5387423038482666 time for calcul the mask position with numpy : 0.019200801849365234 nb_pixel_total : 66291 time to create 1 rle with old method : 0.07014083862304688 time for calcul the mask position with numpy : 0.019431352615356445 nb_pixel_total : 52683 time to create 1 rle with old method : 0.055356740951538086 time for calcul the mask position with numpy : 0.0199429988861084 nb_pixel_total : 18097 time to create 1 rle with old method : 0.01921367645263672 time for calcul the mask position with numpy : 0.020288467407226562 nb_pixel_total : 21412 time to create 1 rle with old method : 0.023550987243652344 time for calcul the mask position with numpy : 0.01987147331237793 nb_pixel_total : 122746 time to create 1 rle with old method : 0.1275768280029297 time for calcul the mask position with numpy : 0.019771337509155273 nb_pixel_total : 63877 time to create 1 rle with old method : 0.06662631034851074 time for calcul the mask position with numpy : 0.019290447235107422 nb_pixel_total : 10961 time to create 1 rle with old method : 0.01151585578918457 time for calcul the mask position with numpy : 0.02061915397644043 nb_pixel_total : 15968 time to create 1 rle with old method : 0.016575098037719727 time for calcul the mask position with numpy : 0.01951742172241211 nb_pixel_total : 19407 time to create 1 rle with old method : 0.020876407623291016 time for calcul the mask position with numpy : 0.020325660705566406 nb_pixel_total : 6680 time to create 1 rle with old method : 0.0070781707763671875 create new chi : 3.024482011795044 time to delete rle : 0.0021886825561523438 batch 1 Loaded 27 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 9240 TO DO : save crop sub photo not yet done ! save time : 0.6483290195465088 nb_obj : 18 nb_hashtags : 2 time to prepare the origin masks : 5.987499475479126 time for calcul the mask position with numpy : 0.29787278175354004 nb_pixel_total : 5661625 time to create 1 rle with new method : 0.847693681716919 time for calcul the mask position with numpy : 0.019307851791381836 nb_pixel_total : 54540 time to create 1 rle with old method : 0.05701613426208496 time for calcul the mask position with numpy : 0.01985478401184082 nb_pixel_total : 49392 time to create 1 rle with old method : 0.05168747901916504 time for calcul the mask position with numpy : 0.019785165786743164 nb_pixel_total : 65192 time to create 1 rle with old method : 0.06981682777404785 time for calcul the mask position with numpy : 0.020412921905517578 nb_pixel_total : 107537 time to create 1 rle with old method : 0.11545443534851074 time for calcul the mask position with numpy : 0.021041393280029297 nb_pixel_total : 105693 time to create 1 rle with old method : 0.11284422874450684 time for calcul the mask position with numpy : 0.020639896392822266 nb_pixel_total : 49522 time to create 1 rle with old method : 0.05532526969909668 time for calcul the mask position with numpy : 0.019562959671020508 nb_pixel_total : 20497 time to create 1 rle with old method : 0.021481037139892578 time for calcul the mask position with numpy : 0.025893211364746094 nb_pixel_total : 67813 time to create 1 rle with old method : 0.07159900665283203 time for calcul the mask position with numpy : 0.019202709197998047 nb_pixel_total : 17071 time to create 1 rle with old method : 0.017791032791137695 time for calcul the mask position with numpy : 0.020489215850830078 nb_pixel_total : 34110 time to create 1 rle with old method : 0.03631091117858887 time for calcul the mask position with numpy : 0.020961523056030273 nb_pixel_total : 73730 time to create 1 rle with old method : 0.07964730262756348 time for calcul the mask position with numpy : 0.021055221557617188 nb_pixel_total : 152378 time to create 1 rle with new method : 0.5971217155456543 time for calcul the mask position with numpy : 0.02271127700805664 nb_pixel_total : 210802 time to create 1 rle with new method : 0.7123537063598633 time for calcul the mask position with numpy : 0.021968841552734375 nb_pixel_total : 78276 time to create 1 rle with old method : 0.08770251274108887 time for calcul the mask position with numpy : 0.021846771240234375 nb_pixel_total : 19828 time to create 1 rle with old method : 0.022220134735107422 time for calcul the mask position with numpy : 0.024550676345825195 nb_pixel_total : 105801 time to create 1 rle with old method : 0.12030029296875 time for calcul the mask position with numpy : 0.03272891044616699 nb_pixel_total : 33533 time to create 1 rle with old method : 0.03718733787536621 time for calcul the mask position with numpy : 0.029362916946411133 nb_pixel_total : 142900 time to create 1 rle with old method : 0.1544358730316162 create new chi : 4.047955274581909 time to delete rle : 0.0022928714752197266 batch 1 Loaded 37 chid ids of type : 3594 +++++++++++++++++++++Number RLEs to save : 15579 TO DO : save crop sub photo not yet done ! save time : 0.934913158416748 nb_obj : 16 nb_hashtags : 3 time to prepare the origin masks : 6.244111776351929 time for calcul the mask position with numpy : 0.518406867980957 nb_pixel_total : 6543732 time to create 1 rle with new method : 0.5549349784851074 time for calcul the mask position with numpy : 0.021399736404418945 nb_pixel_total : 21725 time to create 1 rle with old method : 0.024797439575195312 time for calcul the mask position with numpy : 0.020590543746948242 nb_pixel_total : 49698 time to create 1 rle with old method : 0.055739402770996094 time for calcul the mask position with numpy : 0.020574331283569336 nb_pixel_total : 25490 time to create 1 rle with old method : 0.028139829635620117 time for calcul the mask position with numpy : 0.020890235900878906 nb_pixel_total : 34213 time to create 1 rle with old method : 0.05019879341125488 time for calcul the mask position with numpy : 0.02476644515991211 nb_pixel_total : 110484 time to create 1 rle with old method : 0.1331319808959961 time for calcul the mask position with numpy : 0.022823810577392578 nb_pixel_total : 23471 time to create 1 rle with old method : 0.02722764015197754 time for calcul the mask position with numpy : 0.023703575134277344 nb_pixel_total : 15564 time to create 1 rle with old method : 0.018378257751464844 time for calcul the mask position with numpy : 0.022142410278320312 nb_pixel_total : 40803 time to create 1 rle with old method : 0.04711723327636719 time for calcul the mask position with numpy : 0.02285480499267578 nb_pixel_total : 28470 time to create 1 rle with old method : 0.03298544883728027 time for calcul the mask position with numpy : 0.023838043212890625 nb_pixel_total : 15653 time to create 1 rle with old method : 0.017541885375976562 time for calcul the mask position with numpy : 0.030626296997070312 nb_pixel_total : 17270 time to create 1 rle with old method : 0.019893646240234375 time for calcul the mask position with numpy : 0.033843040466308594 nb_pixel_total : 47088 time to create 1 rle with old method : 0.05254006385803223 time for calcul the mask position with numpy : 0.03128242492675781 nb_pixel_total : 47297 time to create 1 rle with old method : 0.05323672294616699 time for calcul the mask position with numpy : 0.027889251708984375 nb_pixel_total : 8305 time to create 1 rle with old method : 0.009288787841796875 time for calcul the mask position with numpy : 0.021135807037353516 nb_pixel_total : 11511 time to create 1 rle with old method : 0.013103961944580078 time for calcul the mask position with numpy : 0.02288532257080078 nb_pixel_total : 9466 time to create 1 rle with old method : 0.015714406967163086 create new chi : 2.1019175052642822 time to delete rle : 0.0019385814666748047 batch 1 Loaded 33 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 10208 TO DO : save crop sub photo not yet done ! save time : 0.7233603000640869 nb_obj : 11 nb_hashtags : 4 time to prepare the origin masks : 5.492293357849121 time for calcul the mask position with numpy : 0.4777684211730957 nb_pixel_total : 6357463 time to create 1 rle with new method : 0.7440757751464844 time for calcul the mask position with numpy : 0.02027606964111328 nb_pixel_total : 27194 time to create 1 rle with old method : 0.028882741928100586 time for calcul the mask position with numpy : 0.019768714904785156 nb_pixel_total : 7009 time to create 1 rle with old method : 0.007624387741088867 time for calcul the mask position with numpy : 0.02000117301940918 nb_pixel_total : 50291 time to create 1 rle with old method : 0.05382585525512695 time for calcul the mask position with numpy : 0.020333528518676758 nb_pixel_total : 40426 time to create 1 rle with old method : 0.04548907279968262 time for calcul the mask position with numpy : 0.020465612411499023 nb_pixel_total : 35718 time to create 1 rle with old method : 0.03969717025756836 time for calcul the mask position with numpy : 0.027665138244628906 nb_pixel_total : 246222 time to create 1 rle with new method : 0.6527018547058105 time for calcul the mask position with numpy : 0.03894376754760742 nb_pixel_total : 99375 time to create 1 rle with old method : 0.10704278945922852 time for calcul the mask position with numpy : 0.031946659088134766 nb_pixel_total : 86121 time to create 1 rle with old method : 0.09643244743347168 time for calcul the mask position with numpy : 0.03264284133911133 nb_pixel_total : 5806 time to create 1 rle with old method : 0.006707429885864258 time for calcul the mask position with numpy : 0.022627830505371094 nb_pixel_total : 50739 time to create 1 rle with old method : 0.057679176330566406 time for calcul the mask position with numpy : 0.022530794143676758 nb_pixel_total : 43876 time to create 1 rle with old method : 0.05045580863952637 create new chi : 2.708848237991333 time to delete rle : 0.0013537406921386719 batch 1 Loaded 23 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 9478 TO DO : save crop sub photo not yet done ! save time : 0.7255508899688721 nb_obj : 21 nb_hashtags : 2 time to prepare the origin masks : 7.819498538970947 time for calcul the mask position with numpy : 0.4317018985748291 nb_pixel_total : 6007055 time to create 1 rle with new method : 1.053447961807251 time for calcul the mask position with numpy : 0.03601431846618652 nb_pixel_total : 5323 time to create 1 rle with old method : 0.006204366683959961 time for calcul the mask position with numpy : 0.034822702407836914 nb_pixel_total : 53045 time to create 1 rle with old method : 0.06528091430664062 time for calcul the mask position with numpy : 0.0335235595703125 nb_pixel_total : 30230 time to create 1 rle with old method : 0.03488564491271973 time for calcul the mask position with numpy : 0.03186535835266113 nb_pixel_total : 8400 time to create 1 rle with old method : 0.009913444519042969 time for calcul the mask position with numpy : 0.06455349922180176 nb_pixel_total : 23550 time to create 1 rle with old method : 0.03702354431152344 time for calcul the mask position with numpy : 0.03529810905456543 nb_pixel_total : 92523 time to create 1 rle with old method : 0.10431146621704102 time for calcul the mask position with numpy : 0.02790665626525879 nb_pixel_total : 143824 time to create 1 rle with old method : 0.16490387916564941 time for calcul the mask position with numpy : 0.021752357482910156 nb_pixel_total : 13667 time to create 1 rle with old method : 0.015421152114868164 time for calcul the mask position with numpy : 0.02162003517150879 nb_pixel_total : 6996 time to create 1 rle with old method : 0.007909297943115234 time for calcul the mask position with numpy : 0.0212247371673584 nb_pixel_total : 25214 time to create 1 rle with old method : 0.027816057205200195 time for calcul the mask position with numpy : 0.020617961883544922 nb_pixel_total : 4587 time to create 1 rle with old method : 0.0050678253173828125 time for calcul the mask position with numpy : 0.019541501998901367 nb_pixel_total : 93410 time to create 1 rle with old method : 0.10243868827819824 time for calcul the mask position with numpy : 0.020819425582885742 nb_pixel_total : 13380 time to create 1 rle with old method : 0.015074491500854492 time for calcul the mask position with numpy : 0.02162456512451172 nb_pixel_total : 109054 time to create 1 rle with old method : 0.13536667823791504 time for calcul the mask position with numpy : 0.024022340774536133 nb_pixel_total : 90067 time to create 1 rle with old method : 0.11307501792907715 time for calcul the mask position with numpy : 0.023768901824951172 nb_pixel_total : 10117 time to create 1 rle with old method : 0.011848211288452148 time for calcul the mask position with numpy : 0.038355350494384766 nb_pixel_total : 200871 time to create 1 rle with new method : 0.6347517967224121 time for calcul the mask position with numpy : 0.03537750244140625 nb_pixel_total : 22197 time to create 1 rle with old method : 0.026083946228027344 time for calcul the mask position with numpy : 0.03541898727416992 nb_pixel_total : 46103 time to create 1 rle with old method : 0.05914044380187988 time for calcul the mask position with numpy : 0.03213930130004883 nb_pixel_total : 20346 time to create 1 rle with old method : 0.023242712020874023 time for calcul the mask position with numpy : 0.03302741050720215 nb_pixel_total : 30281 time to create 1 rle with old method : 0.03467082977294922 create new chi : 3.8147401809692383 time to delete rle : 0.0021533966064453125 batch 1 Loaded 43 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 11870 TO DO : save crop sub photo not yet done ! save time : 0.7393474578857422 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 5.5612711906433105 time for calcul the mask position with numpy : 1.191098690032959 nb_pixel_total : 6274213 time to create 1 rle with new method : 1.3712310791015625 time for calcul the mask position with numpy : 0.03489995002746582 nb_pixel_total : 9024 time to create 1 rle with old method : 0.01033926010131836 time for calcul the mask position with numpy : 0.03546333312988281 nb_pixel_total : 71195 time to create 1 rle with old method : 0.07906055450439453 time for calcul the mask position with numpy : 0.03286027908325195 nb_pixel_total : 16025 time to create 1 rle with old method : 0.018019437789916992 time for calcul the mask position with numpy : 0.03357696533203125 nb_pixel_total : 7494 time to create 1 rle with old method : 0.008244991302490234 time for calcul the mask position with numpy : 0.03335213661193848 nb_pixel_total : 52098 time to create 1 rle with old method : 0.05741119384765625 time for calcul the mask position with numpy : 0.034670352935791016 nb_pixel_total : 6733 time to create 1 rle with old method : 0.0076580047607421875 time for calcul the mask position with numpy : 0.035414695739746094 nb_pixel_total : 67145 time to create 1 rle with old method : 0.08003592491149902 time for calcul the mask position with numpy : 0.03495359420776367 nb_pixel_total : 7563 time to create 1 rle with old method : 0.008801937103271484 time for calcul the mask position with numpy : 0.023046016693115234 nb_pixel_total : 5996 time to create 1 rle with old method : 0.007061958312988281 time for calcul the mask position with numpy : 0.025174856185913086 nb_pixel_total : 162641 time to create 1 rle with new method : 0.5846717357635498 time for calcul the mask position with numpy : 0.02275252342224121 nb_pixel_total : 84240 time to create 1 rle with old method : 0.11044836044311523 time for calcul the mask position with numpy : 0.02535867691040039 nb_pixel_total : 75547 time to create 1 rle with old method : 0.09020423889160156 time for calcul the mask position with numpy : 0.022304058074951172 nb_pixel_total : 97859 time to create 1 rle with old method : 0.13724875450134277 time for calcul the mask position with numpy : 0.02252984046936035 nb_pixel_total : 46071 time to create 1 rle with old method : 0.0531611442565918 time for calcul the mask position with numpy : 0.02794671058654785 nb_pixel_total : 17482 time to create 1 rle with old method : 0.01998114585876465 time for calcul the mask position with numpy : 0.03469967842102051 nb_pixel_total : 30963 time to create 1 rle with old method : 0.03552675247192383 time for calcul the mask position with numpy : 0.037934303283691406 nb_pixel_total : 17951 time to create 1 rle with old method : 0.020845890045166016 create new chi : 4.4682464599609375 time to delete rle : 0.0018107891082763672 batch 1 Loaded 35 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 10851 TO DO : save crop sub photo not yet done ! save time : 0.6620044708251953 nb_obj : 26 nb_hashtags : 3 time to prepare the origin masks : 4.6557817459106445 time for calcul the mask position with numpy : 0.6713278293609619 nb_pixel_total : 4877965 time to create 1 rle with new method : 1.9998724460601807 time for calcul the mask position with numpy : 0.02739882469177246 nb_pixel_total : 26327 time to create 1 rle with old method : 0.028038740158081055 time for calcul the mask position with numpy : 0.026866674423217773 nb_pixel_total : 14199 time to create 1 rle with old method : 0.018434524536132812 time for calcul the mask position with numpy : 0.03288698196411133 nb_pixel_total : 13183 time to create 1 rle with old method : 0.022074222564697266 time for calcul the mask position with numpy : 0.03188633918762207 nb_pixel_total : 61454 time to create 1 rle with old method : 0.08318519592285156 time for calcul the mask position with numpy : 0.028510332107543945 nb_pixel_total : 72553 time to create 1 rle with old method : 0.08150553703308105 time for calcul the mask position with numpy : 0.02872920036315918 nb_pixel_total : 40506 time to create 1 rle with old method : 0.04559516906738281 time for calcul the mask position with numpy : 0.028632640838623047 nb_pixel_total : 78575 time to create 1 rle with old method : 0.08821415901184082 time for calcul the mask position with numpy : 0.03268885612487793 nb_pixel_total : 621910 time to create 1 rle with new method : 0.8022782802581787 time for calcul the mask position with numpy : 0.028078317642211914 nb_pixel_total : 139937 time to create 1 rle with old method : 0.15879559516906738 time for calcul the mask position with numpy : 0.03014087677001953 nb_pixel_total : 221070 time to create 1 rle with new method : 0.7131726741790771 time for calcul the mask position with numpy : 0.03181028366088867 nb_pixel_total : 87401 time to create 1 rle with old method : 0.10288572311401367 time for calcul the mask position with numpy : 0.029181480407714844 nb_pixel_total : 36645 time to create 1 rle with old method : 0.043025970458984375 time for calcul the mask position with numpy : 0.028886795043945312 nb_pixel_total : 34122 time to create 1 rle with old method : 0.039174556732177734 time for calcul the mask position with numpy : 0.028347492218017578 nb_pixel_total : 29709 time to create 1 rle with old method : 0.033776283264160156 time for calcul the mask position with numpy : 0.029272794723510742 nb_pixel_total : 79577 time to create 1 rle with old method : 0.09145045280456543 time for calcul the mask position with numpy : 0.02879786491394043 nb_pixel_total : 5576 time to create 1 rle with old method : 0.006991863250732422 time for calcul the mask position with numpy : 0.028690576553344727 nb_pixel_total : 21715 time to create 1 rle with old method : 0.024634599685668945 time for calcul the mask position with numpy : 0.028082847595214844 nb_pixel_total : 58062 time to create 1 rle with old method : 0.06510114669799805 time for calcul the mask position with numpy : 0.027677059173583984 nb_pixel_total : 69454 time to create 1 rle with old method : 0.07701683044433594 time for calcul the mask position with numpy : 0.028809309005737305 nb_pixel_total : 132274 time to create 1 rle with old method : 0.15361618995666504 time for calcul the mask position with numpy : 0.11054849624633789 nb_pixel_total : 9267 time to create 1 rle with old method : 0.010324716567993164 time for calcul the mask position with numpy : 0.09177160263061523 nb_pixel_total : 152212 time to create 1 rle with new method : 0.3292660713195801 time for calcul the mask position with numpy : 0.03166532516479492 nb_pixel_total : 82993 time to create 1 rle with old method : 0.10207056999206543 time for calcul the mask position with numpy : 0.029028654098510742 nb_pixel_total : 20895 time to create 1 rle with old method : 0.02346205711364746 time for calcul the mask position with numpy : 0.027725934982299805 nb_pixel_total : 53229 time to create 1 rle with old method : 0.06044650077819824 time for calcul the mask position with numpy : 0.027797937393188477 nb_pixel_total : 9430 time to create 1 rle with old method : 0.010693788528442383 create new chi : 6.88886570930481 time to delete rle : 0.005011796951293945 batch 1 Loaded 53 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++Number RLEs to save : 20569 TO DO : save crop sub photo not yet done ! save time : 1.311006784439087 nb_obj : 22 nb_hashtags : 3 time to prepare the origin masks : 8.825284242630005 time for calcul the mask position with numpy : 0.7358334064483643 nb_pixel_total : 4878076 time to create 1 rle with new method : 1.4814603328704834 time for calcul the mask position with numpy : 0.03258490562438965 nb_pixel_total : 2296 time to create 1 rle with old method : 0.002732515335083008 time for calcul the mask position with numpy : 0.02656841278076172 nb_pixel_total : 73657 time to create 1 rle with old method : 0.08312535285949707 time for calcul the mask position with numpy : 0.02148914337158203 nb_pixel_total : 15998 time to create 1 rle with old method : 0.018190860748291016 time for calcul the mask position with numpy : 0.026146650314331055 nb_pixel_total : 221374 time to create 1 rle with new method : 0.6060459613800049 time for calcul the mask position with numpy : 0.02185511589050293 nb_pixel_total : 124691 time to create 1 rle with old method : 0.14615154266357422 time for calcul the mask position with numpy : 0.0268399715423584 nb_pixel_total : 77446 time to create 1 rle with old method : 0.08978652954101562 time for calcul the mask position with numpy : 0.021445274353027344 nb_pixel_total : 25841 time to create 1 rle with old method : 0.029219388961791992 time for calcul the mask position with numpy : 0.02087688446044922 nb_pixel_total : 6454 time to create 1 rle with old method : 0.0075054168701171875 time for calcul the mask position with numpy : 0.021622657775878906 nb_pixel_total : 53432 time to create 1 rle with old method : 0.06882166862487793 time for calcul the mask position with numpy : 0.024453401565551758 nb_pixel_total : 20818 time to create 1 rle with old method : 0.024034738540649414 time for calcul the mask position with numpy : 0.030343055725097656 nb_pixel_total : 7985 time to create 1 rle with old method : 0.009142875671386719 time for calcul the mask position with numpy : 0.02063298225402832 nb_pixel_total : 46740 time to create 1 rle with old method : 0.05307173728942871 time for calcul the mask position with numpy : 0.02177739143371582 nb_pixel_total : 51959 time to create 1 rle with old method : 0.05902719497680664 time for calcul the mask position with numpy : 0.024138212203979492 nb_pixel_total : 67306 time to create 1 rle with old method : 0.07714104652404785 time for calcul the mask position with numpy : 0.024615049362182617 nb_pixel_total : 254508 time to create 1 rle with new method : 0.6897151470184326 time for calcul the mask position with numpy : 0.02263641357421875 nb_pixel_total : 98830 time to create 1 rle with old method : 0.11240839958190918 time for calcul the mask position with numpy : 0.022293567657470703 nb_pixel_total : 143794 time to create 1 rle with old method : 0.17969870567321777 time for calcul the mask position with numpy : 0.09359574317932129 nb_pixel_total : 20805 time to create 1 rle with old method : 0.023160457611083984 time for calcul the mask position with numpy : 0.021887779235839844 nb_pixel_total : 48237 time to create 1 rle with old method : 0.056058406829833984 time for calcul the mask position with numpy : 0.022321462631225586 nb_pixel_total : 14180 time to create 1 rle with old method : 0.016376495361328125 time for calcul the mask position with numpy : 0.02205348014831543 nb_pixel_total : 154419 time to create 1 rle with new method : 0.6463522911071777 time for calcul the mask position with numpy : 0.032759904861450195 nb_pixel_total : 641394 time to create 1 rle with new method : 0.7171816825866699 create new chi : 6.658483266830444 time to delete rle : 0.004449605941772461 batch 1 Loaded 45 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 18535 TO DO : save crop sub photo not yet done ! save time : 1.2112741470336914 map_output_result : {1359519042: (0.0, 'Should be the crop_list due to order', 0), 1359518650: (0.0, 'Should be the crop_list due to order', 0), 1359518619: (0.0, 'Should be the crop_list due to order', 0), 1359518588: (0.0, 'Should be the crop_list due to order', 0), 1359518554: (0.0, 'Should be the crop_list due to order', 0), 1359515154: (0.0, 'Should be the crop_list due to order', 0), 1359515150: (0.0, 'Should be the crop_list due to order', 0), 1359515144: (0.0, 'Should be the crop_list due to order', 0), 1359515137: (0.0, 'Should be the crop_list due to order', 0), 1359515092: (0.0, 'Should be the crop_list due to order', 0), 1359514939: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1359519042, 1359518650, 1359518619, 1359518588, 1359518554, 1359515154, 1359515150, 1359515144, 1359515137, 1359515092, 1359514939] Looping around the photos to save general results len do output : 11 /1359519042.Didn't retrieve data . /1359518650.Didn't retrieve data . /1359518619.Didn't retrieve data . /1359518588.Didn't retrieve data . /1359518554.Didn't retrieve data . /1359515154.Didn't retrieve data . /1359515150.Didn't retrieve data . /1359515144.Didn't retrieve data . /1359515137.Didn't retrieve data . /1359515092.Didn't retrieve data . /1359514939.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359519042', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359518650', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359518619', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359518588', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359518554', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515154', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515150', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515144', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515137', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515092', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359514939', None, None, None, None, None, '2899960') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.015128135681152344 save_final save missing photos in datou_result : time spend for datou_step_exec : 126.72396802902222 time spend to save output : 0.01564645767211914 total time spend for step 3 : 126.73961448669434 step4:ventilate_hashtags_in_portfolio Mon May 19 22:06:17 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 23141034 get user id for portfolio 23141034 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23141034 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','mal_croppe','pet_fonce','flou','metal','autre','pehd','environnement','carton','papier','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23141034 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','mal_croppe','pet_fonce','flou','metal','autre','pehd','environnement','carton','papier','pet_clair')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23141034 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('background','mal_croppe','pet_fonce','flou','metal','autre','pehd','environnement','carton','papier','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/23141400,23141401,23141402,23141403,23141404,23141405,23141406,23141407,23141408,23141409,23141410?tags=background,mal_croppe,pet_fonce,flou,metal,autre,pehd,environnement,carton,papier,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1359519042, 1359518650, 1359518619, 1359518588, 1359518554, 1359515154, 1359515150, 1359515144, 1359515137, 1359515092, 1359514939] Looping around the photos to save general results len do output : 1 /23141034. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359519042', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359518650', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359518619', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359518588', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359518554', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515154', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515150', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515144', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515137', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515092', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359514939', None, None, None, None, None, '2899960') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.016475915908813477 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.7486917972564697 time spend to save output : 0.016820907592773438 total time spend for step 4 : 1.7655127048492432 step5:final Mon May 19 22:06:18 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1359519042: ('0.17062256036673928',), 1359518650: ('0.17062256036673928',), 1359518619: ('0.17062256036673928',), 1359518588: ('0.17062256036673928',), 1359518554: ('0.17062256036673928',), 1359515154: ('0.17062256036673928',), 1359515150: ('0.17062256036673928',), 1359515144: ('0.17062256036673928',), 1359515137: ('0.17062256036673928',), 1359515092: ('0.17062256036673928',), 1359514939: ('0.17062256036673928',)} new output for save of step final : {1359519042: ('0.17062256036673928',), 1359518650: ('0.17062256036673928',), 1359518619: ('0.17062256036673928',), 1359518588: ('0.17062256036673928',), 1359518554: ('0.17062256036673928',), 1359515154: ('0.17062256036673928',), 1359515150: ('0.17062256036673928',), 1359515144: ('0.17062256036673928',), 1359515137: ('0.17062256036673928',), 1359515092: ('0.17062256036673928',), 1359514939: ('0.17062256036673928',)} [1359519042, 1359518650, 1359518619, 1359518588, 1359518554, 1359515154, 1359515150, 1359515144, 1359515137, 1359515092, 1359514939] Looping around the photos to save general results len do output : 11 /1359519042.Didn't retrieve data . /1359518650.Didn't retrieve data . /1359518619.Didn't retrieve data . /1359518588.Didn't retrieve data . /1359518554.Didn't retrieve data . /1359515154.Didn't retrieve data . /1359515150.Didn't retrieve data . /1359515144.Didn't retrieve data . /1359515137.Didn't retrieve data . /1359515092.Didn't retrieve data . /1359514939.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359519042', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359518650', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359518619', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359518588', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359518554', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515154', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515150', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515144', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515137', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515092', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359514939', None, None, None, None, None, '2899960') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 33 time used for this insertion : 0.015509843826293945 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11406183242797852 time spend to save output : 0.01593804359436035 total time spend for step 5 : 0.12999987602233887 step6:blur_detection Mon May 19 22:06:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365.jpg resize: (2160, 3264) 1359519042 -0.8433732515396657 treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa.jpg resize: (2160, 3264) 1359518650 -0.9134270720759226 treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa.jpg resize: (2160, 3264) 1359518619 -2.0323261817631924 treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a.jpg resize: (2160, 3264) 1359518588 -0.2779428816524822 treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635.jpg resize: (2160, 3264) 1359518554 -0.42307627470032344 treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034.jpg resize: (2160, 3264) 1359515154 -4.020127963849737 treat image : temp/1747684827_3677893_1359515150_4f4f35d0a99be16d03bb61ec562cba80.jpg resize: (2160, 3264) 1359515150 -3.324159991013283 treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c.jpg resize: (2160, 3264) 1359515144 -1.4509933663513364 treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273.jpg resize: (2160, 3264) 1359515137 -2.5386843097661504 treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a.jpg resize: (2160, 3264) 1359515092 -2.535468307403359 treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b.jpg resize: (2160, 3264) 1359514939 -1.4416700682689905 treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875390_0.png resize: (139, 98) 1359559642 -0.87191073666048 treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875385_0.png resize: (156, 123) 1359559643 -1.6187233892983672 treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875384_0.png resize: (159, 312) 1359559644 -0.8237148812745564 treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875395_0.png resize: (190, 195) 1359559646 0.16223160228736042 treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875386_0.png resize: (211, 170) 1359559647 -1.692446598491279 treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875396_0.png resize: (787, 1034) 1359559649 -0.7547673026019353 treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875394_0.png resize: (265, 391) 1359559650 1.6551787064215666 treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875393_0.png resize: (804, 406) 1359559652 -0.34154209401517654 treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875389_0.png resize: (369, 402) 1359559653 -1.8276452726185588 treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875398_0.png resize: (202, 176) 1359559654 -0.948653067773983 treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875382_0.png resize: (135, 161) 1359559656 -1.1807790502134305 treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875417_0.png resize: (176, 107) 1359559657 -1.2720898227732391 treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875401_0.png resize: (196, 250) 1359559659 -1.4220047622524068 treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875403_0.png resize: (194, 394) 1359559660 -2.2501660728985446 treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875402_0.png resize: (166, 201) 1359559662 -1.867832745082778 treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875404_0.png resize: (155, 195) 1359559663 -0.7864159145072819 treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875408_0.png resize: (160, 469) 1359559664 -2.695441336948859 treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875413_0.png resize: (156, 104) 1359559667 -0.36619040871169334 treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875410_0.png resize: (112, 124) 1359559668 -0.0015175084358364133 treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875406_0.png resize: (454, 584) 1359559670 -1.059482162464481 treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875411_0.png resize: (266, 204) 1359559671 0.9099369434735214 treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875400_0.png resize: (363, 337) 1359559673 -0.9017290920961045 treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875428_0.png resize: (124, 133) 1359559674 -1.7977359848409282 treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875426_0.png resize: (439, 923) 1359559676 -0.9866697773667886 treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875429_0.png resize: (176, 108) 1359559677 -1.075718645267043 treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875418_0.png resize: (191, 263) 1359559679 -1.4515005969893338 treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875420_0.png resize: (224, 293) 1359559681 -1.3171499205398427 treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875431_0.png resize: (310, 129) 1359559682 -1.2277355250228599 treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875422_0.png resize: (265, 412) 1359559685 0.01365891748759235 treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875436_0.png resize: (72, 265) 1359559686 -2.3727944400663574 treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875434_0.png resize: (162, 199) 1359559689 -1.1237059135538616 treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875437_0.png resize: (144, 126) 1359559690 -0.9594468078301907 treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a_rle_crop_3804875447_0.png resize: (205, 411) 1359559693 -0.37059908166258204 treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a_rle_crop_3804875440_0.png resize: (196, 173) 1359559694 -0.9644589752794647 treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a_rle_crop_3804875442_0.png resize: (282, 315) 1359559698 1.5829361742099988 treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a_rle_crop_3804875445_0.png resize: (173, 148) 1359559699 -1.5429369026464725 treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a_rle_crop_3804875438_0.png resize: (75, 137) 1359559700 -2.5362405245130466 treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a_rle_crop_3804875441_0.png resize: (112, 123) 1359559703 1.0133051214210944 treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a_rle_crop_3804875439_0.png resize: (175, 164) 1359559704 -0.12181450530536762 treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a_rle_crop_3804875444_0.png resize: (97, 290) 1359559707 -2.5222790595175604 treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875451_0.png resize: (606, 300) 1359559708 -0.5153281447038311 treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875452_0.png resize: (213, 208) 1359559709 -1.387173323658741 treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875459_0.png resize: (324, 167) 1359559712 -1.414496243821059 treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875456_0.png resize: (554, 588) 1359559713 -1.4052587088533044 treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875460_0.png resize: (233, 124) 1359559716 -1.6903795077296933 treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875457_0.png resize: (541, 399) 1359559717 -1.2871303371252552 treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875466_0.png resize: (341, 295) 1359559718 0.5197725240567473 treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875467_0.png resize: (186, 334) 1359559721 -1.2541709309298092 treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875463_0.png resize: (229, 323) 1359559722 -1.7354000861629924 treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875462_0.png resize: (251, 270) 1359559725 -1.1759783086655662 treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875454_0.png resize: (194, 164) 1359559726 -1.1048483919925909 treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875480_0.png resize: (365, 495) 1359559729 -2.417298818824439 treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875474_0.png resize: (228, 165) 1359559730 -0.9012814641572362 treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875470_0.png resize: (107, 141) 1359559733 0.6807795870777285 treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875479_0.png resize: (193, 144) 1359559734 0.9902752751661613 treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875478_0.png resize: (132, 173) 1359559735 -1.6957369401983986 treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875473_0.png resize: (256, 283) 1359559738 -1.339500846015061 treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875481_0.png resize: (281, 219) 1359559739 -1.7168654726849044 treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875484_0.png resize: (274, 123) 1359559742 -1.9045649123575763 treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875471_0.png resize: (118, 100) 1359559743 -1.7840141156760747 treat image : temp/1747684827_3677893_1359515150_4f4f35d0a99be16d03bb61ec562cba80_rle_crop_3804875486_0.png resize: (328, 251) 1359559746 -2.1793227429108097 treat image : temp/1747684827_3677893_1359515150_4f4f35d0a99be16d03bb61ec562cba80_rle_crop_3804875492_0.png resize: (254, 435) 1359559747 -1.5542792520991338 treat image : temp/1747684827_3677893_1359515150_4f4f35d0a99be16d03bb61ec562cba80_rle_crop_3804875485_0.png resize: (393, 222) 1359559750 -1.1549860668999368 treat image : temp/1747684827_3677893_1359515150_4f4f35d0a99be16d03bb61ec562cba80_rle_crop_3804875494_0.png resize: (91, 97) 1359559751 0.7560480033665375 treat image : temp/1747684827_3677893_1359515150_4f4f35d0a99be16d03bb61ec562cba80_rle_crop_3804875487_0.png resize: (70, 106) 1359559752 -0.32279325679803805 treat image : temp/1747684827_3677893_1359515150_4f4f35d0a99be16d03bb61ec562cba80_rle_crop_3804875495_0.png resize: (259, 195) 1359559754 -2.758334104553937 treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875504_0.png resize: (152, 143) 1359559756 -1.5704008608698155 treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875508_0.png resize: (59, 151) 1359559757 -0.8740649052030964 treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875496_0.png resize: (236, 208) 1359559758 -1.534336381338978 treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875513_0.png resize: (56, 187) 1359559761 1.0185645037146491 treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875501_0.png resize: (154, 118) 1359559762 -1.3173597597301137 treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875499_0.png resize: (187, 149) 1359559763 -0.8066032597552734 treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875506_0.png resize: (60, 95) 1359559765 0.9392460669921253 treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875497_0.png resize: (149, 175) 1359559767 -0.5149214497067642 treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875516_0.png resize: (85, 89) 1359559768 -0.5849936818963408 treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875510_0.png resize: (514, 497) 1359559769 -1.6597471613005876 treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875527_0.png resize: (251, 428) 1359559772 -1.3267691608744683 treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875524_0.png resize: (709, 395) 1359559773 -1.6355346087504699 treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875530_0.png resize: (124, 80) 1359559774 -0.7257278148825381 treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875518_0.png resize: (233, 149) 1359559776 1.622290056749249 treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875526_0.png resize: (102, 109) 1359559778 -1.4338675252200783 treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875519_0.png resize: (177, 139) 1359559779 -0.391627391579556 treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875529_0.png resize: (302, 291) 1359559780 -1.248726940491535 treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875522_0.png resize: (255, 491) 1359559783 -0.8735732186387839 treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875517_0.png resize: (222, 121) 1359559784 -1.5146606605605035 treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875528_0.png resize: (149, 85) 1359559785 -1.6385081651210096 treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875533_0.png resize: (105, 107) 1359559787 0.5640652436577994 treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875520_0.png resize: (229, 305) 1359559789 -2.861106729775505 treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875525_0.png resize: (94, 91) 1359559791 -2.8478166555519575 treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875537_0.png resize: (526, 386) 1359559792 -1.1608796195336555 treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875559_0.png resize: (288, 121) 1359559795 -2.28704740434791 treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875542_0.png resize: (402, 459) 1359559796 -1.694911525388879 treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875545_0.png resize: (144, 319) 1359559797 -0.605871322687131 treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875540_0.png resize: (202, 293) 1359559800 -2.272237394759119 treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875541_0.png resize: (365, 190) 1359559801 -1.2316010283293772 treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875549_0.png resize: (548, 353) 1359559803 -1.2383277331435696 treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875550_0.png resize: (71, 178) 1359559805 -1.5752305369219046 treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875552_0.png resize: (131, 147) 1359559806 -0.35618774640804673 treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875539_0.png resize: (122, 137) 1359559807 -3.1859556220320564 treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875536_0.png resize: (380, 435) 1359559810 -4.010432657699808 treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875535_0.png resize: (539, 740) 1359559811 -3.0658490418914437 treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875544_0.png resize: (621, 512) 1359559812 -3.222918783729773 treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875538_0.png resize: (95, 204) 1359559813 -1.6809580218163473 treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875547_0.png resize: (206, 426) 1359559816 -2.375435989420474 treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875548_0.png resize: (226, 139) 1359559817 -2.6808200839786185 treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875565_0.png resize: (531, 398) 1359559818 -1.1214494016808132 treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875572_0.png resize: (233, 118) 1359559821 -1.2786750065011752 treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875563_0.png resize: (264, 314) 1359559822 -2.35489757474006 treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875570_0.png resize: (358, 172) 1359559823 -1.0590457034402065 treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875574_0.png resize: (65, 119) 1359559826 0.9616108574872333 treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875581_0.png resize: (127, 146) 1359559827 0.08621947479719996 treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875571_0.png resize: (122, 141) 1359559828 -1.4901139216432253 treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875568_0.png resize: (332, 384) 1359559830 -2.304151046543288 treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875561_0.png resize: (548, 700) 1359559832 -2.1070999992728496 treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875578_0.png resize: (566, 547) 1359559833 -1.4743432720810963 treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875562_0.png resize: (95, 203) 1359559835 -0.7277019604743187 treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875569_0.png resize: (219, 397) 1359559837 -1.1335340496821242 treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875567_0.png resize: (751, 634) 1359559838 -2.0214835334547137 treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875579_0.png resize: (220, 134) 1359559839 -1.7345485582171487 treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875566_0.png resize: (431, 320) 1359559842 -1.3759598934344348 treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875577_0.png resize: (438, 386) 1359559843 -2.7518445785606303 treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875383_0.png resize: (227, 234) 1359560068 -0.245513801695747 treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875391_0.png resize: (196, 376) 1359560069 0.7178832840110274 treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875409_0.png resize: (251, 223) 1359560071 -0.38141328817877657 treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875412_0.png resize: (130, 112) 1359560072 -2.2557354795951117 treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875399_0.png resize: (219, 160) 1359560073 -1.8355296487510953 treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875423_0.png resize: (121, 273) 1359560074 -2.2399179977275017 treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875419_0.png resize: (240, 199) 1359560076 -0.980029339849323 treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875435_0.png resize: (195, 321) 1359560077 -1.4454583487817128 treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875425_0.png resize: (90, 176) 1359560078 -0.18435107139936355 treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a_rle_crop_3804875448_0.png resize: (350, 556) 1359560080 -0.45342009435134456 treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875469_0.png resize: (91, 143) 1359560081 -1.554964397308068 treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875475_0.png resize: (153, 147) 1359560082 -2.29109007846159 treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875477_0.png resize: (147, 412) 1359560083 -1.2271244926398144 treat image : temp/1747684827_3677893_1359515150_4f4f35d0a99be16d03bb61ec562cba80_rle_crop_3804875491_0.png resize: (197, 278) 1359560085 -1.502024439035653 treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875551_0.png resize: (572, 383) 1359560086 -1.221312768064818 treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875554_0.png resize: (224, 400) 1359560087 -0.8089919819563444 treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875534_0.png resize: (919, 887) 1359560089 -1.0714654901822556 treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875555_0.png resize: (278, 339) 1359560090 -2.216964928594433 treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875557_0.png resize: (493, 265) 1359560091 -2.955419896262057 treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875576_0.png resize: (502, 341) 1359560093 -1.0534929710185827 treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875560_0.png resize: (929, 898) 1359560094 -0.0642102698536341 treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875575_0.png resize: (219, 161) 1359560095 -0.9677235942484387 treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875573_0.png resize: (375, 245) 1359560097 -1.2736553569757778 treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875397_0.png resize: (475, 362) 1359560310 -2.066905417017342 treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875392_0.png resize: (597, 668) 1359560311 -2.6763675821454638 treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875388_0.png resize: (411, 1157) 1359560312 -1.8178079287990334 treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875387_0.png resize: (1039, 311) 1359560314 -0.9955598571241644 treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875405_0.png resize: (201, 193) 1359560315 -1.8779002855461984 treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875414_0.png resize: (231, 232) 1359560316 -1.537375859104281 treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875415_0.png resize: (344, 312) 1359560318 -2.311465708544782 treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875416_0.png resize: (373, 256) 1359560319 -0.7405947674928166 treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875407_0.png resize: (174, 481) 1359560320 -1.2952994773140203 treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875421_0.png resize: (192, 405) 1359560321 -2.728879394605471 treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875427_0.png resize: (279, 161) 1359560323 -1.2308727290257435 treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875432_0.png resize: (158, 306) 1359560324 -1.5789378161742005 treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875430_0.png resize: (349, 381) 1359560325 -1.6424773314155479 treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875433_0.png resize: (262, 194) 1359560327 -1.196154580212778 treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a_rle_crop_3804875450_0.png resize: (781, 511) 1359560328 -0.04690800213304651 treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a_rle_crop_3804875449_0.png resize: (349, 258) 1359560329 -0.7789968037992413 treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a_rle_crop_3804875446_0.png resize: (274, 250) 1359560330 -2.240798016085552 treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a_rle_crop_3804875443_0.png resize: (311, 561) 1359560332 -0.9494219113525998 treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875455_0.png resize: (209, 453) 1359560333 -0.5856086736495948 treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875465_0.png resize: (505, 303) 1359560334 -0.8011452777585757 treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875458_0.png resize: (316, 357) 1359560336 -1.9086289280623963 treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875461_0.png resize: (313, 418) 1359560337 -1.3899382830584568 treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875468_0.png resize: (205, 407) 1359560338 -2.0325501477723344 treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875464_0.png resize: (385, 425) 1359560339 -1.3126225092202588 treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875453_0.png resize: (501, 405) 1359560341 -0.981390397026684 treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875472_0.png resize: (269, 260) 1359560342 -1.5438397429133002 treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875476_0.png resize: (191, 182) 1359560343 -2.164971842109985 treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875482_0.png resize: (184, 189) 1359560345 -3.4092702336018603 treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875483_0.png resize: (635, 114) 1359560346 -2.0846512877303627 treat image : temp/1747684827_3677893_1359515150_4f4f35d0a99be16d03bb61ec562cba80_rle_crop_3804875490_0.png resize: (610, 712) 1359560347 -2.6900999073917675 treat image : temp/1747684827_3677893_1359515150_4f4f35d0a99be16d03bb61ec562cba80_rle_crop_3804875489_0.png resize: (434, 328) 1359560348 -2.1664289048641656 treat image : temp/1747684827_3677893_1359515150_4f4f35d0a99be16d03bb61ec562cba80_rle_crop_3804875488_0.png resize: (349, 490) 1359560350 -3.3347718668061335 treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875509_0.png resize: (116, 162) 1359560351 -0.20513376713515782 treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875500_0.png resize: (321, 924) 1359560352 -0.6324187305968957 treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875512_0.png resize: (189, 158) 1359560354 -1.3299498641369603 treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875507_0.png resize: (158, 199) 1359560355 -0.1807208701715747 treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875514_0.png resize: (103, 525) 1359560356 -2.1728505645266494 treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875498_0.png resize: (232, 248) 1359560357 -3.0681994279604825 treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875503_0.png resize: (362, 440) 1359560359 -1.3443956431855713 treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875505_0.png resize: (418, 288) 1359560360 -1.5511670824874615 treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875502_0.png resize: (248, 523) 1359560361 -0.46689033124033047 treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875515_0.png resize: (183, 356) 1359560363 -3.2020207023592775 treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875511_0.png resize: (543, 208) 1359560364 -2.1185902389810836 treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875531_0.png resize: (142, 206) 1359560365 -1.780126466164648 treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875523_0.png resize: (362, 300) 1359560366 -2.247533524752374 treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875521_0.png resize: (271, 455) 1359560368 -2.494262927584022 treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875556_0.png resize: (181, 428) 1359560369 -2.0711322825430076 treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875543_0.png resize: (157, 210) 1359560370 -2.9234453566696907 treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875546_0.png resize: (378, 389) 1359560372 -0.6983265971697393 treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875558_0.png resize: (321, 272) 1359560373 -3.791181597665284 treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875553_0.png resize: (494, 386) 1359560374 -2.46783829537115 treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875564_0.png resize: (134, 193) 1359560375 -2.021099852498941 treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875580_0.png resize: (323, 283) 1359560377 -2.617211157392987 treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875424_0.png resize: (163, 199) 1359560394 -1.3867334578049384 treat image : temp/1747684827_3677893_1359515150_4f4f35d0a99be16d03bb61ec562cba80_rle_crop_3804875493_0.png resize: (229, 267) 1359560395 -0.6383286834590098 treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875532_0.png resize: (214, 439) 1359560409 -1.881723048416659 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 211 time used for this insertion : 0.02295088768005371 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 211 time used for this insertion : 0.06004595756530762 save missing photos in datou_result : time spend for datou_step_exec : 43.48788237571716 time spend to save output : 0.08890008926391602 total time spend for step 6 : 43.57678246498108 step7:brightness Mon May 19 22:07:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365.jpg treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa.jpg treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa.jpg treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a.jpg treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635.jpg treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034.jpg treat image : temp/1747684827_3677893_1359515150_4f4f35d0a99be16d03bb61ec562cba80.jpg treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c.jpg treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273.jpg treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a.jpg treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b.jpg treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875390_0.png treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875385_0.png treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875384_0.png treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875395_0.png treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875386_0.png treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875396_0.png treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875394_0.png treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875393_0.png treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875389_0.png treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875398_0.png treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875382_0.png treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875417_0.png treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875401_0.png treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875403_0.png treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875402_0.png treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875404_0.png treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875408_0.png treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875413_0.png treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875410_0.png treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875406_0.png treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875411_0.png treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875400_0.png treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875428_0.png treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875426_0.png treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875429_0.png treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875418_0.png treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875420_0.png treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875431_0.png treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875422_0.png treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875436_0.png treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875434_0.png treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875437_0.png treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a_rle_crop_3804875447_0.png treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a_rle_crop_3804875440_0.png treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a_rle_crop_3804875442_0.png treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a_rle_crop_3804875445_0.png treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a_rle_crop_3804875438_0.png treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a_rle_crop_3804875441_0.png treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a_rle_crop_3804875439_0.png treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a_rle_crop_3804875444_0.png treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875451_0.png treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875452_0.png treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875459_0.png treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875456_0.png treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875460_0.png treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875457_0.png treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875466_0.png treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875467_0.png treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875463_0.png treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875462_0.png treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875454_0.png treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875480_0.png treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875474_0.png treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875470_0.png treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875479_0.png treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875478_0.png treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875473_0.png treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875481_0.png treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875484_0.png treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875471_0.png treat image : temp/1747684827_3677893_1359515150_4f4f35d0a99be16d03bb61ec562cba80_rle_crop_3804875486_0.png treat image : temp/1747684827_3677893_1359515150_4f4f35d0a99be16d03bb61ec562cba80_rle_crop_3804875492_0.png treat image : temp/1747684827_3677893_1359515150_4f4f35d0a99be16d03bb61ec562cba80_rle_crop_3804875485_0.png treat image : temp/1747684827_3677893_1359515150_4f4f35d0a99be16d03bb61ec562cba80_rle_crop_3804875494_0.png treat image : temp/1747684827_3677893_1359515150_4f4f35d0a99be16d03bb61ec562cba80_rle_crop_3804875487_0.png treat image : temp/1747684827_3677893_1359515150_4f4f35d0a99be16d03bb61ec562cba80_rle_crop_3804875495_0.png treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875504_0.png treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875508_0.png treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875496_0.png treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875513_0.png treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875501_0.png treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875499_0.png treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875506_0.png treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875497_0.png treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875516_0.png treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875510_0.png treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875527_0.png treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875524_0.png treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875530_0.png treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875518_0.png treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875526_0.png treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875519_0.png treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875529_0.png treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875522_0.png treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875517_0.png treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875528_0.png treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875533_0.png treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875520_0.png treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875525_0.png treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875537_0.png treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875559_0.png treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875542_0.png treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875545_0.png treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875540_0.png treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875541_0.png treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875549_0.png treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875550_0.png treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875552_0.png treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875539_0.png treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875536_0.png treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875535_0.png treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875544_0.png treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875538_0.png treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875547_0.png treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875548_0.png treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875565_0.png treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875572_0.png treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875563_0.png treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875570_0.png treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875574_0.png treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875581_0.png treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875571_0.png treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875568_0.png treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875561_0.png treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875578_0.png treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875562_0.png treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875569_0.png treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875567_0.png treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875579_0.png treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875566_0.png treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875577_0.png treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875383_0.png treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875391_0.png treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875409_0.png treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875412_0.png treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875399_0.png treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875423_0.png treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875419_0.png treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875435_0.png treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875425_0.png treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a_rle_crop_3804875448_0.png treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875469_0.png treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875475_0.png treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875477_0.png treat image : temp/1747684827_3677893_1359515150_4f4f35d0a99be16d03bb61ec562cba80_rle_crop_3804875491_0.png treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875551_0.png treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875554_0.png treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875534_0.png treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875555_0.png treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875557_0.png treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875576_0.png treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875560_0.png treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875575_0.png treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875573_0.png treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875397_0.png treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875392_0.png treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875388_0.png treat image : temp/1747684827_3677893_1359519042_65ceb41afe1347dd307f2c491f3df365_rle_crop_3804875387_0.png treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875405_0.png treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875414_0.png treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875415_0.png treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875416_0.png treat image : temp/1747684827_3677893_1359518650_f7ffd250b3853e8aca38be249bff94aa_rle_crop_3804875407_0.png treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875421_0.png treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875427_0.png treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875432_0.png treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875430_0.png treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875433_0.png treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a_rle_crop_3804875450_0.png treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a_rle_crop_3804875449_0.png treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a_rle_crop_3804875446_0.png treat image : temp/1747684827_3677893_1359518588_fbd581db244a865512c2e064fe1e313a_rle_crop_3804875443_0.png treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875455_0.png treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875465_0.png treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875458_0.png treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875461_0.png treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875468_0.png treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875464_0.png treat image : temp/1747684827_3677893_1359518554_76455bf27a0c58df1196a8ca6e4bf635_rle_crop_3804875453_0.png treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875472_0.png treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875476_0.png treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875482_0.png treat image : temp/1747684827_3677893_1359515154_a9760a5caced728b7dcdaf6387494034_rle_crop_3804875483_0.png treat image : temp/1747684827_3677893_1359515150_4f4f35d0a99be16d03bb61ec562cba80_rle_crop_3804875490_0.png treat image : temp/1747684827_3677893_1359515150_4f4f35d0a99be16d03bb61ec562cba80_rle_crop_3804875489_0.png treat image : temp/1747684827_3677893_1359515150_4f4f35d0a99be16d03bb61ec562cba80_rle_crop_3804875488_0.png treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875509_0.png treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875500_0.png treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875512_0.png treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875507_0.png treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875514_0.png treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875498_0.png treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875503_0.png treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875505_0.png treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875502_0.png treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875515_0.png treat image : temp/1747684827_3677893_1359515144_5f971ae84509a516bd5acb7fb495978c_rle_crop_3804875511_0.png treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875531_0.png treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875523_0.png treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875521_0.png treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875556_0.png treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875543_0.png treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875546_0.png treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875558_0.png treat image : temp/1747684827_3677893_1359515092_c52a49244057e30cf2b6a9f238f14d6a_rle_crop_3804875553_0.png treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875564_0.png treat image : temp/1747684827_3677893_1359514939_b3175ee49ed52c09303e6ce6b5f0424b_rle_crop_3804875580_0.png treat image : temp/1747684827_3677893_1359518619_9994b8c6f211b7ae6598f37bb65420fa_rle_crop_3804875424_0.png treat image : temp/1747684827_3677893_1359515150_4f4f35d0a99be16d03bb61ec562cba80_rle_crop_3804875493_0.png treat image : temp/1747684827_3677893_1359515137_64116b7ac5dc81ee1431e72317796273_rle_crop_3804875532_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 211 time used for this insertion : 0.021217823028564453 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 211 time used for this insertion : 0.06789016723632812 save missing photos in datou_result : time spend for datou_step_exec : 10.712480783462524 time spend to save output : 0.09502100944519043 total time spend for step 7 : 10.807501792907715 step8:velours_tree Mon May 19 22:07:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.15543818473815918 time spend to save output : 3.62396240234375e-05 total time spend for step 8 : 0.15547442436218262 step9:send_mail_cod Mon May 19 22:07:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P23141034_19-05-2025_22_07_13.pdf 23141400 imagette231414001747685233 23141401 imagette231414011747685233 23141402 change filename to text .imagette231414021747685233 23141403 imagette231414031747685233 23141404 imagette231414041747685233 23141405 change filename to text .change filename to text .imagette231414051747685233 23141406 imagette231414061747685233 23141408 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231414081747685233 23141409 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231414091747685235 23141410 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette231414101747685236 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=23141034 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/23141400,23141401,23141402,23141403,23141404,23141405,23141406,23141407,23141408,23141409,23141410?tags=background,mal_croppe,pet_fonce,flou,metal,autre,pehd,environnement,carton,papier,pet_clair args[1359519042] : ((1359519042, -0.8433732515396657, 492688767), (1359519042, 0.441211747056512, 2107752395), '0.17062256036673928') We are sending mail with results at report@fotonower.com args[1359518650] : ((1359518650, -0.9134270720759226, 492688767), (1359518650, 0.06197232952931102, 2107752395), '0.17062256036673928') We are sending mail with results at report@fotonower.com args[1359518619] : ((1359518619, -2.0323261817631924, 492609224), (1359518619, 0.1160752089411248, 2107752395), '0.17062256036673928') We are sending mail with results at report@fotonower.com args[1359518588] : ((1359518588, -0.2779428816524822, 492688767), (1359518588, 0.9036526809044648, 2107752395), '0.17062256036673928') We are sending mail with results at report@fotonower.com args[1359518554] : ((1359518554, -0.42307627470032344, 492688767), (1359518554, 0.14913237622795067, 2107752395), '0.17062256036673928') We are sending mail with results at report@fotonower.com args[1359515154] : ((1359515154, -4.020127963849737, 492609224), (1359515154, 0.3091353047829308, 2107752395), '0.17062256036673928') We are sending mail with results at report@fotonower.com args[1359515150] : ((1359515150, -3.324159991013283, 492609224), (1359515150, 0.03950585325996181, 2107752395), '0.17062256036673928') We are sending mail with results at report@fotonower.com args[1359515144] : ((1359515144, -1.4509933663513364, 492688767), (1359515144, 0.11304461393063295, 2107752395), '0.17062256036673928') We are sending mail with results at report@fotonower.com args[1359515137] : ((1359515137, -2.5386843097661504, 492609224), (1359515137, 0.1531087112178783, 2107752395), '0.17062256036673928') We are sending mail with results at report@fotonower.com args[1359515092] : ((1359515092, -2.535468307403359, 492609224), (1359515092, -0.3836228981453826, 496442774), '0.17062256036673928') We are sending mail with results at report@fotonower.com args[1359514939] : ((1359514939, -1.4416700682689905, 492688767), (1359514939, -0.07875153575690981, 496442774), '0.17062256036673928') We are sending mail with results at report@fotonower.com refus_total : 0.17062256036673928 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=23141034 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23141034_19-05-2025_22_07_13.pdf results_Auto_P23141034_19-05-2025_22_07_13.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23141034_19-05-2025_22_07_13.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','23141034','results_Auto_P23141034_19-05-2025_22_07_13.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23141034_19-05-2025_22_07_13.pdf','pdf','','0.85','0.17062256036673928') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/23141034

https://www.fotonower.com/image?json=false&list_photos_id=1359519042
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359518650
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359518619
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359518588
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359518554
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359515154
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359515150
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359515144
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359515137
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359515092
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1359514939
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 17.06%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pet_fonce: https://www.fotonower.com/view/23141402?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/23141405?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/23141408?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/23141409?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/23141410?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23141034_19-05-2025_22_07_13.pdf.

Lien vers velours :https://www.fotonower.com/velours/23141400,23141401,23141402,23141403,23141404,23141405,23141406,23141407,23141408,23141409,23141410?tags=background,mal_croppe,pet_fonce,flou,metal,autre,pehd,environnement,carton,papier,pet_clair.


L'équipe Fotonower 202 b'' Server: nginx Date: Mon, 19 May 2025 20:07:20 GMT Content-Length: 0 Connection: close X-Message-Id: g2QbhDhYT1iNzs99XQazWg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1359519042, 1359518650, 1359518619, 1359518588, 1359518554, 1359515154, 1359515150, 1359515144, 1359515137, 1359515092, 1359514939] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359519042', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359518650', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359518619', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359518588', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359518554', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515154', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515150', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515144', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515137', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515092', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359514939', None, None, None, None, None, '2899960') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.017354488372802734 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.282212018966675 time spend to save output : 0.017681360244750977 total time spend for step 9 : 7.299893379211426 step10:split_time_score Mon May 19 22:07:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('20', 11),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 19052025 23141034 Nombre de photos uploadées : 11 / 23040 (0%) 19052025 23141034 Nombre de photos taguées (types de déchets): 0 / 11 (0%) 19052025 23141034 Nombre de photos taguées (volume) : 0 / 11 (0%) elapsed_time : load_data_split_time_score 2.384185791015625e-06 elapsed_time : order_list_meta_photo_and_scores 1.2159347534179688e-05 ??????????? elapsed_time : fill_and_build_computed_from_old_data 0.0005767345428466797 elapsed_time : insert_dashboard_record_day_entry 0.028290271759033203 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.14282205050229974 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23110032_19-05-2025_11_58_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23110032 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23110032 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23104389 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23104390 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23110081 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23140955 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23140956 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23140964 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23140984 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23140986 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23141006 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23141018 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23141021 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23141024 order by id desc limit 1 Qualite : 0.17062256036673928 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P23141034_19-05-2025_22_07_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 23141034 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=23141034 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'19052025': {'nb_upload': 11, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1359519042, 1359518650, 1359518619, 1359518588, 1359518554, 1359515154, 1359515150, 1359515144, 1359515137, 1359515092, 1359514939] Looping around the photos to save general results len do output : 1 /23141034Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359519042', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359518650', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359518619', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359518588', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359518554', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515154', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515150', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515144', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515137', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359515092', None, None, None, None, None, '2899960') ('3318', None, None, None, None, None, None, None, '2899960') ('3318', '23141034', '1359514939', None, None, None, None, None, '2899960') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.016495466232299805 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.807917833328247 time spend to save output : 0.01674199104309082 total time spend for step 10 : 10.824659824371338 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 11 set_done_treatment 194.40user 156.96system 7:07.08elapsed 82%CPU (0avgtext+0avgdata 5625052maxresident)k 960512inputs+129240outputs (9211major+16414197minor)pagefaults 0swaps