python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2518645 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2584405'] with mtr_portfolio_ids : ['20528940'] and first list_photo_ids : [] new path : /proc/2518645/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 10 ; length of list_pids : 10 ; length of list_args : 10 time to download the photos : 1.9269382953643799 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Feb 14 01:40:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10553 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-14 01:40:36.242832: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-14 01:40:36.271174: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-14 01:40:36.273760: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fcfe8000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-14 01:40:36.273834: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-14 01:40:36.278797: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-14 01:40:36.541999: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x17078530 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-14 01:40:36.542067: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-14 01:40:36.543560: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-14 01:40:36.545623: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-14 01:40:36.551912: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-14 01:40:36.561293: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-14 01:40:36.562775: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-14 01:40:36.580035: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-14 01:40:36.583007: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-14 01:40:36.607728: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-14 01:40:36.609610: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-14 01:40:36.609723: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-14 01:40:36.610689: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-14 01:40:36.610711: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-14 01:40:36.610723: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-14 01:40:36.612774: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9777 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-14 01:40:36.957959: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-14 01:40:36.958133: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-14 01:40:36.958160: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-14 01:40:36.958184: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-14 01:40:36.958205: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-14 01:40:36.958227: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-14 01:40:36.958248: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-14 01:40:36.958269: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-14 01:40:36.960221: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-14 01:40:36.962105: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-14 01:40:36.962257: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-14 01:40:36.962283: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-14 01:40:36.962304: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-14 01:40:36.962326: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-14 01:40:36.962346: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-14 01:40:36.962367: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-14 01:40:36.962388: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-14 01:40:36.964325: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-14 01:40:36.964407: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-14 01:40:36.964421: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-14 01:40:36.964433: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-14 01:40:36.966466: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9777 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-14 01:40:50.510223: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-14 01:40:50.686882: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 10 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 39 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 51 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 34 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 31 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 44 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 32 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 35 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 44 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 100 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 48 Detection mask done ! Trying to reset tf kernel 2519443 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5264 tf kernel not reseted sub process len(results) : 10 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 10 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10553 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.001957416534423828 nb_pixel_total : 47801 time to create 1 rle with old method : 0.057233572006225586 length of segment : 232 time for calcul the mask position with numpy : 0.001596689224243164 nb_pixel_total : 54421 time to create 1 rle with old method : 0.06428408622741699 length of segment : 466 time for calcul the mask position with numpy : 0.36806654930114746 nb_pixel_total : 452514 time to create 1 rle with new method : 0.04422616958618164 length of segment : 850 time for calcul the mask position with numpy : 0.00028204917907714844 nb_pixel_total : 11191 time to create 1 rle with old method : 0.012459754943847656 length of segment : 156 time for calcul the mask position with numpy : 0.0003173351287841797 nb_pixel_total : 15633 time to create 1 rle with old method : 0.017927885055541992 length of segment : 135 time for calcul the mask position with numpy : 0.00018334388732910156 nb_pixel_total : 4028 time to create 1 rle with old method : 0.0048940181732177734 length of segment : 76 time for calcul the mask position with numpy : 0.00018787384033203125 nb_pixel_total : 5344 time to create 1 rle with old method : 0.00616145133972168 length of segment : 111 time for calcul the mask position with numpy : 0.0002627372741699219 nb_pixel_total : 11905 time to create 1 rle with old method : 0.013984441757202148 length of segment : 66 time for calcul the mask position with numpy : 0.0006923675537109375 nb_pixel_total : 33446 time to create 1 rle with old method : 0.03735470771789551 length of segment : 193 time for calcul the mask position with numpy : 0.00046372413635253906 nb_pixel_total : 18567 time to create 1 rle with old method : 0.020436763763427734 length of segment : 236 time for calcul the mask position with numpy : 0.00022935867309570312 nb_pixel_total : 8382 time to create 1 rle with old method : 0.009737491607666016 length of segment : 150 time for calcul the mask position with numpy : 0.0015282630920410156 nb_pixel_total : 60457 time to create 1 rle with old method : 0.06674718856811523 length of segment : 501 time for calcul the mask position with numpy : 0.0011229515075683594 nb_pixel_total : 34794 time to create 1 rle with old method : 0.03847670555114746 length of segment : 351 time for calcul the mask position with numpy : 0.0008335113525390625 nb_pixel_total : 39687 time to create 1 rle with old method : 0.04364180564880371 length of segment : 283 time for calcul the mask position with numpy : 0.00027751922607421875 nb_pixel_total : 8104 time to create 1 rle with old method : 0.009589910507202148 length of segment : 103 time for calcul the mask position with numpy : 0.0016202926635742188 nb_pixel_total : 62025 time to create 1 rle with old method : 0.06835222244262695 length of segment : 486 time for calcul the mask position with numpy : 0.00012302398681640625 nb_pixel_total : 2753 time to create 1 rle with old method : 0.003331422805786133 length of segment : 39 time for calcul the mask position with numpy : 0.0004036426544189453 nb_pixel_total : 10759 time to create 1 rle with old method : 0.013817310333251953 length of segment : 108 time for calcul the mask position with numpy : 0.00023984909057617188 nb_pixel_total : 9061 time to create 1 rle with old method : 0.010482549667358398 length of segment : 165 time for calcul the mask position with numpy : 0.0004677772521972656 nb_pixel_total : 17134 time to create 1 rle with old method : 0.022670984268188477 length of segment : 201 time for calcul the mask position with numpy : 0.0005548000335693359 nb_pixel_total : 13678 time to create 1 rle with old method : 0.016176939010620117 length of segment : 190 time for calcul the mask position with numpy : 0.0012009143829345703 nb_pixel_total : 31910 time to create 1 rle with old method : 0.03544354438781738 length of segment : 367 time for calcul the mask position with numpy : 0.00324249267578125 nb_pixel_total : 96525 time to create 1 rle with old method : 0.1118316650390625 length of segment : 695 time for calcul the mask position with numpy : 0.0014615058898925781 nb_pixel_total : 62853 time to create 1 rle with old method : 0.06934881210327148 length of segment : 477 time for calcul the mask position with numpy : 0.004563808441162109 nb_pixel_total : 211762 time to create 1 rle with new method : 0.015523195266723633 length of segment : 557 time for calcul the mask position with numpy : 0.0006208419799804688 nb_pixel_total : 28838 time to create 1 rle with old method : 0.032744407653808594 length of segment : 278 time for calcul the mask position with numpy : 0.0002830028533935547 nb_pixel_total : 5731 time to create 1 rle with old method : 0.009321451187133789 length of segment : 86 time for calcul the mask position with numpy : 0.0049457550048828125 nb_pixel_total : 148859 time to create 1 rle with old method : 0.16682744026184082 length of segment : 555 time for calcul the mask position with numpy : 0.00040841102600097656 nb_pixel_total : 12644 time to create 1 rle with old method : 0.013782501220703125 length of segment : 137 time for calcul the mask position with numpy : 0.0005686283111572266 nb_pixel_total : 13424 time to create 1 rle with old method : 0.015042304992675781 length of segment : 124 time for calcul the mask position with numpy : 0.0011603832244873047 nb_pixel_total : 50112 time to create 1 rle with old method : 0.05477094650268555 length of segment : 298 time for calcul the mask position with numpy : 0.0006153583526611328 nb_pixel_total : 13958 time to create 1 rle with old method : 0.015732526779174805 length of segment : 124 time for calcul the mask position with numpy : 0.006026506423950195 nb_pixel_total : 230991 time to create 1 rle with new method : 0.012995719909667969 length of segment : 800 time for calcul the mask position with numpy : 0.0011126995086669922 nb_pixel_total : 27564 time to create 1 rle with old method : 0.030295372009277344 length of segment : 199 time for calcul the mask position with numpy : 0.00024437904357910156 nb_pixel_total : 9863 time to create 1 rle with old method : 0.011122703552246094 length of segment : 163 time for calcul the mask position with numpy : 0.000835418701171875 nb_pixel_total : 33196 time to create 1 rle with old method : 0.036333560943603516 length of segment : 302 time for calcul the mask position with numpy : 0.00042319297790527344 nb_pixel_total : 10595 time to create 1 rle with old method : 0.012053728103637695 length of segment : 165 time for calcul the mask position with numpy : 0.0021097660064697266 nb_pixel_total : 47023 time to create 1 rle with old method : 0.05137753486633301 length of segment : 306 time for calcul the mask position with numpy : 0.0006906986236572266 nb_pixel_total : 16978 time to create 1 rle with old method : 0.01934218406677246 length of segment : 129 time for calcul the mask position with numpy : 0.0020987987518310547 nb_pixel_total : 74923 time to create 1 rle with old method : 0.08092737197875977 length of segment : 287 time for calcul the mask position with numpy : 0.0022225379943847656 nb_pixel_total : 51661 time to create 1 rle with old method : 0.05863595008850098 length of segment : 266 time for calcul the mask position with numpy : 0.003679513931274414 nb_pixel_total : 148790 time to create 1 rle with old method : 0.19172024726867676 length of segment : 432 time for calcul the mask position with numpy : 0.0024225711822509766 nb_pixel_total : 50683 time to create 1 rle with old method : 0.05688977241516113 length of segment : 369 time for calcul the mask position with numpy : 0.0020058155059814453 nb_pixel_total : 62424 time to create 1 rle with old method : 0.06906390190124512 length of segment : 356 time for calcul the mask position with numpy : 0.006209850311279297 nb_pixel_total : 243139 time to create 1 rle with new method : 0.016884326934814453 length of segment : 719 time for calcul the mask position with numpy : 0.0031757354736328125 nb_pixel_total : 93640 time to create 1 rle with old method : 0.10746169090270996 length of segment : 623 time for calcul the mask position with numpy : 0.009152889251708984 nb_pixel_total : 319836 time to create 1 rle with new method : 0.017885208129882812 length of segment : 639 time for calcul the mask position with numpy : 0.0020036697387695312 nb_pixel_total : 71675 time to create 1 rle with old method : 0.08160781860351562 length of segment : 330 time for calcul the mask position with numpy : 0.0009057521820068359 nb_pixel_total : 21121 time to create 1 rle with old method : 0.024616003036499023 length of segment : 238 time for calcul the mask position with numpy : 0.002955198287963867 nb_pixel_total : 72900 time to create 1 rle with old method : 0.08053445816040039 length of segment : 499 time for calcul the mask position with numpy : 0.0032205581665039062 nb_pixel_total : 114620 time to create 1 rle with old method : 0.1328575611114502 length of segment : 549 time for calcul the mask position with numpy : 0.0007178783416748047 nb_pixel_total : 15870 time to create 1 rle with old method : 0.03194689750671387 length of segment : 162 time for calcul the mask position with numpy : 0.0015652179718017578 nb_pixel_total : 52633 time to create 1 rle with old method : 0.061872005462646484 length of segment : 223 time for calcul the mask position with numpy : 0.0003273487091064453 nb_pixel_total : 7391 time to create 1 rle with old method : 0.008396387100219727 length of segment : 81 time for calcul the mask position with numpy : 0.0003521442413330078 nb_pixel_total : 13139 time to create 1 rle with old method : 0.015076637268066406 length of segment : 173 time for calcul the mask position with numpy : 0.0005962848663330078 nb_pixel_total : 21981 time to create 1 rle with old method : 0.02523493766784668 length of segment : 147 time for calcul the mask position with numpy : 0.0011112689971923828 nb_pixel_total : 55628 time to create 1 rle with old method : 0.06060504913330078 length of segment : 338 time for calcul the mask position with numpy : 0.0014090538024902344 nb_pixel_total : 69756 time to create 1 rle with old method : 0.07647466659545898 length of segment : 457 time for calcul the mask position with numpy : 0.0008385181427001953 nb_pixel_total : 26668 time to create 1 rle with old method : 0.031109333038330078 length of segment : 504 time for calcul the mask position with numpy : 0.0001800060272216797 nb_pixel_total : 4348 time to create 1 rle with old method : 0.005112886428833008 length of segment : 83 time for calcul the mask position with numpy : 0.0003535747528076172 nb_pixel_total : 15483 time to create 1 rle with old method : 0.01831364631652832 length of segment : 99 time for calcul the mask position with numpy : 0.0003361701965332031 nb_pixel_total : 14056 time to create 1 rle with old method : 0.015591621398925781 length of segment : 203 time for calcul the mask position with numpy : 0.00017213821411132812 nb_pixel_total : 5390 time to create 1 rle with old method : 0.0063321590423583984 length of segment : 91 time for calcul the mask position with numpy : 0.001646280288696289 nb_pixel_total : 94952 time to create 1 rle with old method : 0.10359835624694824 length of segment : 654 time for calcul the mask position with numpy : 0.00030541419982910156 nb_pixel_total : 7379 time to create 1 rle with old method : 0.008298635482788086 length of segment : 158 time for calcul the mask position with numpy : 0.004930019378662109 nb_pixel_total : 339924 time to create 1 rle with new method : 0.01728510856628418 length of segment : 637 time for calcul the mask position with numpy : 0.00090789794921875 nb_pixel_total : 59546 time to create 1 rle with old method : 0.06564736366271973 length of segment : 360 time for calcul the mask position with numpy : 0.0009620189666748047 nb_pixel_total : 54329 time to create 1 rle with old method : 0.058801889419555664 length of segment : 278 time for calcul the mask position with numpy : 0.002953767776489258 nb_pixel_total : 173635 time to create 1 rle with new method : 0.013029813766479492 length of segment : 678 time for calcul the mask position with numpy : 0.0009489059448242188 nb_pixel_total : 31777 time to create 1 rle with old method : 0.03687143325805664 length of segment : 228 time for calcul the mask position with numpy : 0.0003540515899658203 nb_pixel_total : 20683 time to create 1 rle with old method : 0.023122072219848633 length of segment : 111 time for calcul the mask position with numpy : 0.0022916793823242188 nb_pixel_total : 115189 time to create 1 rle with old method : 0.13331937789916992 length of segment : 365 time for calcul the mask position with numpy : 0.003058195114135742 nb_pixel_total : 122092 time to create 1 rle with old method : 0.1357262134552002 length of segment : 586 time for calcul the mask position with numpy : 0.0014557838439941406 nb_pixel_total : 55843 time to create 1 rle with old method : 0.06298971176147461 length of segment : 316 time for calcul the mask position with numpy : 0.004850625991821289 nb_pixel_total : 137566 time to create 1 rle with old method : 0.18814396858215332 length of segment : 472 time for calcul the mask position with numpy : 0.003026247024536133 nb_pixel_total : 119747 time to create 1 rle with old method : 0.14978981018066406 length of segment : 444 time for calcul the mask position with numpy : 0.0006434917449951172 nb_pixel_total : 21385 time to create 1 rle with old method : 0.02534937858581543 length of segment : 169 time for calcul the mask position with numpy : 0.0003185272216796875 nb_pixel_total : 13607 time to create 1 rle with old method : 0.015330314636230469 length of segment : 158 time for calcul the mask position with numpy : 0.0012459754943847656 nb_pixel_total : 60825 time to create 1 rle with old method : 0.07072067260742188 length of segment : 291 time for calcul the mask position with numpy : 0.0007326602935791016 nb_pixel_total : 23982 time to create 1 rle with old method : 0.02687382698059082 length of segment : 220 time for calcul the mask position with numpy : 0.0005180835723876953 nb_pixel_total : 15661 time to create 1 rle with old method : 0.018110036849975586 length of segment : 179 time for calcul the mask position with numpy : 0.002054452896118164 nb_pixel_total : 83015 time to create 1 rle with old method : 0.09194111824035645 length of segment : 458 time for calcul the mask position with numpy : 0.0032129287719726562 nb_pixel_total : 141822 time to create 1 rle with old method : 0.15595006942749023 length of segment : 432 time for calcul the mask position with numpy : 0.0035142898559570312 nb_pixel_total : 150746 time to create 1 rle with new method : 0.009315967559814453 length of segment : 525 time for calcul the mask position with numpy : 0.002713441848754883 nb_pixel_total : 122029 time to create 1 rle with old method : 0.1610240936279297 length of segment : 419 time for calcul the mask position with numpy : 0.003936767578125 nb_pixel_total : 107684 time to create 1 rle with old method : 0.24018239974975586 length of segment : 378 time for calcul the mask position with numpy : 0.002009153366088867 nb_pixel_total : 91332 time to create 1 rle with old method : 0.10962700843811035 length of segment : 242 time for calcul the mask position with numpy : 0.0014083385467529297 nb_pixel_total : 44360 time to create 1 rle with old method : 0.0527348518371582 length of segment : 325 time for calcul the mask position with numpy : 0.012296915054321289 nb_pixel_total : 502064 time to create 1 rle with new method : 0.5796253681182861 length of segment : 962 time for calcul the mask position with numpy : 0.001644134521484375 nb_pixel_total : 80356 time to create 1 rle with old method : 0.09038519859313965 length of segment : 277 time for calcul the mask position with numpy : 0.0005240440368652344 nb_pixel_total : 18559 time to create 1 rle with old method : 0.024560213088989258 length of segment : 146 time for calcul the mask position with numpy : 0.00048828125 nb_pixel_total : 9386 time to create 1 rle with old method : 0.010991096496582031 length of segment : 161 time for calcul the mask position with numpy : 0.0009899139404296875 nb_pixel_total : 42155 time to create 1 rle with old method : 0.0473637580871582 length of segment : 273 time for calcul the mask position with numpy : 0.0024442672729492188 nb_pixel_total : 101718 time to create 1 rle with old method : 0.1181948184967041 length of segment : 576 time for calcul the mask position with numpy : 0.0023550987243652344 nb_pixel_total : 94293 time to create 1 rle with old method : 0.10451388359069824 length of segment : 390 time for calcul the mask position with numpy : 0.00026988983154296875 nb_pixel_total : 7903 time to create 1 rle with old method : 0.012523889541625977 length of segment : 123 time for calcul the mask position with numpy : 0.0007495880126953125 nb_pixel_total : 27728 time to create 1 rle with old method : 0.03071880340576172 length of segment : 331 time for calcul the mask position with numpy : 0.010748863220214844 nb_pixel_total : 438458 time to create 1 rle with new method : 0.0530848503112793 length of segment : 921 time for calcul the mask position with numpy : 0.0008826255798339844 nb_pixel_total : 39177 time to create 1 rle with old method : 0.043251991271972656 length of segment : 323 time for calcul the mask position with numpy : 0.00043892860412597656 nb_pixel_total : 18727 time to create 1 rle with old method : 0.02227640151977539 length of segment : 149 time for calcul the mask position with numpy : 0.0007557868957519531 nb_pixel_total : 29300 time to create 1 rle with old method : 0.03674459457397461 length of segment : 289 time for calcul the mask position with numpy : 0.0006201267242431641 nb_pixel_total : 14823 time to create 1 rle with old method : 0.017921924591064453 length of segment : 215 time for calcul the mask position with numpy : 0.0016541481018066406 nb_pixel_total : 56558 time to create 1 rle with old method : 0.06856298446655273 length of segment : 347 time for calcul the mask position with numpy : 0.004815578460693359 nb_pixel_total : 257505 time to create 1 rle with new method : 0.01330113410949707 length of segment : 765 time for calcul the mask position with numpy : 0.0030646324157714844 nb_pixel_total : 143494 time to create 1 rle with old method : 0.16714262962341309 length of segment : 725 time for calcul the mask position with numpy : 0.0025644302368164062 nb_pixel_total : 113840 time to create 1 rle with old method : 0.1256568431854248 length of segment : 591 time for calcul the mask position with numpy : 0.005594491958618164 nb_pixel_total : 156976 time to create 1 rle with new method : 0.012502908706665039 length of segment : 452 time for calcul the mask position with numpy : 0.0024378299713134766 nb_pixel_total : 52188 time to create 1 rle with old method : 0.05913186073303223 length of segment : 387 time for calcul the mask position with numpy : 0.0014328956604003906 nb_pixel_total : 43310 time to create 1 rle with old method : 0.04850316047668457 length of segment : 151 time for calcul the mask position with numpy : 0.00069427490234375 nb_pixel_total : 23485 time to create 1 rle with old method : 0.02679610252380371 length of segment : 165 time for calcul the mask position with numpy : 0.00026535987854003906 nb_pixel_total : 14194 time to create 1 rle with old method : 0.016466617584228516 length of segment : 131 time for calcul the mask position with numpy : 0.0009524822235107422 nb_pixel_total : 22790 time to create 1 rle with old method : 0.02567768096923828 length of segment : 168 time for calcul the mask position with numpy : 0.0005950927734375 nb_pixel_total : 34980 time to create 1 rle with old method : 0.0392458438873291 length of segment : 228 time for calcul the mask position with numpy : 0.0009827613830566406 nb_pixel_total : 19903 time to create 1 rle with old method : 0.02686452865600586 length of segment : 231 time for calcul the mask position with numpy : 0.0015940666198730469 nb_pixel_total : 38826 time to create 1 rle with old method : 0.042618513107299805 length of segment : 206 time for calcul the mask position with numpy : 0.0006513595581054688 nb_pixel_total : 11197 time to create 1 rle with old method : 0.012607574462890625 length of segment : 147 time for calcul the mask position with numpy : 0.005698442459106445 nb_pixel_total : 113669 time to create 1 rle with old method : 0.1272721290588379 length of segment : 386 time for calcul the mask position with numpy : 0.0027022361755371094 nb_pixel_total : 43479 time to create 1 rle with old method : 0.04950690269470215 length of segment : 308 time for calcul the mask position with numpy : 0.0003211498260498047 nb_pixel_total : 5057 time to create 1 rle with old method : 0.006010532379150391 length of segment : 135 time for calcul the mask position with numpy : 0.0008196830749511719 nb_pixel_total : 14833 time to create 1 rle with old method : 0.018231868743896484 length of segment : 137 time for calcul the mask position with numpy : 0.0016407966613769531 nb_pixel_total : 27118 time to create 1 rle with old method : 0.032129526138305664 length of segment : 223 time for calcul the mask position with numpy : 0.00042438507080078125 nb_pixel_total : 9846 time to create 1 rle with old method : 0.012017011642456055 length of segment : 96 time for calcul the mask position with numpy : 0.00048160552978515625 nb_pixel_total : 9319 time to create 1 rle with old method : 0.011383533477783203 length of segment : 135 time for calcul the mask position with numpy : 0.0007371902465820312 nb_pixel_total : 16564 time to create 1 rle with old method : 0.018794536590576172 length of segment : 153 time for calcul the mask position with numpy : 0.0035638809204101562 nb_pixel_total : 102100 time to create 1 rle with old method : 0.11294412612915039 length of segment : 269 time for calcul the mask position with numpy : 0.0011014938354492188 nb_pixel_total : 32973 time to create 1 rle with old method : 0.037636518478393555 length of segment : 138 time for calcul the mask position with numpy : 0.0025436878204345703 nb_pixel_total : 64656 time to create 1 rle with old method : 0.07098126411437988 length of segment : 310 time for calcul the mask position with numpy : 0.0009112358093261719 nb_pixel_total : 15839 time to create 1 rle with old method : 0.017697811126708984 length of segment : 136 time for calcul the mask position with numpy : 0.0008234977722167969 nb_pixel_total : 35908 time to create 1 rle with old method : 0.039810895919799805 length of segment : 154 time for calcul the mask position with numpy : 0.0005321502685546875 nb_pixel_total : 6187 time to create 1 rle with old method : 0.0077495574951171875 length of segment : 80 time for calcul the mask position with numpy : 0.003625154495239258 nb_pixel_total : 45278 time to create 1 rle with old method : 0.05007505416870117 length of segment : 252 time for calcul the mask position with numpy : 0.0014331340789794922 nb_pixel_total : 13918 time to create 1 rle with old method : 0.01636815071105957 length of segment : 137 time for calcul the mask position with numpy : 0.0013878345489501953 nb_pixel_total : 22280 time to create 1 rle with old method : 0.024936437606811523 length of segment : 183 time for calcul the mask position with numpy : 0.0011937618255615234 nb_pixel_total : 17349 time to create 1 rle with old method : 0.019260883331298828 length of segment : 195 time for calcul the mask position with numpy : 0.003045797348022461 nb_pixel_total : 47810 time to create 1 rle with old method : 0.05365943908691406 length of segment : 234 time for calcul the mask position with numpy : 0.0005135536193847656 nb_pixel_total : 4535 time to create 1 rle with old method : 0.00529932975769043 length of segment : 96 time for calcul the mask position with numpy : 0.000812530517578125 nb_pixel_total : 11927 time to create 1 rle with old method : 0.01374053955078125 length of segment : 94 time for calcul the mask position with numpy : 0.0013420581817626953 nb_pixel_total : 11877 time to create 1 rle with old method : 0.013594627380371094 length of segment : 201 time for calcul the mask position with numpy : 0.0010449886322021484 nb_pixel_total : 12623 time to create 1 rle with old method : 0.014028787612915039 length of segment : 203 time for calcul the mask position with numpy : 0.002597808837890625 nb_pixel_total : 32695 time to create 1 rle with old method : 0.035715579986572266 length of segment : 378 time for calcul the mask position with numpy : 0.001989126205444336 nb_pixel_total : 15826 time to create 1 rle with old method : 0.017975807189941406 length of segment : 186 time for calcul the mask position with numpy : 0.0003592967987060547 nb_pixel_total : 6541 time to create 1 rle with old method : 0.0076901912689208984 length of segment : 106 time for calcul the mask position with numpy : 0.0017015933990478516 nb_pixel_total : 28857 time to create 1 rle with old method : 0.0315251350402832 length of segment : 193 time for calcul the mask position with numpy : 0.0014929771423339844 nb_pixel_total : 18244 time to create 1 rle with old method : 0.029606103897094727 length of segment : 167 time for calcul the mask position with numpy : 0.002819538116455078 nb_pixel_total : 22383 time to create 1 rle with old method : 0.02673649787902832 length of segment : 279 time for calcul the mask position with numpy : 0.0017485618591308594 nb_pixel_total : 14823 time to create 1 rle with old method : 0.01696467399597168 length of segment : 163 time for calcul the mask position with numpy : 0.0005261898040771484 nb_pixel_total : 7792 time to create 1 rle with old method : 0.008971214294433594 length of segment : 75 time for calcul the mask position with numpy : 0.0021610260009765625 nb_pixel_total : 14057 time to create 1 rle with old method : 0.015742778778076172 length of segment : 207 time for calcul the mask position with numpy : 0.0026407241821289062 nb_pixel_total : 28425 time to create 1 rle with old method : 0.0314788818359375 length of segment : 248 time for calcul the mask position with numpy : 0.0013053417205810547 nb_pixel_total : 15576 time to create 1 rle with old method : 0.017236709594726562 length of segment : 177 time for calcul the mask position with numpy : 0.001936197280883789 nb_pixel_total : 28751 time to create 1 rle with old method : 0.03977632522583008 length of segment : 228 time for calcul the mask position with numpy : 0.001506805419921875 nb_pixel_total : 16657 time to create 1 rle with old method : 0.01819467544555664 length of segment : 138 time for calcul the mask position with numpy : 0.0012001991271972656 nb_pixel_total : 14759 time to create 1 rle with old method : 0.016002893447875977 length of segment : 231 time for calcul the mask position with numpy : 0.002267599105834961 nb_pixel_total : 17599 time to create 1 rle with old method : 0.019928932189941406 length of segment : 218 time for calcul the mask position with numpy : 0.008989095687866211 nb_pixel_total : 89501 time to create 1 rle with old method : 0.0989081859588623 length of segment : 348 time for calcul the mask position with numpy : 0.0019655227661132812 nb_pixel_total : 33076 time to create 1 rle with old method : 0.03613471984863281 length of segment : 267 time for calcul the mask position with numpy : 0.0013804435729980469 nb_pixel_total : 28521 time to create 1 rle with old method : 0.03162550926208496 length of segment : 246 time for calcul the mask position with numpy : 0.0013248920440673828 nb_pixel_total : 24534 time to create 1 rle with old method : 0.02738499641418457 length of segment : 204 time for calcul the mask position with numpy : 0.0023491382598876953 nb_pixel_total : 30076 time to create 1 rle with old method : 0.0327305793762207 length of segment : 394 time for calcul the mask position with numpy : 0.002298593521118164 nb_pixel_total : 35014 time to create 1 rle with old method : 0.03868842124938965 length of segment : 219 time for calcul the mask position with numpy : 0.000354766845703125 nb_pixel_total : 3789 time to create 1 rle with old method : 0.004433155059814453 length of segment : 75 time for calcul the mask position with numpy : 0.002748250961303711 nb_pixel_total : 48112 time to create 1 rle with old method : 0.053147315979003906 length of segment : 345 time for calcul the mask position with numpy : 0.0003414154052734375 nb_pixel_total : 5873 time to create 1 rle with old method : 0.0068395137786865234 length of segment : 114 time for calcul the mask position with numpy : 0.0013358592987060547 nb_pixel_total : 17411 time to create 1 rle with old method : 0.026317834854125977 length of segment : 168 time for calcul the mask position with numpy : 0.0017094612121582031 nb_pixel_total : 17586 time to create 1 rle with old method : 0.01972055435180664 length of segment : 178 time for calcul the mask position with numpy : 0.004838705062866211 nb_pixel_total : 38080 time to create 1 rle with old method : 0.044064998626708984 length of segment : 548 time for calcul the mask position with numpy : 0.0009238719940185547 nb_pixel_total : 9154 time to create 1 rle with old method : 0.010281801223754883 length of segment : 169 time for calcul the mask position with numpy : 0.0006144046783447266 nb_pixel_total : 6578 time to create 1 rle with old method : 0.007637977600097656 length of segment : 94 time for calcul the mask position with numpy : 0.0005843639373779297 nb_pixel_total : 6243 time to create 1 rle with old method : 0.0072133541107177734 length of segment : 92 time for calcul the mask position with numpy : 0.0021681785583496094 nb_pixel_total : 36516 time to create 1 rle with old method : 0.04027605056762695 length of segment : 251 time for calcul the mask position with numpy : 0.0005817413330078125 nb_pixel_total : 5061 time to create 1 rle with old method : 0.0058023929595947266 length of segment : 81 time for calcul the mask position with numpy : 0.0006110668182373047 nb_pixel_total : 7801 time to create 1 rle with old method : 0.009196996688842773 length of segment : 68 time for calcul the mask position with numpy : 0.0006866455078125 nb_pixel_total : 8495 time to create 1 rle with old method : 0.010186433792114258 length of segment : 68 time for calcul the mask position with numpy : 0.002037525177001953 nb_pixel_total : 18987 time to create 1 rle with old method : 0.02150106430053711 length of segment : 206 time for calcul the mask position with numpy : 0.0014424324035644531 nb_pixel_total : 18978 time to create 1 rle with old method : 0.021534204483032227 length of segment : 255 time for calcul the mask position with numpy : 0.0012814998626708984 nb_pixel_total : 16624 time to create 1 rle with old method : 0.019034147262573242 length of segment : 105 time for calcul the mask position with numpy : 0.0015883445739746094 nb_pixel_total : 17787 time to create 1 rle with old method : 0.019997119903564453 length of segment : 264 time for calcul the mask position with numpy : 0.0005028247833251953 nb_pixel_total : 4467 time to create 1 rle with old method : 0.009734630584716797 length of segment : 86 time for calcul the mask position with numpy : 0.0010499954223632812 nb_pixel_total : 14016 time to create 1 rle with old method : 0.015992164611816406 length of segment : 172 time for calcul the mask position with numpy : 0.0014109611511230469 nb_pixel_total : 21536 time to create 1 rle with old method : 0.024461984634399414 length of segment : 143 time for calcul the mask position with numpy : 0.0005452632904052734 nb_pixel_total : 5442 time to create 1 rle with old method : 0.006539821624755859 length of segment : 85 time for calcul the mask position with numpy : 0.002812623977661133 nb_pixel_total : 10312 time to create 1 rle with old method : 0.012601613998413086 length of segment : 220 time for calcul the mask position with numpy : 0.0020952224731445312 nb_pixel_total : 47010 time to create 1 rle with old method : 0.051155805587768555 length of segment : 273 time for calcul the mask position with numpy : 0.0007295608520507812 nb_pixel_total : 13075 time to create 1 rle with old method : 0.01479029655456543 length of segment : 145 time for calcul the mask position with numpy : 0.007505893707275391 nb_pixel_total : 130288 time to create 1 rle with old method : 0.14761590957641602 length of segment : 364 time for calcul the mask position with numpy : 0.0024428367614746094 nb_pixel_total : 46831 time to create 1 rle with old method : 0.052623748779296875 length of segment : 296 time for calcul the mask position with numpy : 0.0023620128631591797 nb_pixel_total : 44765 time to create 1 rle with old method : 0.050316572189331055 length of segment : 283 time for calcul the mask position with numpy : 0.0014421939849853516 nb_pixel_total : 25559 time to create 1 rle with old method : 0.031324148178100586 length of segment : 303 time for calcul the mask position with numpy : 0.0007789134979248047 nb_pixel_total : 13254 time to create 1 rle with old method : 0.015130996704101562 length of segment : 132 time for calcul the mask position with numpy : 0.00046753883361816406 nb_pixel_total : 8977 time to create 1 rle with old method : 0.010150909423828125 length of segment : 152 time for calcul the mask position with numpy : 0.0005977153778076172 nb_pixel_total : 12776 time to create 1 rle with old method : 0.014169931411743164 length of segment : 222 time for calcul the mask position with numpy : 0.0014216899871826172 nb_pixel_total : 24713 time to create 1 rle with old method : 0.028476238250732422 length of segment : 264 time for calcul the mask position with numpy : 0.0017230510711669922 nb_pixel_total : 40892 time to create 1 rle with old method : 0.04562211036682129 length of segment : 429 time for calcul the mask position with numpy : 0.008720159530639648 nb_pixel_total : 206142 time to create 1 rle with new method : 0.01319742202758789 length of segment : 536 time for calcul the mask position with numpy : 0.011470317840576172 nb_pixel_total : 211992 time to create 1 rle with new method : 0.015111684799194336 length of segment : 848 time for calcul the mask position with numpy : 0.0006456375122070312 nb_pixel_total : 18308 time to create 1 rle with old method : 0.02100968360900879 length of segment : 144 time for calcul the mask position with numpy : 0.0005452632904052734 nb_pixel_total : 19269 time to create 1 rle with old method : 0.02216815948486328 length of segment : 135 time for calcul the mask position with numpy : 0.0006279945373535156 nb_pixel_total : 12773 time to create 1 rle with old method : 0.014312505722045898 length of segment : 154 time for calcul the mask position with numpy : 0.0007259845733642578 nb_pixel_total : 13169 time to create 1 rle with old method : 0.015298128128051758 length of segment : 142 time for calcul the mask position with numpy : 0.0004951953887939453 nb_pixel_total : 10727 time to create 1 rle with old method : 0.012570381164550781 length of segment : 85 time for calcul the mask position with numpy : 0.0017883777618408203 nb_pixel_total : 30934 time to create 1 rle with old method : 0.03536367416381836 length of segment : 240 time for calcul the mask position with numpy : 0.0008332729339599609 nb_pixel_total : 18265 time to create 1 rle with old method : 0.020633935928344727 length of segment : 139 time for calcul the mask position with numpy : 0.0018191337585449219 nb_pixel_total : 46857 time to create 1 rle with old method : 0.05484628677368164 length of segment : 191 time for calcul the mask position with numpy : 0.001990795135498047 nb_pixel_total : 47855 time to create 1 rle with old method : 0.05323290824890137 length of segment : 211 time spent for convertir_results : 18.73021125793457 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 204 chid ids of type : 3594 Number RLEs to save : 56043 save missing photos in datou_result : time spend for datou_step_exec : 123.59507942199707 time spend to save output : 7.521701097488403 total time spend for step 1 : 131.11678051948547 step2:crop_condition Fri Feb 14 01:42:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 10 ! batch 1 Loaded 204 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 120 About to insert : list_path_to_insert length 120 new photo from crops ! About to upload 120 photos upload in portfolio : 3736932 init cache_photo without model_param we have 120 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739493788_2518645 we have uploaded 120 photos in the portfolio 3736932 time of upload the photos Elapsed time : 33.97802257537842 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 42 About to insert : list_path_to_insert length 42 new photo from crops ! About to upload 42 photos upload in portfolio : 3736932 init cache_photo without model_param we have 42 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739493834_2518645 we have uploaded 42 photos in the portfolio 3736932 time of upload the photos Elapsed time : 13.951324939727783 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739493850_2518645 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.0427603721618652 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 28 About to insert : list_path_to_insert length 28 new photo from crops ! About to upload 28 photos upload in portfolio : 3736932 init cache_photo without model_param we have 28 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739493866_2518645 we have uploaded 28 photos in the portfolio 3736932 time of upload the photos Elapsed time : 8.106816291809082 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 3736932 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739493877_2518645 we have uploaded 7 photos in the portfolio 3736932 time of upload the photos Elapsed time : 2.6043949127197266 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 3736932 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739493882_2518645 we have uploaded 2 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.8276739120483398 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739493885_2518645 we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.3480494022369385 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1337447786, 1337447785, 1337447782, 1337447779, 1337398186, 1337398185, 1337398181, 1337398178, 1337397168, 1337397160] Looping around the photos to save general results len do output : 204 /1337485211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337485464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337447786', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337447785', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337447782', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337447779', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337398186', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337398185', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337398181', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337398178', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337397168', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337397160', None, None, None, None, None, '2584405') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 622 time used for this insertion : 0.07308840751647949 save_final save missing photos in datou_result : time spend for datou_step_exec : 123.14434576034546 time spend to save output : 0.07865500450134277 total time spend for step 2 : 123.2230007648468 step3:rle_unique_nms_with_priority Fri Feb 14 01:44:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 204 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 18 nb_hashtags : 4 time to prepare the origin masks : 5.821903944015503 time for calcul the mask position with numpy : 0.6483914852142334 nb_pixel_total : 6229542 time to create 1 rle with new method : 1.5229825973510742 time for calcul the mask position with numpy : 0.02500176429748535 nb_pixel_total : 9061 time to create 1 rle with old method : 0.010792732238769531 time for calcul the mask position with numpy : 0.023132801055908203 nb_pixel_total : 10759 time to create 1 rle with old method : 0.013191938400268555 time for calcul the mask position with numpy : 0.02190256118774414 nb_pixel_total : 2753 time to create 1 rle with old method : 0.0031485557556152344 time for calcul the mask position with numpy : 0.026169300079345703 nb_pixel_total : 10961 time to create 1 rle with old method : 0.012058019638061523 time for calcul the mask position with numpy : 0.02243208885192871 nb_pixel_total : 8104 time to create 1 rle with old method : 0.009588956832885742 time for calcul the mask position with numpy : 0.023757219314575195 nb_pixel_total : 39687 time to create 1 rle with old method : 0.043390512466430664 time for calcul the mask position with numpy : 0.02838444709777832 nb_pixel_total : 31396 time to create 1 rle with old method : 0.03837132453918457 time for calcul the mask position with numpy : 0.0215606689453125 nb_pixel_total : 60457 time to create 1 rle with old method : 0.06750178337097168 time for calcul the mask position with numpy : 0.024758338928222656 nb_pixel_total : 8382 time to create 1 rle with old method : 0.00921940803527832 time for calcul the mask position with numpy : 0.021441936492919922 nb_pixel_total : 18567 time to create 1 rle with old method : 0.02022385597229004 time for calcul the mask position with numpy : 0.02299666404724121 nb_pixel_total : 33446 time to create 1 rle with old method : 0.0373995304107666 time for calcul the mask position with numpy : 0.022714853286743164 nb_pixel_total : 11905 time to create 1 rle with old method : 0.013028860092163086 time for calcul the mask position with numpy : 0.022513151168823242 nb_pixel_total : 5344 time to create 1 rle with old method : 0.0060367584228515625 time for calcul the mask position with numpy : 0.024085283279418945 nb_pixel_total : 4028 time to create 1 rle with old method : 0.0046193599700927734 time for calcul the mask position with numpy : 0.021595239639282227 nb_pixel_total : 11112 time to create 1 rle with old method : 0.012481212615966797 time for calcul the mask position with numpy : 0.025740385055541992 nb_pixel_total : 452514 time to create 1 rle with new method : 1.0818517208099365 time for calcul the mask position with numpy : 0.02439117431640625 nb_pixel_total : 54421 time to create 1 rle with old method : 0.060750722885131836 time for calcul the mask position with numpy : 0.023048877716064453 nb_pixel_total : 47801 time to create 1 rle with old method : 0.05538058280944824 create new chi : 4.1554296016693115 time to delete rle : 0.010339021682739258 batch 1 Loaded 38 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 10805 TO DO : save crop sub photo not yet done ! save time : 1.3028669357299805 nb_obj : 18 nb_hashtags : 5 time to prepare the origin masks : 5.837442398071289 time for calcul the mask position with numpy : 0.5317919254302979 nb_pixel_total : 6038431 time to create 1 rle with new method : 1.2111637592315674 time for calcul the mask position with numpy : 0.026163101196289062 nb_pixel_total : 10595 time to create 1 rle with old method : 0.015254020690917969 time for calcul the mask position with numpy : 0.02923440933227539 nb_pixel_total : 33196 time to create 1 rle with old method : 0.05415964126586914 time for calcul the mask position with numpy : 0.02489638328552246 nb_pixel_total : 2152 time to create 1 rle with old method : 0.0026335716247558594 time for calcul the mask position with numpy : 0.02821040153503418 nb_pixel_total : 27564 time to create 1 rle with old method : 0.030203580856323242 time for calcul the mask position with numpy : 0.02365255355834961 nb_pixel_total : 230991 time to create 1 rle with new method : 0.3454599380493164 time for calcul the mask position with numpy : 0.023415803909301758 nb_pixel_total : 13958 time to create 1 rle with old method : 0.015450477600097656 time for calcul the mask position with numpy : 0.022718429565429688 nb_pixel_total : 50052 time to create 1 rle with old method : 0.052742719650268555 time for calcul the mask position with numpy : 0.02140665054321289 nb_pixel_total : 13424 time to create 1 rle with old method : 0.013906002044677734 time for calcul the mask position with numpy : 0.022226333618164062 nb_pixel_total : 12644 time to create 1 rle with old method : 0.013637542724609375 time for calcul the mask position with numpy : 0.0215151309967041 nb_pixel_total : 148859 time to create 1 rle with old method : 0.1553490161895752 time for calcul the mask position with numpy : 0.02223372459411621 nb_pixel_total : 5731 time to create 1 rle with old method : 0.0061266422271728516 time for calcul the mask position with numpy : 0.03278946876525879 nb_pixel_total : 28838 time to create 1 rle with old method : 0.031008005142211914 time for calcul the mask position with numpy : 0.03499245643615723 nb_pixel_total : 211762 time to create 1 rle with new method : 0.6791582107543945 time for calcul the mask position with numpy : 0.03663182258605957 nb_pixel_total : 62796 time to create 1 rle with old method : 0.06960034370422363 time for calcul the mask position with numpy : 0.03381991386413574 nb_pixel_total : 96525 time to create 1 rle with old method : 0.10695099830627441 time for calcul the mask position with numpy : 0.02414393424987793 nb_pixel_total : 31910 time to create 1 rle with old method : 0.03637218475341797 time for calcul the mask position with numpy : 0.023320913314819336 nb_pixel_total : 13678 time to create 1 rle with old method : 0.014924287796020508 time for calcul the mask position with numpy : 0.021628379821777344 nb_pixel_total : 17134 time to create 1 rle with old method : 0.019481182098388672 create new chi : 3.979581356048584 time to delete rle : 0.0019230842590332031 batch 1 Loaded 37 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 13398 TO DO : save crop sub photo not yet done ! save time : 2.2966485023498535 nb_obj : 19 nb_hashtags : 4 time to prepare the origin masks : 8.31249213218689 time for calcul the mask position with numpy : 0.7646212577819824 nb_pixel_total : 5577316 time to create 1 rle with new method : 0.7244784832000732 time for calcul the mask position with numpy : 0.04393768310546875 nb_pixel_total : 15550 time to create 1 rle with old method : 0.01824021339416504 time for calcul the mask position with numpy : 0.035642147064208984 nb_pixel_total : 13139 time to create 1 rle with old method : 0.014734506607055664 time for calcul the mask position with numpy : 0.03560495376586914 nb_pixel_total : 7391 time to create 1 rle with old method : 0.008045196533203125 time for calcul the mask position with numpy : 0.036055803298950195 nb_pixel_total : 52633 time to create 1 rle with old method : 0.057900190353393555 time for calcul the mask position with numpy : 0.03529787063598633 nb_pixel_total : 15870 time to create 1 rle with old method : 0.027383804321289062 time for calcul the mask position with numpy : 0.0454709529876709 nb_pixel_total : 114620 time to create 1 rle with old method : 0.15218687057495117 time for calcul the mask position with numpy : 0.036869049072265625 nb_pixel_total : 72900 time to create 1 rle with old method : 0.08097958564758301 time for calcul the mask position with numpy : 0.0376734733581543 nb_pixel_total : 21121 time to create 1 rle with old method : 0.023557424545288086 time for calcul the mask position with numpy : 0.03860640525817871 nb_pixel_total : 71675 time to create 1 rle with old method : 0.08049798011779785 time for calcul the mask position with numpy : 0.037142276763916016 nb_pixel_total : 319836 time to create 1 rle with new method : 0.4392740726470947 time for calcul the mask position with numpy : 0.038982391357421875 nb_pixel_total : 73743 time to create 1 rle with old method : 0.09547543525695801 time for calcul the mask position with numpy : 0.0374908447265625 nb_pixel_total : 243139 time to create 1 rle with new method : 0.5207011699676514 time for calcul the mask position with numpy : 0.04011654853820801 nb_pixel_total : 61249 time to create 1 rle with old method : 0.06791877746582031 time for calcul the mask position with numpy : 0.037410736083984375 nb_pixel_total : 50683 time to create 1 rle with old method : 0.058114051818847656 time for calcul the mask position with numpy : 0.03552436828613281 nb_pixel_total : 148790 time to create 1 rle with old method : 0.17037320137023926 time for calcul the mask position with numpy : 0.03540992736816406 nb_pixel_total : 51661 time to create 1 rle with old method : 0.062418460845947266 time for calcul the mask position with numpy : 0.035254716873168945 nb_pixel_total : 74923 time to create 1 rle with old method : 0.08682656288146973 time for calcul the mask position with numpy : 0.03319692611694336 nb_pixel_total : 16978 time to create 1 rle with old method : 0.020690441131591797 time for calcul the mask position with numpy : 0.03287029266357422 nb_pixel_total : 47023 time to create 1 rle with old method : 0.07674145698547363 create new chi : 4.357707262039185 time to delete rle : 0.003833770751953125 batch 1 Loaded 39 chid ids of type : 3594 ++++++++++++++++++++++++++++++++Number RLEs to save : 14633 TO DO : save crop sub photo not yet done ! save time : 1.2727746963500977 nb_obj : 13 nb_hashtags : 4 time to prepare the origin masks : 6.799733877182007 time for calcul the mask position with numpy : 0.38520097732543945 nb_pixel_total : 6129146 time to create 1 rle with new method : 0.6938607692718506 time for calcul the mask position with numpy : 0.03565025329589844 nb_pixel_total : 173635 time to create 1 rle with new method : 0.4178953170776367 time for calcul the mask position with numpy : 0.03849601745605469 nb_pixel_total : 54329 time to create 1 rle with old method : 0.0628516674041748 time for calcul the mask position with numpy : 0.03459429740905762 nb_pixel_total : 59546 time to create 1 rle with old method : 0.06683921813964844 time for calcul the mask position with numpy : 0.03995227813720703 nb_pixel_total : 339924 time to create 1 rle with new method : 0.37319469451904297 time for calcul the mask position with numpy : 0.022524118423461914 nb_pixel_total : 7379 time to create 1 rle with old method : 0.008136749267578125 time for calcul the mask position with numpy : 0.026274442672729492 nb_pixel_total : 94952 time to create 1 rle with old method : 0.10999274253845215 time for calcul the mask position with numpy : 0.022948265075683594 nb_pixel_total : 5390 time to create 1 rle with old method : 0.006073951721191406 time for calcul the mask position with numpy : 0.02339959144592285 nb_pixel_total : 14056 time to create 1 rle with old method : 0.01542806625366211 time for calcul the mask position with numpy : 0.03451108932495117 nb_pixel_total : 15483 time to create 1 rle with old method : 0.018120765686035156 time for calcul the mask position with numpy : 0.03824472427368164 nb_pixel_total : 4348 time to create 1 rle with old method : 0.00610041618347168 time for calcul the mask position with numpy : 0.04076027870178223 nb_pixel_total : 26668 time to create 1 rle with old method : 0.0402979850769043 time for calcul the mask position with numpy : 0.036255598068237305 nb_pixel_total : 69756 time to create 1 rle with old method : 0.07791590690612793 time for calcul the mask position with numpy : 0.036243438720703125 nb_pixel_total : 55628 time to create 1 rle with old method : 0.061767578125 create new chi : 2.8460910320281982 time to delete rle : 0.0017940998077392578 batch 1 Loaded 27 chid ids of type : 3594 ++++++++++++++++++++++Number RLEs to save : 11240 TO DO : save crop sub photo not yet done ! save time : 2.4688313007354736 nb_obj : 20 nb_hashtags : 4 time to prepare the origin masks : 9.524323225021362 time for calcul the mask position with numpy : 0.4202742576599121 nb_pixel_total : 5095069 time to create 1 rle with new method : 0.9533555507659912 time for calcul the mask position with numpy : 0.03933000564575195 nb_pixel_total : 502064 time to create 1 rle with new method : 0.5143444538116455 time for calcul the mask position with numpy : 0.033237457275390625 nb_pixel_total : 20314 time to create 1 rle with old method : 0.021379947662353516 time for calcul the mask position with numpy : 0.03461599349975586 nb_pixel_total : 91332 time to create 1 rle with old method : 0.09451675415039062 time for calcul the mask position with numpy : 0.035047292709350586 nb_pixel_total : 107684 time to create 1 rle with old method : 0.11304545402526855 time for calcul the mask position with numpy : 0.036163330078125 nb_pixel_total : 122029 time to create 1 rle with old method : 0.12978768348693848 time for calcul the mask position with numpy : 0.037470340728759766 nb_pixel_total : 149669 time to create 1 rle with old method : 0.1555311679840088 time for calcul the mask position with numpy : 0.035100460052490234 nb_pixel_total : 141822 time to create 1 rle with old method : 0.14914512634277344 time for calcul the mask position with numpy : 0.0338897705078125 nb_pixel_total : 81900 time to create 1 rle with old method : 0.08603668212890625 time for calcul the mask position with numpy : 0.02971053123474121 nb_pixel_total : 15661 time to create 1 rle with old method : 0.016993045806884766 time for calcul the mask position with numpy : 0.025116920471191406 nb_pixel_total : 23982 time to create 1 rle with old method : 0.02501654624938965 time for calcul the mask position with numpy : 0.0227816104888916 nb_pixel_total : 60825 time to create 1 rle with old method : 0.06358861923217773 time for calcul the mask position with numpy : 0.022342205047607422 nb_pixel_total : 13607 time to create 1 rle with old method : 0.014048099517822266 time for calcul the mask position with numpy : 0.023780107498168945 nb_pixel_total : 21385 time to create 1 rle with old method : 0.02289724349975586 time for calcul the mask position with numpy : 0.021572351455688477 nb_pixel_total : 119747 time to create 1 rle with old method : 0.12499737739562988 time for calcul the mask position with numpy : 0.02222275733947754 nb_pixel_total : 137566 time to create 1 rle with old method : 0.14222335815429688 time for calcul the mask position with numpy : 0.020891666412353516 nb_pixel_total : 55843 time to create 1 rle with old method : 0.0581660270690918 time for calcul the mask position with numpy : 0.021114349365234375 nb_pixel_total : 122092 time to create 1 rle with old method : 0.12546133995056152 time for calcul the mask position with numpy : 0.021845102310180664 nb_pixel_total : 115189 time to create 1 rle with old method : 0.12022590637207031 time for calcul the mask position with numpy : 0.02315831184387207 nb_pixel_total : 20683 time to create 1 rle with old method : 0.022507429122924805 time for calcul the mask position with numpy : 0.024384021759033203 nb_pixel_total : 31777 time to create 1 rle with old method : 0.03439068794250488 create new chi : 4.041309833526611 time to delete rle : 0.0025146007537841797 batch 1 Loaded 41 chid ids of type : 3594 +++++++++++++++++++++++++Number RLEs to save : 16273 TO DO : save crop sub photo not yet done ! save time : 1.1361327171325684 nb_obj : 12 nb_hashtags : 2 time to prepare the origin masks : 4.130856990814209 time for calcul the mask position with numpy : 1.0715508460998535 nb_pixel_total : 6142480 time to create 1 rle with new method : 0.645334005355835 time for calcul the mask position with numpy : 0.023576736450195312 nb_pixel_total : 29300 time to create 1 rle with old method : 0.03282594680786133 time for calcul the mask position with numpy : 0.021355628967285156 nb_pixel_total : 18727 time to create 1 rle with old method : 0.020464420318603516 time for calcul the mask position with numpy : 0.02187180519104004 nb_pixel_total : 39177 time to create 1 rle with old method : 0.043079376220703125 time for calcul the mask position with numpy : 0.025627613067626953 nb_pixel_total : 438458 time to create 1 rle with new method : 0.8889155387878418 time for calcul the mask position with numpy : 0.023127079010009766 nb_pixel_total : 27728 time to create 1 rle with old method : 0.030042409896850586 time for calcul the mask position with numpy : 0.022657394409179688 nb_pixel_total : 7903 time to create 1 rle with old method : 0.008632183074951172 time for calcul the mask position with numpy : 0.022921085357666016 nb_pixel_total : 94293 time to create 1 rle with old method : 0.10457634925842285 time for calcul the mask position with numpy : 0.022532224655151367 nb_pixel_total : 101718 time to create 1 rle with old method : 0.10980963706970215 time for calcul the mask position with numpy : 0.0224306583404541 nb_pixel_total : 42155 time to create 1 rle with old method : 0.04778170585632324 time for calcul the mask position with numpy : 0.021463632583618164 nb_pixel_total : 9386 time to create 1 rle with old method : 0.01049494743347168 time for calcul the mask position with numpy : 0.021495342254638672 nb_pixel_total : 18559 time to create 1 rle with old method : 0.020267963409423828 time for calcul the mask position with numpy : 0.022345542907714844 nb_pixel_total : 80356 time to create 1 rle with old method : 0.08863067626953125 create new chi : 3.4629852771759033 time to delete rle : 0.0016078948974609375 batch 1 Loaded 25 chid ids of type : 3594 +++++++++++++++Number RLEs to save : 10078 TO DO : save crop sub photo not yet done ! save time : 0.7493453025817871 nb_obj : 12 nb_hashtags : 5 time to prepare the origin masks : 5.054877996444702 time for calcul the mask position with numpy : 0.34781861305236816 nb_pixel_total : 6116547 time to create 1 rle with new method : 0.6395094394683838 time for calcul the mask position with numpy : 0.023539304733276367 nb_pixel_total : 34980 time to create 1 rle with old method : 0.039133548736572266 time for calcul the mask position with numpy : 0.027063608169555664 nb_pixel_total : 22790 time to create 1 rle with old method : 0.025486230850219727 time for calcul the mask position with numpy : 0.02178812026977539 nb_pixel_total : 14194 time to create 1 rle with old method : 0.015368223190307617 time for calcul the mask position with numpy : 0.021884679794311523 nb_pixel_total : 23485 time to create 1 rle with old method : 0.027009010314941406 time for calcul the mask position with numpy : 0.023447036743164062 nb_pixel_total : 43310 time to create 1 rle with old method : 0.04714703559875488 time for calcul the mask position with numpy : 0.022501468658447266 nb_pixel_total : 52188 time to create 1 rle with old method : 0.056345224380493164 time for calcul the mask position with numpy : 0.024155378341674805 nb_pixel_total : 156976 time to create 1 rle with new method : 0.5195858478546143 time for calcul the mask position with numpy : 0.02197575569152832 nb_pixel_total : 113390 time to create 1 rle with old method : 0.13060235977172852 time for calcul the mask position with numpy : 0.022938966751098633 nb_pixel_total : 143494 time to create 1 rle with old method : 0.16122698783874512 time for calcul the mask position with numpy : 0.024532556533813477 nb_pixel_total : 257505 time to create 1 rle with new method : 0.6455404758453369 time for calcul the mask position with numpy : 0.026627063751220703 nb_pixel_total : 56558 time to create 1 rle with old method : 0.06603527069091797 time for calcul the mask position with numpy : 0.022938013076782227 nb_pixel_total : 14823 time to create 1 rle with old method : 0.016911029815673828 create new chi : 3.1115598678588867 time to delete rle : 0.0018749237060546875 batch 1 Loaded 25 chid ids of type : 3594 ++++++++++++++++Number RLEs to save : 10738 TO DO : save crop sub photo not yet done ! save time : 0.760291337966919 nb_obj : 17 nb_hashtags : 3 time to prepare the origin masks : 8.577328443527222 time for calcul the mask position with numpy : 0.48595666885375977 nb_pixel_total : 6482766 time to create 1 rle with new method : 1.8328392505645752 time for calcul the mask position with numpy : 0.03190445899963379 nb_pixel_total : 6187 time to create 1 rle with old method : 0.006857872009277344 time for calcul the mask position with numpy : 0.03966045379638672 nb_pixel_total : 35908 time to create 1 rle with old method : 0.04021644592285156 time for calcul the mask position with numpy : 0.03720974922180176 nb_pixel_total : 15839 time to create 1 rle with old method : 0.017943620681762695 time for calcul the mask position with numpy : 0.03788018226623535 nb_pixel_total : 64656 time to create 1 rle with old method : 0.07647919654846191 time for calcul the mask position with numpy : 0.04085135459899902 nb_pixel_total : 32973 time to create 1 rle with old method : 0.03937125205993652 time for calcul the mask position with numpy : 0.04480719566345215 nb_pixel_total : 102100 time to create 1 rle with old method : 0.11486124992370605 time for calcul the mask position with numpy : 0.04075455665588379 nb_pixel_total : 16564 time to create 1 rle with old method : 0.018402576446533203 time for calcul the mask position with numpy : 0.03486800193786621 nb_pixel_total : 9319 time to create 1 rle with old method : 0.01048135757446289 time for calcul the mask position with numpy : 0.03522920608520508 nb_pixel_total : 9846 time to create 1 rle with old method : 0.010818004608154297 time for calcul the mask position with numpy : 0.03834724426269531 nb_pixel_total : 27118 time to create 1 rle with old method : 0.029584169387817383 time for calcul the mask position with numpy : 0.035166263580322266 nb_pixel_total : 14833 time to create 1 rle with old method : 0.01615142822265625 time for calcul the mask position with numpy : 0.03845524787902832 nb_pixel_total : 5057 time to create 1 rle with old method : 0.005656719207763672 time for calcul the mask position with numpy : 0.03431892395019531 nb_pixel_total : 43479 time to create 1 rle with old method : 0.04776501655578613 time for calcul the mask position with numpy : 0.034435272216796875 nb_pixel_total : 113669 time to create 1 rle with old method : 0.12137126922607422 time for calcul the mask position with numpy : 0.033226728439331055 nb_pixel_total : 11197 time to create 1 rle with old method : 0.015178442001342773 time for calcul the mask position with numpy : 0.03465867042541504 nb_pixel_total : 38826 time to create 1 rle with old method : 0.04194045066833496 time for calcul the mask position with numpy : 0.03314018249511719 nb_pixel_total : 19903 time to create 1 rle with old method : 0.021745920181274414 create new chi : 3.62494158744812 time to delete rle : 0.0013592243194580078 batch 1 Loaded 35 chid ids of type : 3594 +++++++++++++++++Number RLEs to save : 8648 TO DO : save crop sub photo not yet done ! save time : 0.7287931442260742 nb_obj : 52 nb_hashtags : 3 time to prepare the origin masks : 4.3116607666015625 time for calcul the mask position with numpy : 0.0830080509185791 nb_pixel_total : 6005188 time to create 1 rle with new method : 0.7059903144836426 time for calcul the mask position with numpy : 0.028851747512817383 nb_pixel_total : 5442 time to create 1 rle with old method : 0.006289005279541016 time for calcul the mask position with numpy : 0.028899192810058594 nb_pixel_total : 17787 time to create 1 rle with old method : 0.019668102264404297 time for calcul the mask position with numpy : 0.029094219207763672 nb_pixel_total : 14057 time to create 1 rle with old method : 0.01570725440979004 time for calcul the mask position with numpy : 0.028924942016601562 nb_pixel_total : 22383 time to create 1 rle with old method : 0.02395796775817871 time for calcul the mask position with numpy : 0.029014110565185547 nb_pixel_total : 14016 time to create 1 rle with old method : 0.015486001968383789 time for calcul the mask position with numpy : 0.029177427291870117 nb_pixel_total : 15576 time to create 1 rle with old method : 0.01718926429748535 time for calcul the mask position with numpy : 0.028796672821044922 nb_pixel_total : 5061 time to create 1 rle with old method : 0.005541801452636719 time for calcul the mask position with numpy : 0.028814315795898438 nb_pixel_total : 16657 time to create 1 rle with old method : 0.018475055694580078 time for calcul the mask position with numpy : 0.028824567794799805 nb_pixel_total : 18987 time to create 1 rle with old method : 0.02112722396850586 time for calcul the mask position with numpy : 0.028723716735839844 nb_pixel_total : 9154 time to create 1 rle with old method : 0.010544300079345703 time for calcul the mask position with numpy : 0.028822898864746094 nb_pixel_total : 12623 time to create 1 rle with old method : 0.013938188552856445 time for calcul the mask position with numpy : 0.02883458137512207 nb_pixel_total : 5871 time to create 1 rle with old method : 0.006487369537353516 time for calcul the mask position with numpy : 0.028931617736816406 nb_pixel_total : 28425 time to create 1 rle with old method : 0.031104326248168945 time for calcul the mask position with numpy : 0.02886176109313965 nb_pixel_total : 30076 time to create 1 rle with old method : 0.03377199172973633 time for calcul the mask position with numpy : 0.02885890007019043 nb_pixel_total : 24534 time to create 1 rle with old method : 0.02626347541809082 time for calcul the mask position with numpy : 0.028935670852661133 nb_pixel_total : 32695 time to create 1 rle with old method : 0.03595614433288574 time for calcul the mask position with numpy : 0.029128313064575195 nb_pixel_total : 17349 time to create 1 rle with old method : 0.019517183303833008 time for calcul the mask position with numpy : 0.0296480655670166 nb_pixel_total : 28751 time to create 1 rle with old method : 0.031472206115722656 time for calcul the mask position with numpy : 0.029654979705810547 nb_pixel_total : 47810 time to create 1 rle with old method : 0.05704998970031738 time for calcul the mask position with numpy : 0.02903008460998535 nb_pixel_total : 17411 time to create 1 rle with old method : 0.01923370361328125 time for calcul the mask position with numpy : 0.029203176498413086 nb_pixel_total : 28185 time to create 1 rle with old method : 0.030736684799194336 time for calcul the mask position with numpy : 0.02901911735534668 nb_pixel_total : 22280 time to create 1 rle with old method : 0.024527311325073242 time for calcul the mask position with numpy : 0.02928781509399414 nb_pixel_total : 45278 time to create 1 rle with old method : 0.04883265495300293 time for calcul the mask position with numpy : 0.028851032257080078 nb_pixel_total : 7792 time to create 1 rle with old method : 0.008764982223510742 time for calcul the mask position with numpy : 0.02895331382751465 nb_pixel_total : 14759 time to create 1 rle with old method : 0.015903711318969727 time for calcul the mask position with numpy : 0.029113292694091797 nb_pixel_total : 36516 time to create 1 rle with old method : 0.040251731872558594 time for calcul the mask position with numpy : 0.0291748046875 nb_pixel_total : 38080 time to create 1 rle with old method : 0.05486655235290527 time for calcul the mask position with numpy : 0.03312182426452637 nb_pixel_total : 33076 time to create 1 rle with old method : 0.036643028259277344 time for calcul the mask position with numpy : 0.029448986053466797 nb_pixel_total : 17599 time to create 1 rle with old method : 0.019893884658813477 time for calcul the mask position with numpy : 0.029523849487304688 nb_pixel_total : 45406 time to create 1 rle with old method : 0.048160552978515625 time for calcul the mask position with numpy : 0.029993057250976562 nb_pixel_total : 89501 time to create 1 rle with old method : 0.0967869758605957 time for calcul the mask position with numpy : 0.0290529727935791 nb_pixel_total : 15826 time to create 1 rle with old method : 0.017285823822021484 time for calcul the mask position with numpy : 0.02874612808227539 nb_pixel_total : 28857 time to create 1 rle with old method : 0.03091907501220703 time for calcul the mask position with numpy : 0.029091358184814453 nb_pixel_total : 13918 time to create 1 rle with old method : 0.01564192771911621 time for calcul the mask position with numpy : 0.029175758361816406 nb_pixel_total : 34913 time to create 1 rle with old method : 0.03789997100830078 time for calcul the mask position with numpy : 0.03013157844543457 nb_pixel_total : 18244 time to create 1 rle with old method : 0.01972341537475586 time for calcul the mask position with numpy : 0.028977394104003906 nb_pixel_total : 14823 time to create 1 rle with old method : 0.016376972198486328 time for calcul the mask position with numpy : 0.029105663299560547 nb_pixel_total : 21536 time to create 1 rle with old method : 0.024244308471679688 time for calcul the mask position with numpy : 0.028882741928100586 nb_pixel_total : 7801 time to create 1 rle with old method : 0.008300542831420898 time for calcul the mask position with numpy : 0.028905153274536133 nb_pixel_total : 4467 time to create 1 rle with old method : 0.0050563812255859375 time for calcul the mask position with numpy : 0.029300451278686523 nb_pixel_total : 11877 time to create 1 rle with old method : 0.013079166412353516 time for calcul the mask position with numpy : 0.029860258102416992 nb_pixel_total : 6578 time to create 1 rle with old method : 0.007203578948974609 time for calcul the mask position with numpy : 0.033406972885131836 nb_pixel_total : 17586 time to create 1 rle with old method : 0.027579069137573242 time for calcul the mask position with numpy : 0.036284446716308594 nb_pixel_total : 6541 time to create 1 rle with old method : 0.010095834732055664 time for calcul the mask position with numpy : 0.03638267517089844 nb_pixel_total : 10312 time to create 1 rle with old method : 0.01616954803466797 time for calcul the mask position with numpy : 0.03661799430847168 nb_pixel_total : 4535 time to create 1 rle with old method : 0.0070514678955078125 time for calcul the mask position with numpy : 0.03598737716674805 nb_pixel_total : 6243 time to create 1 rle with old method : 0.009725570678710938 time for calcul the mask position with numpy : 0.036675214767456055 nb_pixel_total : 17023 time to create 1 rle with old method : 0.026365280151367188 time for calcul the mask position with numpy : 0.03633737564086914 nb_pixel_total : 16624 time to create 1 rle with old method : 0.025403976440429688 time for calcul the mask position with numpy : 0.03810834884643555 nb_pixel_total : 3789 time to create 1 rle with old method : 0.005773782730102539 time for calcul the mask position with numpy : 0.035254716873168945 nb_pixel_total : 11927 time to create 1 rle with old method : 0.013148307800292969 time for calcul the mask position with numpy : 0.030717849731445312 nb_pixel_total : 8495 time to create 1 rle with old method : 0.011931419372558594 create new chi : 3.604846715927124 time to delete rle : 0.005231142044067383 batch 1 Loaded 105 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 22081 TO DO : save crop sub photo not yet done ! save time : 3.601379156112671 nb_obj : 22 nb_hashtags : 5 time to prepare the origin masks : 9.074487686157227 time for calcul the mask position with numpy : 0.6305768489837646 nb_pixel_total : 6005809 time to create 1 rle with new method : 0.9049549102783203 time for calcul the mask position with numpy : 0.022047042846679688 nb_pixel_total : 47855 time to create 1 rle with old method : 0.05174994468688965 time for calcul the mask position with numpy : 0.03414273262023926 nb_pixel_total : 46857 time to create 1 rle with old method : 0.05002427101135254 time for calcul the mask position with numpy : 0.03346109390258789 nb_pixel_total : 18265 time to create 1 rle with old method : 0.020050764083862305 time for calcul the mask position with numpy : 0.033199310302734375 nb_pixel_total : 30934 time to create 1 rle with old method : 0.03337264060974121 time for calcul the mask position with numpy : 0.03315329551696777 nb_pixel_total : 10727 time to create 1 rle with old method : 0.012192726135253906 time for calcul the mask position with numpy : 0.0332789421081543 nb_pixel_total : 13169 time to create 1 rle with old method : 0.013870000839233398 time for calcul the mask position with numpy : 0.0328519344329834 nb_pixel_total : 12773 time to create 1 rle with old method : 0.014260530471801758 time for calcul the mask position with numpy : 0.022531747817993164 nb_pixel_total : 19269 time to create 1 rle with old method : 0.021838665008544922 time for calcul the mask position with numpy : 0.021976947784423828 nb_pixel_total : 18308 time to create 1 rle with old method : 0.019824981689453125 time for calcul the mask position with numpy : 0.02330946922302246 nb_pixel_total : 211992 time to create 1 rle with new method : 1.0511667728424072 time for calcul the mask position with numpy : 0.025638103485107422 nb_pixel_total : 206142 time to create 1 rle with new method : 0.6050505638122559 time for calcul the mask position with numpy : 0.021518945693969727 nb_pixel_total : 40892 time to create 1 rle with old method : 0.04525351524353027 time for calcul the mask position with numpy : 0.02133035659790039 nb_pixel_total : 24713 time to create 1 rle with old method : 0.0268099308013916 time for calcul the mask position with numpy : 0.021848440170288086 nb_pixel_total : 12776 time to create 1 rle with old method : 0.01420283317565918 time for calcul the mask position with numpy : 0.024135828018188477 nb_pixel_total : 8977 time to create 1 rle with old method : 0.009920597076416016 time for calcul the mask position with numpy : 0.022800683975219727 nb_pixel_total : 13254 time to create 1 rle with old method : 0.014255523681640625 time for calcul the mask position with numpy : 0.02163553237915039 nb_pixel_total : 25559 time to create 1 rle with old method : 0.02825331687927246 time for calcul the mask position with numpy : 0.022550106048583984 nb_pixel_total : 44765 time to create 1 rle with old method : 0.04806041717529297 time for calcul the mask position with numpy : 0.02267289161682129 nb_pixel_total : 46831 time to create 1 rle with old method : 0.05133485794067383 time for calcul the mask position with numpy : 0.022738218307495117 nb_pixel_total : 130288 time to create 1 rle with old method : 0.13992810249328613 time for calcul the mask position with numpy : 0.02258586883544922 nb_pixel_total : 13075 time to create 1 rle with old method : 0.014928817749023438 time for calcul the mask position with numpy : 0.02274179458618164 nb_pixel_total : 47010 time to create 1 rle with old method : 0.05127978324890137 create new chi : 4.512099027633667 time to delete rle : 0.0036323070526123047 batch 1 Loaded 45 chid ids of type : 3594 +++++++++++++++++++++++++++++++Number RLEs to save : 13536 TO DO : save crop sub photo not yet done ! save time : 2.78818941116333 map_output_result : {1337447786: (0.0, 'Should be the crop_list due to order', 0.0), 1337447785: (0.0, 'Should be the crop_list due to order', 0.0), 1337447782: (0.0, 'Should be the crop_list due to order', 0.0), 1337447779: (0.0, 'Should be the crop_list due to order', 0.0), 1337398186: (0.0, 'Should be the crop_list due to order', 0.0), 1337398185: (0.0, 'Should be the crop_list due to order', 0.0), 1337398181: (0.0, 'Should be the crop_list due to order', 0.0), 1337398178: (0.0, 'Should be the crop_list due to order', 0.0), 1337397168: (0.0, 'Should be the crop_list due to order', 0.0), 1337397160: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1337447786, 1337447785, 1337447782, 1337447779, 1337398186, 1337398185, 1337398181, 1337398178, 1337397168, 1337397160] Looping around the photos to save general results len do output : 10 /1337447786.Didn't retrieve data . /1337447785.Didn't retrieve data . /1337447782.Didn't retrieve data . /1337447779.Didn't retrieve data . /1337398186.Didn't retrieve data . /1337398185.Didn't retrieve data . /1337398181.Didn't retrieve data . /1337398178.Didn't retrieve data . /1337397168.Didn't retrieve data . /1337397160.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337447786', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337447785', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337447782', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337447779', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337398186', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337398185', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337398181', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337398178', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337397168', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337397160', None, None, None, None, None, '2584405') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.14086365699768066 save_final save missing photos in datou_result : time spend for datou_step_exec : 123.60287165641785 time spend to save output : 0.14149117469787598 total time spend for step 3 : 123.74436283111572 step4:ventilate_hashtags_in_portfolio Fri Feb 14 01:46:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20528940 get user id for portfolio 20528940 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528940 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','pehd','background','environnement','flou','carton','autre','papier','pet_fonce','metal','pet_clair')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528940 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','pehd','background','environnement','flou','carton','autre','papier','pet_fonce','metal','pet_clair')) AND mptpi.`min_score`=0.5 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528940 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('mal_croppe','pehd','background','environnement','flou','carton','autre','papier','pet_fonce','metal','pet_clair')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/20531995,20531996,20531997,20531998,20531999,20532000,20532001,20532002,20532003,20532004,20532005?tags=mal_croppe,pehd,background,environnement,flou,carton,autre,papier,pet_fonce,metal,pet_clair Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1337447786, 1337447785, 1337447782, 1337447779, 1337398186, 1337398185, 1337398181, 1337398178, 1337397168, 1337397160] Looping around the photos to save general results len do output : 1 /20528940. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337447786', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337447785', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337447782', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337447779', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337398186', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337398185', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337398181', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337398178', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337397168', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337397160', None, None, None, None, None, '2584405') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.016762971878051758 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.277053117752075 time spend to save output : 0.017030000686645508 total time spend for step 4 : 2.2940831184387207 step5:final Fri Feb 14 01:46:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1337447786: ('0.15148570828794478',), 1337447785: ('0.15148570828794478',), 1337447782: ('0.15148570828794478',), 1337447779: ('0.15148570828794478',), 1337398186: ('0.15148570828794478',), 1337398185: ('0.15148570828794478',), 1337398181: ('0.15148570828794478',), 1337398178: ('0.15148570828794478',), 1337397168: ('0.15148570828794478',), 1337397160: ('0.15148570828794478',)} new output for save of step final : {1337447786: ('0.15148570828794478',), 1337447785: ('0.15148570828794478',), 1337447782: ('0.15148570828794478',), 1337447779: ('0.15148570828794478',), 1337398186: ('0.15148570828794478',), 1337398185: ('0.15148570828794478',), 1337398181: ('0.15148570828794478',), 1337398178: ('0.15148570828794478',), 1337397168: ('0.15148570828794478',), 1337397160: ('0.15148570828794478',)} [1337447786, 1337447785, 1337447782, 1337447779, 1337398186, 1337398185, 1337398181, 1337398178, 1337397168, 1337397160] Looping around the photos to save general results len do output : 10 /1337447786.Didn't retrieve data . /1337447785.Didn't retrieve data . /1337447782.Didn't retrieve data . /1337447779.Didn't retrieve data . /1337398186.Didn't retrieve data . /1337398185.Didn't retrieve data . /1337398181.Didn't retrieve data . /1337398178.Didn't retrieve data . /1337397168.Didn't retrieve data . /1337397160.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337447786', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337447785', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337447782', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337447779', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337398186', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337398185', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337398181', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337398178', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337397168', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337397160', None, None, None, None, None, '2584405') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 30 time used for this insertion : 0.019619226455688477 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11317276954650879 time spend to save output : 0.020390987396240234 total time spend for step 5 : 0.13356375694274902 step6:blur_detection Fri Feb 14 01:46:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284.jpg resize: (2160, 3264) 1337447786 -3.775256694980243 treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0.jpg resize: (2160, 3264) 1337447785 -3.84595497804747 treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9.jpg resize: (2160, 3264) 1337447782 -4.840055817312127 treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876.jpg resize: (2160, 3264) 1337447779 -3.2731126234873527 treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e.jpg resize: (2160, 3264) 1337398186 -4.126384590773684 treat image : temp/1739493630_2518645_1337398185_9aac07182f0517719a45a2f915b59ba3.jpg resize: (2160, 3264) 1337398185 -3.7489379402330547 treat image : temp/1739493630_2518645_1337398181_27e5c31857c90c134aa575efbcf8df0d.jpg resize: (2160, 3264) 1337398181 -3.3437961890019703 treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af.jpg resize: (2160, 3264) 1337398178 -4.878244692542967 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d.jpg resize: (2160, 3264) 1337397168 -4.977529553413778 treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4.jpg resize: (2160, 3264) 1337397160 -3.6551880759635718 treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127873_0.png resize: (39, 85) 1337485211 0.6833402408059527 treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127857_0.png resize: (232, 291) 1337485212 -0.3372202773475968 treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127871_0.png resize: (103, 120) 1337485213 -1.7668698968355347 treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127858_0.png resize: (370, 234) 1337485214 -2.52747585032722 treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127860_0.png resize: (139, 112) 1337485215 -2.531403010673935 treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127869_0.png resize: (292, 182) 1337485216 -2.507920478151736 treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127862_0.png resize: (76, 68) 1337485217 -0.7216275415561779 treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127874_0.png resize: (91, 172) 1337485218 -3.772991182670814 treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127864_0.png resize: (66, 249) 1337485220 -2.824651926859447 treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127868_0.png resize: (435, 222) 1337485223 -3.7398478165552542 treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127863_0.png resize: (103, 101) 1337485224 -3.4173243281361696 treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127876_0.png resize: (200, 140) 1337485225 -1.693116597192078 treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127885_0.png resize: (135, 129) 1337485226 -2.5917215854926106 treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127888_0.png resize: (124, 145) 1337485227 -3.834310338886539 treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127878_0.png resize: (280, 178) 1337485228 -4.287281943488122 treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127877_0.png resize: (185, 121) 1337485229 -3.6418686526754014 treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127880_0.png resize: (453, 231) 1337485230 -2.9465320397012795 treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127891_0.png resize: (161, 89) 1337485231 -2.0872874354631232 treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127879_0.png resize: (625, 392) 1337485232 -3.155134922403387 treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127884_0.png resize: (471, 705) 1337485233 -2.086666656668518 treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127887_0.png resize: (298, 235) 1337485234 -1.4977192317795989 treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127881_0.png resize: (482, 600) 1337485235 -1.8109595639983063 treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127893_0.png resize: (164, 81) 1337485236 -0.4650120676418346 treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127911_0.png resize: (174, 134) 1337485237 -3.1899353230848817 treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127895_0.png resize: (129, 175) 1337485238 1.4102447675926268 treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127901_0.png resize: (543, 724) 1337485239 -3.669299676339241 treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876_rle_crop_3674127913_0.png resize: (316, 265) 1337485240 -2.462761736862649 treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876_rle_crop_3674127916_0.png resize: (79, 72) 1337485241 0.3067315859407326 treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876_rle_crop_3674127915_0.png resize: (296, 249) 1337485242 -4.110002750958467 treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876_rle_crop_3674127921_0.png resize: (147, 108) 1337485243 -3.603696899454804 treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876_rle_crop_3674127925_0.png resize: (451, 629) 1337485244 -1.8307869205241718 treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127930_0.png resize: (315, 253) 1337485245 -1.7039594338106818 treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127934_0.png resize: (156, 107) 1337485246 -1.5995102010028628 treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127938_0.png resize: (351, 490) 1337485247 -2.8072514125347885 treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127928_0.png resize: (354, 454) 1337485248 -1.085251435225679 treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127935_0.png resize: (272, 314) 1337485249 -3.38813208393333 treat image : temp/1739493630_2518645_1337398185_9aac07182f0517719a45a2f915b59ba3_rle_crop_3674127957_0.png resize: (176, 307) 1337485250 -2.766538640797261 treat image : temp/1739493630_2518645_1337398185_9aac07182f0517719a45a2f915b59ba3_rle_crop_3674127956_0.png resize: (130, 225) 1337485251 -3.5953277886237753 treat image : temp/1739493630_2518645_1337398185_9aac07182f0517719a45a2f915b59ba3_rle_crop_3674127954_0.png resize: (822, 1024) 1337485252 -2.8350235595477535 treat image : temp/1739493630_2518645_1337398185_9aac07182f0517719a45a2f915b59ba3_rle_crop_3674127952_0.png resize: (123, 105) 1337485253 -3.5598201120617086 treat image : temp/1739493630_2518645_1337398185_9aac07182f0517719a45a2f915b59ba3_rle_crop_3674127953_0.png resize: (331, 137) 1337485254 -2.4070315923851306 treat image : temp/1739493630_2518645_1337398185_9aac07182f0517719a45a2f915b59ba3_rle_crop_3674127948_0.png resize: (151, 172) 1337485255 -2.705973526780101 treat image : temp/1739493630_2518645_1337398185_9aac07182f0517719a45a2f915b59ba3_rle_crop_3674127951_0.png resize: (390, 406) 1337485256 -3.0067842555914477 treat image : temp/1739493630_2518645_1337398185_9aac07182f0517719a45a2f915b59ba3_rle_crop_3674127950_0.png resize: (567, 439) 1337485257 -1.3849522959640461 treat image : temp/1739493630_2518645_1337398181_27e5c31857c90c134aa575efbcf8df0d_rle_crop_3674127958_0.png resize: (215, 137) 1337485258 -2.471268246528596 treat image : temp/1739493630_2518645_1337398181_27e5c31857c90c134aa575efbcf8df0d_rle_crop_3674127964_0.png resize: (372, 306) 1337485259 -2.189738863109111 treat image : temp/1739493630_2518645_1337398181_27e5c31857c90c134aa575efbcf8df0d_rle_crop_3674127968_0.png resize: (134, 286) 1337485260 -2.414750281854181 treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127986_0.png resize: (80, 164) 1337485261 -2.7095200343459926 treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127971_0.png resize: (206, 250) 1337485262 -3.4678302662133853 treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127983_0.png resize: (310, 305) 1337485263 -2.0494420568065648 treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127980_0.png resize: (150, 147) 1337485264 -3.001659100712275 treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127985_0.png resize: (150, 270) 1337485265 -3.744926961359344 treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127976_0.png resize: (137, 175) 1337485266 -2.2246017192850034 treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127978_0.png resize: (95, 132) 1337485267 -2.0029111867726286 treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127981_0.png resize: (257, 664) 1337485268 -3.6138722791965074 treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127977_0.png resize: (216, 214) 1337485269 -2.1656642097194867 treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127970_0.png resize: (231, 114) 1337485270 -2.0413658155336187 treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127974_0.png resize: (308, 358) 1337485271 -2.5231289919284223 treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127979_0.png resize: (128, 118) 1337485272 -3.351088107022264 treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127975_0.png resize: (121, 75) 1337485273 -2.8413932958664407 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674127995_0.png resize: (167, 141) 1337485274 -3.432656208049799 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128037_0.png resize: (83, 101) 1337485275 -3.4986936592959257 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128006_0.png resize: (172, 137) 1337485276 -2.9475157929657163 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674127990_0.png resize: (195, 110) 1337485277 -2.514404227644107 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128020_0.png resize: (168, 145) 1337485278 -1.7523168253277193 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128022_0.png resize: (321, 270) 1337485279 -3.2397844475120015 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128027_0.png resize: (81, 86) 1337485280 -2.0755686964683466 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128015_0.png resize: (303, 169) 1337485281 -3.028797823325782 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128010_0.png resize: (218, 142) 1337485282 -2.1218457268429214 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128023_0.png resize: (160, 91) 1337485283 -3.472745646342965 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128038_0.png resize: (145, 201) 1337485284 -3.465265433651177 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128002_0.png resize: (163, 151) 1337485285 -2.774635073309588 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674127993_0.png resize: (93, 169) 1337485286 -2.6786266481994483 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128011_0.png resize: (317, 392) 1337485287 -3.366883261142357 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128036_0.png resize: (133, 231) 1337485288 -3.3529290028579952 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128024_0.png resize: (94, 102) 1337485289 -2.3463381593513857 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128030_0.png resize: (141, 209) 1337485290 -2.1800105387288267 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128018_0.png resize: (269, 310) 1337485291 -3.6210881003278486 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128009_0.png resize: (182, 109) 1337485292 -2.508737768798118 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128016_0.png resize: (190, 260) 1337485293 -3.3959898557593395 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128003_0.png resize: (73, 130) 1337485294 -3.1395879741661803 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128033_0.png resize: (226, 121) 1337485295 -3.983515271555371 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128034_0.png resize: (83, 82) 1337485296 -3.2836832587240368 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674127996_0.png resize: (272, 199) 1337485297 -2.6474109524283915 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128000_0.png resize: (146, 178) 1337485298 -2.8382050492469846 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674127987_0.png resize: (226, 365) 1337485299 -2.9242910371207995 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674127999_0.png resize: (190, 200) 1337485300 -3.8742100120775396 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128008_0.png resize: (131, 197) 1337485301 -2.7622010059709354 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128012_0.png resize: (265, 181) 1337485302 -2.874732375394422 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674127991_0.png resize: (234, 306) 1337485303 -1.5662124827476853 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128028_0.png resize: (68, 140) 1337485304 -3.0207934098394733 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674127988_0.png resize: (128, 187) 1337485305 -2.4425442366650927 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674127997_0.png resize: (186, 197) 1337485306 -2.920640299356899 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128025_0.png resize: (83, 100) 1337485307 -3.0811201452620156 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128026_0.png resize: (246, 188) 1337485308 -4.095378800197947 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674127989_0.png resize: (183, 181) 1337485309 -3.148837948292182 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128035_0.png resize: (170, 128) 1337485310 -2.8821605213723602 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674127992_0.png resize: (93, 88) 1337485311 -4.121583230515109 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128007_0.png resize: (210, 233) 1337485312 -2.763790619956916 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128004_0.png resize: (179, 139) 1337485313 -2.863280397086114 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674127998_0.png resize: (83, 106) 1337485314 -3.8350361509381106 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128017_0.png resize: (69, 75) 1337485315 -2.9988259809930042 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128013_0.png resize: (246, 161) 1337485316 -3.4775114019268436 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128031_0.png resize: (172, 172) 1337485317 -4.9113342773596145 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128005_0.png resize: (215, 209) 1337485318 -3.672641294984304 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674127994_0.png resize: (170, 161) 1337485319 -3.903981073407253 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128014_0.png resize: (198, 205) 1337485320 -2.7542736941509425 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128019_0.png resize: (108, 87) 1337485321 -0.8573557825760344 treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128048_0.png resize: (186, 230) 1337485322 -3.776408384372002 treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128056_0.png resize: (85, 168) 1337485323 -1.6050224121864722 treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128044_0.png resize: (297, 120) 1337485324 -2.9793718634489417 treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128047_0.png resize: (222, 90) 1337485325 -1.9093722172087677 treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128059_0.png resize: (175, 359) 1337485326 -5.070032412679589 treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128041_0.png resize: (346, 599) 1337485327 -1.634570822567488 treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128042_0.png resize: (288, 275) 1337485328 -1.8862350286883451 treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128039_0.png resize: (273, 263) 1337485329 0.02595394886530625 treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128052_0.png resize: (143, 227) 1337485330 -1.3973922036145545 treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128049_0.png resize: (279, 214) 1337485331 -3.201517258871008 treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128054_0.png resize: (145, 118) 1337485332 -2.0946083077185835 treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128058_0.png resize: (138, 158) 1337485333 -1.614545681690971 treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127872_0.png resize: (410, 272) 1337485366 -2.1523432503027586 treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127875_0.png resize: (155, 90) 1337485367 -1.4627186530680265 treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127870_0.png resize: (260, 201) 1337485368 -2.1143511013529643 treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127867_0.png resize: (149, 79) 1337485369 -2.908179341227244 treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127859_0.png resize: (758, 926) 1337485370 -4.186636663925116 treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127861_0.png resize: (126, 174) 1337485371 -1.4881232487681944 treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127883_0.png resize: (85, 91) 1337485372 -3.250380268205831 treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127894_0.png resize: (306, 262) 1337485373 -1.7634041281826458 treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127909_0.png resize: (222, 327) 1337485374 -4.819969609429064 treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127897_0.png resize: (251, 329) 1337485375 -2.114519207933501 treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127910_0.png resize: (80, 125) 1337485376 -1.1243886905421163 treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876_rle_crop_3674127918_0.png resize: (203, 114) 1337485377 -2.9295864162941783 treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876_rle_crop_3674127919_0.png resize: (91, 139) 1337485378 -3.255581598715982 treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876_rle_crop_3674127917_0.png resize: (99, 224) 1337485379 -3.8809960194644875 treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127937_0.png resize: (179, 125) 1337485380 -1.6180008809754516 treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127944_0.png resize: (325, 189) 1337485381 -1.1149386272135178 treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127940_0.png resize: (434, 527) 1337485382 -1.8341756483075307 treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127927_0.png resize: (93, 283) 1337485383 -1.3861283276555239 treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127931_0.png resize: (470, 413) 1337485384 -3.010036778342066 treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127933_0.png resize: (169, 237) 1337485385 -3.1848834391927214 treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127945_0.png resize: (962, 681) 1337485386 -3.638869614693768 treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127926_0.png resize: (190, 288) 1337485387 -3.6952378789566556 treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127936_0.png resize: (217, 172) 1337485388 -2.7101629558170828 treat image : temp/1739493630_2518645_1337398185_9aac07182f0517719a45a2f915b59ba3_rle_crop_3674127949_0.png resize: (267, 270) 1337485389 -3.6532088398922453 treat image : temp/1739493630_2518645_1337398185_9aac07182f0517719a45a2f915b59ba3_rle_crop_3674127955_0.png resize: (323, 225) 1337485390 -2.414469012739983 treat image : temp/1739493630_2518645_1337398185_9aac07182f0517719a45a2f915b59ba3_rle_crop_3674127947_0.png resize: (145, 184) 1337485391 -2.7584211651983392 treat image : temp/1739493630_2518645_1337398185_9aac07182f0517719a45a2f915b59ba3_rle_crop_3674127946_0.png resize: (277, 418) 1337485392 -2.1755319707010203 treat image : temp/1739493630_2518645_1337398181_27e5c31857c90c134aa575efbcf8df0d_rle_crop_3674127967_0.png resize: (128, 138) 1337485393 -0.8519201973244677 treat image : temp/1739493630_2518645_1337398181_27e5c31857c90c134aa575efbcf8df0d_rle_crop_3674127961_0.png resize: (718, 291) 1337485394 -2.4329324440330033 treat image : temp/1739493630_2518645_1337398181_27e5c31857c90c134aa575efbcf8df0d_rle_crop_3674127962_0.png resize: (551, 456) 1337485395 -2.100382101142026 treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127972_0.png resize: (147, 121) 1337485396 -2.09902516436372 treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127984_0.png resize: (136, 178) 1337485397 -2.1315443113279744 treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127982_0.png resize: (126, 314) 1337485398 -2.9328277162497955 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128029_0.png resize: (67, 184) 1337485399 -3.180765117369281 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128001_0.png resize: (276, 186) 1337485400 -2.4117560242579112 treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128051_0.png resize: (778, 437) 1337485401 -2.217090722618962 treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128046_0.png resize: (152, 76) 1337485402 -1.3134189813751187 treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128055_0.png resize: (130, 189) 1337485403 -2.5262698947618656 treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128040_0.png resize: (145, 141) 1337485404 -4.3005898735895025 treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128043_0.png resize: (210, 328) 1337485405 -2.590237506135288 treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128045_0.png resize: (132, 176) 1337485406 -3.122981353952398 treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128060_0.png resize: (200, 273) 1337485407 -3.468478770984581 treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127865_0.png resize: (193, 215) 1337485409 -4.165309937310049 treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127866_0.png resize: (231, 103) 1337485423 -3.580432966901655 treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127892_0.png resize: (301, 159) 1337485424 -2.6275111995940015 treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127889_0.png resize: (791, 326) 1337485425 -5.785924075362194 treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127882_0.png resize: (237, 168) 1337485426 -4.2011113988641435 treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127900_0.png resize: (345, 321) 1337485427 -4.111990836477185 treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127899_0.png resize: (247, 325) 1337485428 -3.141121597309407 treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127912_0.png resize: (120, 314) 1337485429 -2.6487273031132736 treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127902_0.png resize: (426, 567) 1337485430 -2.4566371650111263 treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127898_0.png resize: (432, 475) 1337485431 -2.540801224410807 treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127896_0.png resize: (267, 340) 1337485432 -2.674592543492058 treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127907_0.png resize: (528, 321) 1337485433 -1.6228949099044028 treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127906_0.png resize: (499, 283) 1337485434 -2.7310138368255092 treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127903_0.png resize: (639, 712) 1337485435 -2.6090274214288516 treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127904_0.png resize: (324, 295) 1337485436 -3.385229634565684 treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127905_0.png resize: (197, 237) 1337485437 -2.2506458664587243 treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876_rle_crop_3674127920_0.png resize: (551, 281) 1337485438 -2.9029561820787557 treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876_rle_crop_3674127922_0.png resize: (636, 672) 1337485439 -2.3875498611856085 treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876_rle_crop_3674127924_0.png resize: (266, 293) 1337485440 -3.1475618305275583 treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876_rle_crop_3674127914_0.png resize: (318, 427) 1337485441 -3.0836134428089084 treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127929_0.png resize: (586, 394) 1337485442 -4.801382646120416 treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127943_0.png resize: (231, 575) 1337485443 -2.678046654639269 treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127942_0.png resize: (374, 413) 1337485444 -2.22715071002005 treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127939_0.png resize: (343, 729) 1337485445 -3.670892720590018 treat image : temp/1739493630_2518645_1337398181_27e5c31857c90c134aa575efbcf8df0d_rle_crop_3674127959_0.png resize: (341, 250) 1337485446 -3.1657711144048637 treat image : temp/1739493630_2518645_1337398181_27e5c31857c90c134aa575efbcf8df0d_rle_crop_3674127963_0.png resize: (419, 663) 1337485447 -2.049205291685695 treat image : temp/1739493630_2518645_1337398181_27e5c31857c90c134aa575efbcf8df0d_rle_crop_3674127960_0.png resize: (765, 467) 1337485448 -1.8779659740558525 treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127973_0.png resize: (372, 428) 1337485449 -4.270687003270752 treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128050_0.png resize: (525, 530) 1337485450 -4.463277195121333 treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127886_0.png resize: (124, 130) 1337485452 -1.603273506171068 treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127941_0.png resize: (413, 358) 1337485453 -1.645173462019794 treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127932_0.png resize: (443, 393) 1337485454 -3.2545785132185596 treat image : temp/1739493630_2518645_1337398181_27e5c31857c90c134aa575efbcf8df0d_rle_crop_3674127969_0.png resize: (227, 203) 1337485455 -3.01420002611801 treat image : temp/1739493630_2518645_1337398181_27e5c31857c90c134aa575efbcf8df0d_rle_crop_3674127966_0.png resize: (165, 177) 1337485456 -4.463833235206711 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128021_0.png resize: (169, 152) 1337485457 -1.6034295745087541 treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128032_0.png resize: (104, 209) 1337485458 -3.34324446666312 treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876_rle_crop_3674127923_0.png resize: (319, 241) 1337485459 -3.742654750124724 treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128057_0.png resize: (196, 234) 1337485460 -0.7776465453701881 treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127890_0.png resize: (188, 167) 1337485461 -2.5524063802933736 treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127908_0.png resize: (162, 143) 1337485462 -3.807440255417939 treat image : temp/1739493630_2518645_1337398181_27e5c31857c90c134aa575efbcf8df0d_rle_crop_3674127965_0.png resize: (135, 488) 1337485463 -3.1529855569070353 treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128053_0.png resize: (135, 167) 1337485464 -4.114919804739824 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 214 time used for this insertion : 0.02898693084716797 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 214 time used for this insertion : 0.07123351097106934 save missing photos in datou_result : time spend for datou_step_exec : 34.167062282562256 time spend to save output : 0.10728216171264648 total time spend for step 6 : 34.2743444442749 step7:brightness Fri Feb 14 01:47:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284.jpg treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0.jpg treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9.jpg treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876.jpg treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e.jpg treat image : temp/1739493630_2518645_1337398185_9aac07182f0517719a45a2f915b59ba3.jpg treat image : temp/1739493630_2518645_1337398181_27e5c31857c90c134aa575efbcf8df0d.jpg treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af.jpg treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d.jpg treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4.jpg treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127873_0.png treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127857_0.png treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127871_0.png treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127858_0.png treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127860_0.png treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127869_0.png treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127862_0.png treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127874_0.png treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127864_0.png treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127868_0.png treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127863_0.png treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127876_0.png treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127885_0.png treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127888_0.png treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127878_0.png treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127877_0.png treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127880_0.png treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127891_0.png treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127879_0.png treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127884_0.png treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127887_0.png treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127881_0.png treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127893_0.png treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127911_0.png treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127895_0.png treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127901_0.png treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876_rle_crop_3674127913_0.png treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876_rle_crop_3674127916_0.png treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876_rle_crop_3674127915_0.png treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876_rle_crop_3674127921_0.png treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876_rle_crop_3674127925_0.png treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127930_0.png treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127934_0.png treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127938_0.png treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127928_0.png treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127935_0.png treat image : temp/1739493630_2518645_1337398185_9aac07182f0517719a45a2f915b59ba3_rle_crop_3674127957_0.png treat image : temp/1739493630_2518645_1337398185_9aac07182f0517719a45a2f915b59ba3_rle_crop_3674127956_0.png treat image : temp/1739493630_2518645_1337398185_9aac07182f0517719a45a2f915b59ba3_rle_crop_3674127954_0.png treat image : temp/1739493630_2518645_1337398185_9aac07182f0517719a45a2f915b59ba3_rle_crop_3674127952_0.png treat image : temp/1739493630_2518645_1337398185_9aac07182f0517719a45a2f915b59ba3_rle_crop_3674127953_0.png treat image : temp/1739493630_2518645_1337398185_9aac07182f0517719a45a2f915b59ba3_rle_crop_3674127948_0.png treat image : temp/1739493630_2518645_1337398185_9aac07182f0517719a45a2f915b59ba3_rle_crop_3674127951_0.png treat image : temp/1739493630_2518645_1337398185_9aac07182f0517719a45a2f915b59ba3_rle_crop_3674127950_0.png treat image : temp/1739493630_2518645_1337398181_27e5c31857c90c134aa575efbcf8df0d_rle_crop_3674127958_0.png treat image : temp/1739493630_2518645_1337398181_27e5c31857c90c134aa575efbcf8df0d_rle_crop_3674127964_0.png treat image : temp/1739493630_2518645_1337398181_27e5c31857c90c134aa575efbcf8df0d_rle_crop_3674127968_0.png treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127986_0.png treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127971_0.png treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127983_0.png treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127980_0.png treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127985_0.png treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127976_0.png treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127978_0.png treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127981_0.png treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127977_0.png treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127970_0.png treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127974_0.png treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127979_0.png treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127975_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674127995_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128037_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128006_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674127990_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128020_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128022_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128027_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128015_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128010_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128023_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128038_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128002_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674127993_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128011_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128036_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128024_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128030_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128018_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128009_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128016_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128003_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128033_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128034_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674127996_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128000_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674127987_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674127999_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128008_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128012_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674127991_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128028_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674127988_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674127997_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128025_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128026_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674127989_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128035_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674127992_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128007_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128004_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674127998_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128017_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128013_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128031_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128005_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674127994_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128014_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128019_0.png treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128048_0.png treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128056_0.png treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128044_0.png treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128047_0.png treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128059_0.png treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128041_0.png treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128042_0.png treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128039_0.png treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128052_0.png treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128049_0.png treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128054_0.png treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128058_0.png treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127872_0.png treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127875_0.png treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127870_0.png treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127867_0.png treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127859_0.png treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127861_0.png treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127883_0.png treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127894_0.png treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127909_0.png treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127897_0.png treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127910_0.png treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876_rle_crop_3674127918_0.png treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876_rle_crop_3674127919_0.png treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876_rle_crop_3674127917_0.png treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127937_0.png treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127944_0.png treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127940_0.png treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127927_0.png treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127931_0.png treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127933_0.png treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127945_0.png treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127926_0.png treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127936_0.png treat image : temp/1739493630_2518645_1337398185_9aac07182f0517719a45a2f915b59ba3_rle_crop_3674127949_0.png treat image : temp/1739493630_2518645_1337398185_9aac07182f0517719a45a2f915b59ba3_rle_crop_3674127955_0.png treat image : temp/1739493630_2518645_1337398185_9aac07182f0517719a45a2f915b59ba3_rle_crop_3674127947_0.png treat image : temp/1739493630_2518645_1337398185_9aac07182f0517719a45a2f915b59ba3_rle_crop_3674127946_0.png treat image : temp/1739493630_2518645_1337398181_27e5c31857c90c134aa575efbcf8df0d_rle_crop_3674127967_0.png treat image : temp/1739493630_2518645_1337398181_27e5c31857c90c134aa575efbcf8df0d_rle_crop_3674127961_0.png treat image : temp/1739493630_2518645_1337398181_27e5c31857c90c134aa575efbcf8df0d_rle_crop_3674127962_0.png treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127972_0.png treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127984_0.png treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127982_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128029_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128001_0.png treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128051_0.png treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128046_0.png treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128055_0.png treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128040_0.png treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128043_0.png treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128045_0.png treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128060_0.png treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127865_0.png treat image : temp/1739493630_2518645_1337447786_56e6014ee967b5141d325e81a9b78284_rle_crop_3674127866_0.png treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127892_0.png treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127889_0.png treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127882_0.png treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127900_0.png treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127899_0.png treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127912_0.png treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127902_0.png treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127898_0.png treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127896_0.png treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127907_0.png treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127906_0.png treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127903_0.png treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127904_0.png treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127905_0.png treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876_rle_crop_3674127920_0.png treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876_rle_crop_3674127922_0.png treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876_rle_crop_3674127924_0.png treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876_rle_crop_3674127914_0.png treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127929_0.png treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127943_0.png treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127942_0.png treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127939_0.png treat image : temp/1739493630_2518645_1337398181_27e5c31857c90c134aa575efbcf8df0d_rle_crop_3674127959_0.png treat image : temp/1739493630_2518645_1337398181_27e5c31857c90c134aa575efbcf8df0d_rle_crop_3674127963_0.png treat image : temp/1739493630_2518645_1337398181_27e5c31857c90c134aa575efbcf8df0d_rle_crop_3674127960_0.png treat image : temp/1739493630_2518645_1337398178_0f2c9d9b939dfcca887f1307178558af_rle_crop_3674127973_0.png treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128050_0.png treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127886_0.png treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127941_0.png treat image : temp/1739493630_2518645_1337398186_121cd2285823620f49a0fc5d9d04bc1e_rle_crop_3674127932_0.png treat image : temp/1739493630_2518645_1337398181_27e5c31857c90c134aa575efbcf8df0d_rle_crop_3674127969_0.png treat image : temp/1739493630_2518645_1337398181_27e5c31857c90c134aa575efbcf8df0d_rle_crop_3674127966_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128021_0.png treat image : temp/1739493630_2518645_1337397168_09ed440f3895fd9418cda122c3b17d4d_rle_crop_3674128032_0.png treat image : temp/1739493630_2518645_1337447779_84718d1be5f5f5201e341124d999f876_rle_crop_3674127923_0.png treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128057_0.png treat image : temp/1739493630_2518645_1337447785_1cdfc166caa2aeb1773fef15869728c0_rle_crop_3674127890_0.png treat image : temp/1739493630_2518645_1337447782_1b97e5e93a81acee581b900ca3823ee9_rle_crop_3674127908_0.png treat image : temp/1739493630_2518645_1337398181_27e5c31857c90c134aa575efbcf8df0d_rle_crop_3674127965_0.png treat image : temp/1739493630_2518645_1337397160_39148ce2e2501f507f8f23f07eec81f4_rle_crop_3674128053_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 214 time used for this insertion : 0.01945805549621582 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 214 time used for this insertion : 0.057798147201538086 save missing photos in datou_result : time spend for datou_step_exec : 9.87417459487915 time spend to save output : 0.08270096778869629 total time spend for step 7 : 9.956875562667847 step8:velours_tree Fri Feb 14 01:47:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 0.840522050857544 time spend to save output : 2.9325485229492188e-05 total time spend for step 8 : 0.8405513763427734 step9:send_mail_cod Fri Feb 14 01:47:38 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P20528940_14-02-2025_01_47_38.pdf 20531995 imagette205319951739494058 20531996 change filename to text .change filename to text .imagette205319961739494058 20531997 imagette205319971739494058 20531999 imagette205319991739494058 20532000 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205320001739494058 20532001 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205320011739494059 20532002 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205320021739494060 20532003 change filename to text .change filename to text .change filename to text .change filename to text .imagette205320031739494061 20532004 change filename to text .imagette205320041739494061 20532005 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205320051739494061 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20528940 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20531995,20531996,20531997,20531998,20531999,20532000,20532001,20532002,20532003,20532004,20532005?tags=mal_croppe,pehd,background,environnement,flou,carton,autre,papier,pet_fonce,metal,pet_clair args[1337447786] : ((1337447786, -3.775256694980243, 492609224), (1337447786, -0.30177345702968345, 496442774), '0.15148570828794478') apple ((1337447786, -3.775256694980243, 492609224), (1337447786, -0.30177345702968345, 496442774), '0.15148570828794478') We are sending mail with results at report@fotonower.com args[1337447785] : ((1337447785, -3.84595497804747, 492609224), (1337447785, -0.376286205790847, 496442774), '0.15148570828794478') apple ((1337447785, -3.84595497804747, 492609224), (1337447785, -0.376286205790847, 496442774), '0.15148570828794478') We are sending mail with results at report@fotonower.com args[1337447782] : ((1337447782, -4.840055817312127, 492609224), (1337447782, -0.2586056143308488, 496442774), '0.15148570828794478') apple ((1337447782, -4.840055817312127, 492609224), (1337447782, -0.2586056143308488, 496442774), '0.15148570828794478') We are sending mail with results at report@fotonower.com args[1337447779] : ((1337447779, -3.2731126234873527, 492609224), (1337447779, -0.5749168468052537, 501862349), '0.15148570828794478') apple ((1337447779, -3.2731126234873527, 492609224), (1337447779, -0.5749168468052537, 501862349), '0.15148570828794478') We are sending mail with results at report@fotonower.com args[1337398186] : ((1337398186, -4.126384590773684, 492609224), (1337398186, -0.21009875576546994, 496442774), '0.15148570828794478') apple ((1337398186, -4.126384590773684, 492609224), (1337398186, -0.21009875576546994, 496442774), '0.15148570828794478') We are sending mail with results at report@fotonower.com args[1337398185] : ((1337398185, -3.7489379402330547, 492609224), (1337398185, -0.2950761432559678, 496442774), '0.15148570828794478') apple ((1337398185, -3.7489379402330547, 492609224), (1337398185, -0.2950761432559678, 496442774), '0.15148570828794478') We are sending mail with results at report@fotonower.com args[1337398181] : ((1337398181, -3.3437961890019703, 492609224), (1337398181, -0.2901150642768117, 496442774), '0.15148570828794478') apple ((1337398181, -3.3437961890019703, 492609224), (1337398181, -0.2901150642768117, 496442774), '0.15148570828794478') We are sending mail with results at report@fotonower.com args[1337398178] : ((1337398178, -4.878244692542967, 492609224), (1337398178, -0.2798248992516819, 496442774), '0.15148570828794478') apple ((1337398178, -4.878244692542967, 492609224), (1337398178, -0.2798248992516819, 496442774), '0.15148570828794478') We are sending mail with results at report@fotonower.com args[1337397168] : ((1337397168, -4.977529553413778, 492609224), (1337397168, -0.23112061680364127, 496442774), '0.15148570828794478') apple ((1337397168, -4.977529553413778, 492609224), (1337397168, -0.23112061680364127, 496442774), '0.15148570828794478') We are sending mail with results at report@fotonower.com args[1337397160] : ((1337397160, -3.6551880759635718, 492609224), (1337397160, -0.4147007497928393, 496442774), '0.15148570828794478') apple ((1337397160, -3.6551880759635718, 492609224), (1337397160, -0.4147007497928393, 496442774), '0.15148570828794478') We are sending mail with results at report@fotonower.com refus_total : 0.15148570828794478 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20528940 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1337398181,1337398185,1337398186,1337447779,1337447782,1337397160,1337397168,1337398178,1337447785,1337447786) Found this number of photos: 10 begin to download photo : 1337398181 begin to download photo : 1337447779 begin to download photo : 1337397168 begin to download photo : 1337447786 download finish for photo 1337447786 download finish for photo 1337397168 begin to download photo : 1337398178 download finish for photo 1337447779 begin to download photo : 1337447782 download finish for photo 1337398181 begin to download photo : 1337398185 download finish for photo 1337447782 begin to download photo : 1337397160 download finish for photo 1337398178 begin to download photo : 1337447785 download finish for photo 1337398185 begin to download photo : 1337398186 download finish for photo 1337397160 download finish for photo 1337398186 download finish for photo 1337447785 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528940_14-02-2025_01_47_38.pdf results_Auto_P20528940_14-02-2025_01_47_38.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528940_14-02-2025_01_47_38.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','20528940','results_Auto_P20528940_14-02-2025_01_47_38.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528940_14-02-2025_01_47_38.pdf','pdf','','0.92','0.15148570828794478') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/20528940

https://www.fotonower.com/image?json=false&list_photos_id=1337447786
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337447785
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337447782
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337447779
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337398186
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337398185
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337398181
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337398178
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337397168
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1337397160
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 15.15%
Veuillez trouver les photos des contaminants.

exemples de contaminants: pehd: https://www.fotonower.com/view/20531996?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/20532000?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/20532001?limit=200
exemples de contaminants: papier: https://www.fotonower.com/view/20532002?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/20532003?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/20532004?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/20532005?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528940_14-02-2025_01_47_38.pdf.

Lien vers velours :https://www.fotonower.com/velours/20531995,20531996,20531997,20531998,20531999,20532000,20532001,20532002,20532003,20532004,20532005?tags=mal_croppe,pehd,background,environnement,flou,carton,autre,papier,pet_fonce,metal,pet_clair.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 14 Feb 2025 00:47:46 GMT Content-Length: 0 Connection: close X-Message-Id: 2RMPL2mpSc2qV_JaXa6MKw Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1337447786, 1337447785, 1337447782, 1337447779, 1337398186, 1337398185, 1337398181, 1337398178, 1337397168, 1337397160] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337447786', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337447785', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337447782', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337447779', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337398186', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337398185', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337398181', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337398178', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337397168', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337397160', None, None, None, None, None, '2584405') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 10 time used for this insertion : 0.015812397003173828 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.382369756698608 time spend to save output : 0.01600050926208496 total time spend for step 9 : 8.398370265960693 step10:split_time_score Fri Feb 14 01:47:46 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 10),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 13022025 20528940 Nombre de photos uploadées : 10 / 23040 (0%) 13022025 20528940 Nombre de photos taguées (types de déchets): 0 / 10 (0%) 13022025 20528940 Nombre de photos taguées (volume) : 0 / 10 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 4.291534423828125e-06 ?????????? elapsed_time : fill_and_build_computed_from_old_data 0.00038886070251464844 elapsed_time : insert_dashboard_record_day_entry 0.024693727493286133 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.12214087747367464 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528847_14-02-2025_01_46_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528847 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528847 AND mptpi.`type`=3594 To do Qualite : 0.14136086604967552 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20503797_13-02-2025_09_15_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20503797 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20503797 AND mptpi.`type`=3594 To do Qualite : 0.14449458458151784 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20503799_13-02-2025_09_01_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20503799 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20503799 AND mptpi.`type`=3594 To do Qualite : 0.07891361257373916 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528860_14-02-2025_00_50_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528860 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528860 AND mptpi.`type`=3726 To do Qualite : 0.13077788841230933 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528862_14-02-2025_01_17_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528862 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528862 AND mptpi.`type`=3594 To do Qualite : 0.13281513190409905 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528869_14-02-2025_00_57_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528869 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528869 AND mptpi.`type`=3594 To do Qualite : 0.12365535073983296 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528871_14-02-2025_01_08_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528871 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528871 AND mptpi.`type`=3594 To do Qualite : 0.17378304379236262 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528872_14-02-2025_00_48_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528872 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528872 AND mptpi.`type`=3594 To do Qualite : 0.15148570828794478 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528940_14-02-2025_01_47_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528940 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528940 AND mptpi.`type`=3594 To do Qualite : 0.06743200877946215 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528945_14-02-2025_00_17_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528945 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528945 AND mptpi.`type`=3726 To do Qualite : 0.14551669770917627 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20528952_14-02-2025_00_32_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528952 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20528952 AND mptpi.`type`=3594 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20528954 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'13022025': {'nb_upload': 10, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1337447786, 1337447785, 1337447782, 1337447779, 1337398186, 1337398185, 1337398181, 1337398178, 1337397168, 1337397160] Looping around the photos to save general results len do output : 1 /20528940Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337447786', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337447785', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337447782', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337447779', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337398186', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337398185', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337398181', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337398178', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337397168', None, None, None, None, None, '2584405') ('3318', None, None, None, None, None, None, None, '2584405') ('3318', '20528940', '1337397160', None, None, None, None, None, '2584405') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 11 time used for this insertion : 0.016373157501220703 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.646698236465454 time spend to save output : 0.016524076461791992 total time spend for step 10 : 1.663222312927246 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 10 set_done_treatment 187.85user 163.16system 7:23.28elapsed 79%CPU (0avgtext+0avgdata 6762392maxresident)k 1363568inputs+163488outputs (16702major+18040221minor)pagefaults 0swaps