python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 3318 ' -s datou_3318 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 195463 load datou : 3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 3318, datou_cur_ids : ['2601834'] with mtr_portfolio_ids : ['20699408'] and first list_photo_ids : [] new path : /proc/195463/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, crop_condition, rle_unique_nms_with_priority, ventilate_hashtags_in_portfolio, final, blur_detection, brightness, velours_tree, send_mail_cod, split_time_score over limit max, limiting to limit_max 40 list_input_json : [] origin We have 1 , BFBFBFBFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 8 ; length of list_pids : 8 ; length of list_args : 8 time to download the photos : 1.689770221710205 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 10 step1:mask_detect Fri Feb 21 01:00:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 2964 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-21 01:00:34.236415: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-21 01:00:34.269113: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-21 01:00:34.270873: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f7bb4000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-21 01:00:34.270905: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-21 01:00:34.274523: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-21 01:00:34.447977: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x17879ca0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-21 01:00:34.448027: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-21 01:00:34.448878: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-21 01:00:34.449224: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-21 01:00:34.451763: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-21 01:00:34.454390: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-21 01:00:34.455036: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-21 01:00:34.457637: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-21 01:00:34.459000: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-21 01:00:34.463782: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-21 01:00:34.465279: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-21 01:00:34.465414: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-21 01:00:34.466232: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-21 01:00:34.466263: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-21 01:00:34.466279: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-21 01:00:34.467801: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2347 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-21 01:00:34.775380: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-21 01:00:34.775520: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-21 01:00:34.775566: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-21 01:00:34.775602: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-21 01:00:34.775637: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-21 01:00:34.775664: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-21 01:00:34.775686: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-21 01:00:34.775707: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-21 01:00:34.776765: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-21 01:00:34.778043: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-21 01:00:34.778119: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-21 01:00:34.778139: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-21 01:00:34.778157: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-21 01:00:34.778174: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-21 01:00:34.778192: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-21 01:00:34.778209: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-21 01:00:34.778227: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-21 01:00:34.779264: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-21 01:00:34.779312: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-21 01:00:34.779324: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-21 01:00:34.779335: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-21 01:00:34.780357: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 2347 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-21 01:00:46.575689: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-21 01:00:46.777199: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-21 01:00:48.239789: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-21 01:00:48.239860: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-21 01:00:48.246216: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-21 01:00:48.246239: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-21 01:00:48.326871: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-21 01:00:48.326975: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-21 01:00:48.368193: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-21 01:00:48.368237: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.09GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-21 01:00:48.419810: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-21 01:00:48.419870: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.15GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-21 01:00:48.422320: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.29G (1389232128 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.422916: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.16G (1250308864 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.422942: W tensorflow/core/common_runtime/bfc_allocator.cc:311] Garbage collection: deallocate free memory regions (i.e., allocations) so that we can re-allocate a larger region to avoid OOM due to memory fragmentation. If you see this message frequently, you are running near the threshold of the available device memory and re-allocation may incur great performance overhead. You may try smaller batch sizes to observe the performance impact. Set TF_ENABLE_GPU_GARBAGE_COLLECTION=false if you'd like to disable this feature. 2025-02-21 01:00:48.439965: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.440624: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.467853: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.468376: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.469914: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.470448: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.476318: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.476825: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.478521: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.479040: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.484793: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.485313: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.486845: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.487367: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.515697: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.516223: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.516737: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.517249: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.520867: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.521403: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.537567: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.538093: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.538608: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.539131: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.551764: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.552336: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.552870: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.553425: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.558045: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.558759: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.563831: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.564395: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.577098: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.577648: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.581929: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.582488: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.583051: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.583560: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.584374: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.584960: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.595626: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.596215: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.596809: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.597483: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.598363: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.599290: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.615872: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.616437: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.685647: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.686498: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.705412: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.706272: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.707122: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.707942: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.712396: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.713213: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.714057: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.714870: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.716236: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.716257: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-02-21 01:00:48.726428: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.727271: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.736658: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.737480: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.738329: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.739153: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.740001: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-21 01:00:48.740817: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 1.79G (1926103040 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 8 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 20 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 43 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 44 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 29 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 53 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 63 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 75 NEW PHOTO Processing 1 images image shape: (2160, 3264, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 3264.00000 nb d'objets trouves : 47 Detection mask done ! Trying to reset tf kernel 196331 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 574 tf kernel not reseted sub process len(results) : 8 len(list_Values) 0 None max_time_sub_proc : 3600 parent process len(results) : 8 len(list_Values) 0 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 1548 list_Values should be empty [] To do loadFromThcl(), then load ParamDescType : thcl2847 Catched exception ! Connect or reconnect ! thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] time for calcul the mask position with numpy : 0.012958765029907227 nb_pixel_total : 288858 time to create 1 rle with new method : 0.03352069854736328 length of segment : 761 time for calcul the mask position with numpy : 0.0013165473937988281 nb_pixel_total : 96105 time to create 1 rle with old method : 0.10755133628845215 length of segment : 412 time for calcul the mask position with numpy : 0.0004322528839111328 nb_pixel_total : 23983 time to create 1 rle with old method : 0.028584957122802734 length of segment : 204 time for calcul the mask position with numpy : 0.0008378028869628906 nb_pixel_total : 47674 time to create 1 rle with old method : 0.05422639846801758 length of segment : 244 time for calcul the mask position with numpy : 0.0006809234619140625 nb_pixel_total : 43290 time to create 1 rle with old method : 0.04939889907836914 length of segment : 237 time for calcul the mask position with numpy : 0.00016021728515625 nb_pixel_total : 8464 time to create 1 rle with old method : 0.010434627532958984 length of segment : 104 time for calcul the mask position with numpy : 0.0002422332763671875 nb_pixel_total : 14628 time to create 1 rle with old method : 0.016825199127197266 length of segment : 157 time for calcul the mask position with numpy : 0.009460210800170898 nb_pixel_total : 300227 time to create 1 rle with new method : 0.014781951904296875 length of segment : 1268 time for calcul the mask position with numpy : 0.00023436546325683594 nb_pixel_total : 11023 time to create 1 rle with old method : 0.013011932373046875 length of segment : 124 time for calcul the mask position with numpy : 0.00451350212097168 nb_pixel_total : 198594 time to create 1 rle with new method : 0.015191316604614258 length of segment : 362 time for calcul the mask position with numpy : 0.0005652904510498047 nb_pixel_total : 29626 time to create 1 rle with old method : 0.03865623474121094 length of segment : 232 time for calcul the mask position with numpy : 0.0002713203430175781 nb_pixel_total : 7481 time to create 1 rle with old method : 0.008964061737060547 length of segment : 131 time for calcul the mask position with numpy : 0.0003674030303955078 nb_pixel_total : 12350 time to create 1 rle with old method : 0.014554023742675781 length of segment : 145 time for calcul the mask position with numpy : 0.013292551040649414 nb_pixel_total : 247234 time to create 1 rle with new method : 0.29668760299682617 length of segment : 1067 time for calcul the mask position with numpy : 0.0018551349639892578 nb_pixel_total : 38859 time to create 1 rle with old method : 0.04467344284057617 length of segment : 292 time for calcul the mask position with numpy : 0.0010418891906738281 nb_pixel_total : 23467 time to create 1 rle with old method : 0.027284860610961914 length of segment : 166 time for calcul the mask position with numpy : 0.0003509521484375 nb_pixel_total : 5806 time to create 1 rle with old method : 0.007425546646118164 length of segment : 104 time for calcul the mask position with numpy : 0.0008008480072021484 nb_pixel_total : 9441 time to create 1 rle with old method : 0.016350984573364258 length of segment : 125 time for calcul the mask position with numpy : 0.00026798248291015625 nb_pixel_total : 8152 time to create 1 rle with old method : 0.009667396545410156 length of segment : 106 time for calcul the mask position with numpy : 0.00563359260559082 nb_pixel_total : 218616 time to create 1 rle with new method : 0.017706871032714844 length of segment : 349 time for calcul the mask position with numpy : 0.0013189315795898438 nb_pixel_total : 32572 time to create 1 rle with old method : 0.041975975036621094 length of segment : 231 time for calcul the mask position with numpy : 0.005914449691772461 nb_pixel_total : 220540 time to create 1 rle with new method : 0.017536401748657227 length of segment : 726 time for calcul the mask position with numpy : 0.0005793571472167969 nb_pixel_total : 16509 time to create 1 rle with old method : 0.019782066345214844 length of segment : 152 time for calcul the mask position with numpy : 0.0009319782257080078 nb_pixel_total : 11985 time to create 1 rle with old method : 0.015192270278930664 length of segment : 243 time for calcul the mask position with numpy : 0.0012867450714111328 nb_pixel_total : 33617 time to create 1 rle with old method : 0.040695905685424805 length of segment : 225 time for calcul the mask position with numpy : 0.0014200210571289062 nb_pixel_total : 33126 time to create 1 rle with old method : 0.03832530975341797 length of segment : 250 time for calcul the mask position with numpy : 0.0007987022399902344 nb_pixel_total : 15351 time to create 1 rle with old method : 0.019145488739013672 length of segment : 306 time for calcul the mask position with numpy : 0.0004208087921142578 nb_pixel_total : 10788 time to create 1 rle with old method : 0.012871503829956055 length of segment : 124 time for calcul the mask position with numpy : 0.00041174888610839844 nb_pixel_total : 11384 time to create 1 rle with old method : 0.01410531997680664 length of segment : 94 time for calcul the mask position with numpy : 0.000823974609375 nb_pixel_total : 18632 time to create 1 rle with old method : 0.022635221481323242 length of segment : 181 time for calcul the mask position with numpy : 0.006448507308959961 nb_pixel_total : 338264 time to create 1 rle with new method : 0.03259158134460449 length of segment : 613 time for calcul the mask position with numpy : 0.0013055801391601562 nb_pixel_total : 27113 time to create 1 rle with old method : 0.04664206504821777 length of segment : 199 time for calcul the mask position with numpy : 0.0031385421752929688 nb_pixel_total : 62333 time to create 1 rle with old method : 0.07196235656738281 length of segment : 339 time for calcul the mask position with numpy : 0.0015621185302734375 nb_pixel_total : 25087 time to create 1 rle with old method : 0.02955007553100586 length of segment : 219 time for calcul the mask position with numpy : 0.00039267539978027344 nb_pixel_total : 6417 time to create 1 rle with old method : 0.008088827133178711 length of segment : 86 time for calcul the mask position with numpy : 0.0018458366394042969 nb_pixel_total : 47948 time to create 1 rle with old method : 0.05525374412536621 length of segment : 312 time for calcul the mask position with numpy : 0.0013666152954101562 nb_pixel_total : 26532 time to create 1 rle with old method : 0.032587289810180664 length of segment : 189 time for calcul the mask position with numpy : 0.004358053207397461 nb_pixel_total : 117129 time to create 1 rle with old method : 0.14050579071044922 length of segment : 424 time for calcul the mask position with numpy : 0.011616706848144531 nb_pixel_total : 263192 time to create 1 rle with new method : 0.03251004219055176 length of segment : 444 time for calcul the mask position with numpy : 0.0015294551849365234 nb_pixel_total : 34668 time to create 1 rle with old method : 0.04178643226623535 length of segment : 340 time for calcul the mask position with numpy : 0.0006663799285888672 nb_pixel_total : 10485 time to create 1 rle with old method : 0.012118816375732422 length of segment : 190 time for calcul the mask position with numpy : 0.0004870891571044922 nb_pixel_total : 8110 time to create 1 rle with old method : 0.009949207305908203 length of segment : 100 time for calcul the mask position with numpy : 0.0006897449493408203 nb_pixel_total : 15900 time to create 1 rle with old method : 0.01848292350769043 length of segment : 145 time for calcul the mask position with numpy : 0.004522562026977539 nb_pixel_total : 134065 time to create 1 rle with old method : 0.15853428840637207 length of segment : 404 time for calcul the mask position with numpy : 0.0007040500640869141 nb_pixel_total : 11785 time to create 1 rle with old method : 0.014215230941772461 length of segment : 161 time for calcul the mask position with numpy : 0.0010955333709716797 nb_pixel_total : 14920 time to create 1 rle with old method : 0.02588057518005371 length of segment : 151 time for calcul the mask position with numpy : 0.0005056858062744141 nb_pixel_total : 4734 time to create 1 rle with old method : 0.007960319519042969 length of segment : 94 time for calcul the mask position with numpy : 0.005316495895385742 nb_pixel_total : 104205 time to create 1 rle with old method : 0.12857842445373535 length of segment : 367 time for calcul the mask position with numpy : 0.001569986343383789 nb_pixel_total : 29474 time to create 1 rle with old method : 0.03534579277038574 length of segment : 247 time for calcul the mask position with numpy : 0.0003540515899658203 nb_pixel_total : 14538 time to create 1 rle with old method : 0.016852617263793945 length of segment : 187 time for calcul the mask position with numpy : 0.00036454200744628906 nb_pixel_total : 6429 time to create 1 rle with old method : 0.0077075958251953125 length of segment : 79 time for calcul the mask position with numpy : 0.0005559921264648438 nb_pixel_total : 11750 time to create 1 rle with old method : 0.015651464462280273 length of segment : 151 time for calcul the mask position with numpy : 0.004386425018310547 nb_pixel_total : 115483 time to create 1 rle with old method : 0.13022279739379883 length of segment : 502 time for calcul the mask position with numpy : 0.0003333091735839844 nb_pixel_total : 6326 time to create 1 rle with old method : 0.0076313018798828125 length of segment : 87 time for calcul the mask position with numpy : 0.001398324966430664 nb_pixel_total : 37408 time to create 1 rle with old method : 0.04870867729187012 length of segment : 136 time for calcul the mask position with numpy : 0.0007929801940917969 nb_pixel_total : 20063 time to create 1 rle with old method : 0.02501201629638672 length of segment : 192 time for calcul the mask position with numpy : 0.001461029052734375 nb_pixel_total : 33034 time to create 1 rle with old method : 0.038007497787475586 length of segment : 242 time for calcul the mask position with numpy : 0.0010826587677001953 nb_pixel_total : 16315 time to create 1 rle with old method : 0.022233963012695312 length of segment : 177 time for calcul the mask position with numpy : 0.0009493827819824219 nb_pixel_total : 29829 time to create 1 rle with old method : 0.03622245788574219 length of segment : 162 time for calcul the mask position with numpy : 0.007072925567626953 nb_pixel_total : 181868 time to create 1 rle with new method : 0.013654470443725586 length of segment : 368 time for calcul the mask position with numpy : 0.0007724761962890625 nb_pixel_total : 20175 time to create 1 rle with old method : 0.023348093032836914 length of segment : 287 time for calcul the mask position with numpy : 0.0005247592926025391 nb_pixel_total : 8436 time to create 1 rle with old method : 0.014369726181030273 length of segment : 103 time for calcul the mask position with numpy : 0.002543926239013672 nb_pixel_total : 29735 time to create 1 rle with old method : 0.048972368240356445 length of segment : 189 time for calcul the mask position with numpy : 0.007233858108520508 nb_pixel_total : 108077 time to create 1 rle with old method : 0.12288761138916016 length of segment : 479 time for calcul the mask position with numpy : 0.0020682811737060547 nb_pixel_total : 40148 time to create 1 rle with old method : 0.047818660736083984 length of segment : 174 time for calcul the mask position with numpy : 0.003977537155151367 nb_pixel_total : 62444 time to create 1 rle with old method : 0.09125375747680664 length of segment : 351 time for calcul the mask position with numpy : 0.0006780624389648438 nb_pixel_total : 12742 time to create 1 rle with old method : 0.015342473983764648 length of segment : 141 time for calcul the mask position with numpy : 0.011509418487548828 nb_pixel_total : 207856 time to create 1 rle with new method : 0.022993803024291992 length of segment : 389 time for calcul the mask position with numpy : 0.0008935928344726562 nb_pixel_total : 30151 time to create 1 rle with old method : 0.03657031059265137 length of segment : 155 time for calcul the mask position with numpy : 0.005334138870239258 nb_pixel_total : 88282 time to create 1 rle with old method : 0.09929251670837402 length of segment : 533 time for calcul the mask position with numpy : 0.0010988712310791016 nb_pixel_total : 18991 time to create 1 rle with old method : 0.02226734161376953 length of segment : 131 time for calcul the mask position with numpy : 0.003108501434326172 nb_pixel_total : 70299 time to create 1 rle with old method : 0.08462738990783691 length of segment : 745 time for calcul the mask position with numpy : 0.006486415863037109 nb_pixel_total : 138336 time to create 1 rle with old method : 0.15526103973388672 length of segment : 346 time for calcul the mask position with numpy : 0.0021245479583740234 nb_pixel_total : 35031 time to create 1 rle with old method : 0.04157209396362305 length of segment : 548 time for calcul the mask position with numpy : 0.0001766681671142578 nb_pixel_total : 5675 time to create 1 rle with old method : 0.0076465606689453125 length of segment : 72 time for calcul the mask position with numpy : 0.004599332809448242 nb_pixel_total : 117942 time to create 1 rle with old method : 0.13748478889465332 length of segment : 339 time for calcul the mask position with numpy : 0.0010302066802978516 nb_pixel_total : 22295 time to create 1 rle with old method : 0.02805042266845703 length of segment : 143 time for calcul the mask position with numpy : 0.001995563507080078 nb_pixel_total : 32290 time to create 1 rle with old method : 0.03758549690246582 length of segment : 249 time for calcul the mask position with numpy : 0.004095315933227539 nb_pixel_total : 30949 time to create 1 rle with old method : 0.043636322021484375 length of segment : 445 time for calcul the mask position with numpy : 0.004629611968994141 nb_pixel_total : 99790 time to create 1 rle with old method : 0.12061738967895508 length of segment : 365 time for calcul the mask position with numpy : 0.0016894340515136719 nb_pixel_total : 32769 time to create 1 rle with old method : 0.04033970832824707 length of segment : 191 time for calcul the mask position with numpy : 0.002205371856689453 nb_pixel_total : 28246 time to create 1 rle with old method : 0.03288888931274414 length of segment : 211 time for calcul the mask position with numpy : 0.005875587463378906 nb_pixel_total : 91660 time to create 1 rle with old method : 0.10394525527954102 length of segment : 361 time for calcul the mask position with numpy : 0.007559061050415039 nb_pixel_total : 81912 time to create 1 rle with old method : 0.09300780296325684 length of segment : 660 time for calcul the mask position with numpy : 0.0029463768005371094 nb_pixel_total : 48234 time to create 1 rle with old method : 0.05494332313537598 length of segment : 425 time for calcul the mask position with numpy : 0.0020630359649658203 nb_pixel_total : 42177 time to create 1 rle with old method : 0.05030202865600586 length of segment : 497 time for calcul the mask position with numpy : 0.0022776126861572266 nb_pixel_total : 52429 time to create 1 rle with old method : 0.06891036033630371 length of segment : 204 time for calcul the mask position with numpy : 0.0018067359924316406 nb_pixel_total : 19293 time to create 1 rle with old method : 0.02399730682373047 length of segment : 339 time for calcul the mask position with numpy : 0.007325649261474609 nb_pixel_total : 96712 time to create 1 rle with old method : 0.12087845802307129 length of segment : 578 time for calcul the mask position with numpy : 0.00041675567626953125 nb_pixel_total : 4451 time to create 1 rle with old method : 0.0059812068939208984 length of segment : 90 time for calcul the mask position with numpy : 0.008527755737304688 nb_pixel_total : 119980 time to create 1 rle with old method : 0.14658188819885254 length of segment : 376 time for calcul the mask position with numpy : 0.002232789993286133 nb_pixel_total : 41753 time to create 1 rle with old method : 0.05125236511230469 length of segment : 366 time for calcul the mask position with numpy : 0.0030548572540283203 nb_pixel_total : 35826 time to create 1 rle with old method : 0.04643559455871582 length of segment : 342 time for calcul the mask position with numpy : 0.0016205310821533203 nb_pixel_total : 27006 time to create 1 rle with old method : 0.03153634071350098 length of segment : 269 time for calcul the mask position with numpy : 0.0021877288818359375 nb_pixel_total : 31033 time to create 1 rle with old method : 0.04839587211608887 length of segment : 180 time for calcul the mask position with numpy : 0.0010638236999511719 nb_pixel_total : 18139 time to create 1 rle with old method : 0.021294355392456055 length of segment : 177 time for calcul the mask position with numpy : 0.0017948150634765625 nb_pixel_total : 28195 time to create 1 rle with old method : 0.033917903900146484 length of segment : 161 time for calcul the mask position with numpy : 0.007631540298461914 nb_pixel_total : 172388 time to create 1 rle with new method : 0.01593780517578125 length of segment : 457 time for calcul the mask position with numpy : 0.002245187759399414 nb_pixel_total : 79510 time to create 1 rle with old method : 0.10327672958374023 length of segment : 252 time for calcul the mask position with numpy : 0.0008051395416259766 nb_pixel_total : 11314 time to create 1 rle with old method : 0.01925373077392578 length of segment : 74 time for calcul the mask position with numpy : 0.002027273178100586 nb_pixel_total : 39811 time to create 1 rle with old method : 0.049179792404174805 length of segment : 257 time for calcul the mask position with numpy : 0.0008134841918945312 nb_pixel_total : 16708 time to create 1 rle with old method : 0.020844697952270508 length of segment : 72 time for calcul the mask position with numpy : 0.002434253692626953 nb_pixel_total : 52414 time to create 1 rle with old method : 0.060874223709106445 length of segment : 233 time for calcul the mask position with numpy : 0.01855158805847168 nb_pixel_total : 356307 time to create 1 rle with new method : 0.060532331466674805 length of segment : 811 time for calcul the mask position with numpy : 0.00046825408935546875 nb_pixel_total : 11056 time to create 1 rle with old method : 0.013788461685180664 length of segment : 87 time for calcul the mask position with numpy : 0.0017402172088623047 nb_pixel_total : 29863 time to create 1 rle with old method : 0.037023067474365234 length of segment : 130 time for calcul the mask position with numpy : 0.005177021026611328 nb_pixel_total : 92769 time to create 1 rle with old method : 0.10711550712585449 length of segment : 326 time for calcul the mask position with numpy : 0.0036258697509765625 nb_pixel_total : 71002 time to create 1 rle with old method : 0.08300065994262695 length of segment : 440 time for calcul the mask position with numpy : 0.0050201416015625 nb_pixel_total : 91035 time to create 1 rle with old method : 0.10500907897949219 length of segment : 229 time for calcul the mask position with numpy : 0.001550436019897461 nb_pixel_total : 44711 time to create 1 rle with old method : 0.051087379455566406 length of segment : 235 time for calcul the mask position with numpy : 0.0029985904693603516 nb_pixel_total : 37540 time to create 1 rle with old method : 0.04883742332458496 length of segment : 457 time for calcul the mask position with numpy : 0.003618478775024414 nb_pixel_total : 51739 time to create 1 rle with old method : 0.06091475486755371 length of segment : 281 time for calcul the mask position with numpy : 0.004199981689453125 nb_pixel_total : 66170 time to create 1 rle with old method : 0.08072304725646973 length of segment : 270 time for calcul the mask position with numpy : 0.002580404281616211 nb_pixel_total : 49690 time to create 1 rle with old method : 0.05841946601867676 length of segment : 207 time for calcul the mask position with numpy : 0.0011320114135742188 nb_pixel_total : 20930 time to create 1 rle with old method : 0.025340557098388672 length of segment : 155 time for calcul the mask position with numpy : 0.00793910026550293 nb_pixel_total : 114020 time to create 1 rle with old method : 0.13228845596313477 length of segment : 473 time for calcul the mask position with numpy : 0.002567291259765625 nb_pixel_total : 32905 time to create 1 rle with old method : 0.03822731971740723 length of segment : 275 time for calcul the mask position with numpy : 0.0018820762634277344 nb_pixel_total : 29952 time to create 1 rle with old method : 0.03470444679260254 length of segment : 210 time for calcul the mask position with numpy : 0.0005960464477539062 nb_pixel_total : 21721 time to create 1 rle with old method : 0.02889418601989746 length of segment : 344 time for calcul the mask position with numpy : 0.006286144256591797 nb_pixel_total : 109753 time to create 1 rle with old method : 0.12653183937072754 length of segment : 373 time for calcul the mask position with numpy : 0.003165721893310547 nb_pixel_total : 48488 time to create 1 rle with old method : 0.05544757843017578 length of segment : 340 time for calcul the mask position with numpy : 0.0018231868743896484 nb_pixel_total : 22252 time to create 1 rle with old method : 0.026861906051635742 length of segment : 388 time for calcul the mask position with numpy : 0.008537769317626953 nb_pixel_total : 141832 time to create 1 rle with old method : 0.16599750518798828 length of segment : 499 time for calcul the mask position with numpy : 0.0014579296112060547 nb_pixel_total : 17763 time to create 1 rle with old method : 0.021146297454833984 length of segment : 212 time for calcul the mask position with numpy : 0.00044274330139160156 nb_pixel_total : 11996 time to create 1 rle with old method : 0.01762557029724121 length of segment : 78 time for calcul the mask position with numpy : 0.0005941390991210938 nb_pixel_total : 7358 time to create 1 rle with old method : 0.008602142333984375 length of segment : 164 time for calcul the mask position with numpy : 0.002708911895751953 nb_pixel_total : 41029 time to create 1 rle with old method : 0.04772543907165527 length of segment : 230 time for calcul the mask position with numpy : 0.004592180252075195 nb_pixel_total : 80851 time to create 1 rle with old method : 0.09141755104064941 length of segment : 374 time for calcul the mask position with numpy : 0.0012235641479492188 nb_pixel_total : 15384 time to create 1 rle with old method : 0.017951250076293945 length of segment : 169 time for calcul the mask position with numpy : 0.003958463668823242 nb_pixel_total : 28201 time to create 1 rle with old method : 0.032964229583740234 length of segment : 249 time for calcul the mask position with numpy : 0.0038025379180908203 nb_pixel_total : 103886 time to create 1 rle with old method : 0.11673808097839355 length of segment : 355 time for calcul the mask position with numpy : 0.0007231235504150391 nb_pixel_total : 4101 time to create 1 rle with old method : 0.005283355712890625 length of segment : 244 time for calcul the mask position with numpy : 0.002634763717651367 nb_pixel_total : 22346 time to create 1 rle with old method : 0.027169227600097656 length of segment : 447 time for calcul the mask position with numpy : 0.001188516616821289 nb_pixel_total : 20278 time to create 1 rle with old method : 0.02527308464050293 length of segment : 245 time for calcul the mask position with numpy : 0.0010700225830078125 nb_pixel_total : 18100 time to create 1 rle with old method : 0.02140498161315918 length of segment : 215 time for calcul the mask position with numpy : 0.00042057037353515625 nb_pixel_total : 2938 time to create 1 rle with old method : 0.0035746097564697266 length of segment : 88 time for calcul the mask position with numpy : 0.0010769367218017578 nb_pixel_total : 22469 time to create 1 rle with old method : 0.028722047805786133 length of segment : 150 time for calcul the mask position with numpy : 0.00025391578674316406 nb_pixel_total : 11680 time to create 1 rle with old method : 0.013595819473266602 length of segment : 170 time for calcul the mask position with numpy : 0.0007982254028320312 nb_pixel_total : 15938 time to create 1 rle with old method : 0.018837928771972656 length of segment : 126 time for calcul the mask position with numpy : 0.011388063430786133 nb_pixel_total : 239291 time to create 1 rle with new method : 0.3585543632507324 length of segment : 405 time for calcul the mask position with numpy : 0.002742290496826172 nb_pixel_total : 39240 time to create 1 rle with old method : 0.046038150787353516 length of segment : 381 time for calcul the mask position with numpy : 0.0022690296173095703 nb_pixel_total : 32091 time to create 1 rle with old method : 0.043527841567993164 length of segment : 460 time for calcul the mask position with numpy : 0.0013861656188964844 nb_pixel_total : 38202 time to create 1 rle with old method : 0.05233931541442871 length of segment : 285 time for calcul the mask position with numpy : 0.003919839859008789 nb_pixel_total : 90402 time to create 1 rle with old method : 0.12065291404724121 length of segment : 378 time for calcul the mask position with numpy : 0.0002543926239013672 nb_pixel_total : 7448 time to create 1 rle with old method : 0.009445905685424805 length of segment : 74 time for calcul the mask position with numpy : 0.0035812854766845703 nb_pixel_total : 67652 time to create 1 rle with old method : 0.07867932319641113 length of segment : 382 time for calcul the mask position with numpy : 0.002705097198486328 nb_pixel_total : 51418 time to create 1 rle with old method : 0.0586400032043457 length of segment : 264 time for calcul the mask position with numpy : 0.0015027523040771484 nb_pixel_total : 23655 time to create 1 rle with old method : 0.027977943420410156 length of segment : 375 time for calcul the mask position with numpy : 0.0022568702697753906 nb_pixel_total : 62133 time to create 1 rle with old method : 0.0694892406463623 length of segment : 305 time for calcul the mask position with numpy : 0.009921073913574219 nb_pixel_total : 139088 time to create 1 rle with old method : 0.1576244831085205 length of segment : 656 time for calcul the mask position with numpy : 0.0026407241821289062 nb_pixel_total : 71123 time to create 1 rle with old method : 0.08026361465454102 length of segment : 518 time for calcul the mask position with numpy : 0.0006976127624511719 nb_pixel_total : 15296 time to create 1 rle with old method : 0.01782083511352539 length of segment : 136 time for calcul the mask position with numpy : 0.0004124641418457031 nb_pixel_total : 18917 time to create 1 rle with old method : 0.022870302200317383 length of segment : 141 time for calcul the mask position with numpy : 0.004950523376464844 nb_pixel_total : 128579 time to create 1 rle with old method : 0.15163445472717285 length of segment : 479 time for calcul the mask position with numpy : 0.0011854171752929688 nb_pixel_total : 56903 time to create 1 rle with old method : 0.06432533264160156 length of segment : 366 time for calcul the mask position with numpy : 0.001402139663696289 nb_pixel_total : 40124 time to create 1 rle with old method : 0.045848846435546875 length of segment : 265 time for calcul the mask position with numpy : 0.0005486011505126953 nb_pixel_total : 7703 time to create 1 rle with old method : 0.009706974029541016 length of segment : 110 time for calcul the mask position with numpy : 0.0014731884002685547 nb_pixel_total : 70980 time to create 1 rle with old method : 0.08420753479003906 length of segment : 279 time for calcul the mask position with numpy : 0.002250194549560547 nb_pixel_total : 58800 time to create 1 rle with old method : 0.06815052032470703 length of segment : 241 time for calcul the mask position with numpy : 0.002867460250854492 nb_pixel_total : 66100 time to create 1 rle with old method : 0.07462215423583984 length of segment : 350 time for calcul the mask position with numpy : 0.0003032684326171875 nb_pixel_total : 9123 time to create 1 rle with old method : 0.010898351669311523 length of segment : 103 time for calcul the mask position with numpy : 0.0003979206085205078 nb_pixel_total : 8287 time to create 1 rle with old method : 0.009929418563842773 length of segment : 175 time spent for convertir_results : 17.55891442298889 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Number saved : None batch 1 Loaded 162 chid ids of type : 3594 Number RLEs to save : 46559 save missing photos in datou_result : time spend for datou_step_exec : 100.88456678390503 time spend to save output : 8.063313961029053 total time spend for step 1 : 108.94788074493408 step2:crop_condition Fri Feb 21 01:02:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure Loading chi in step crop with photo_hashtag_type : 3594 Loading chi in step crop for list_pids : 8 ! batch 1 Loaded 162 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ begin to crop the class : papier param for this class : {'min_score': 0.7} filtre for class : papier hashtag_id of this class : 492668766 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 91 About to insert : list_path_to_insert length 91 new photo from crops ! About to upload 91 photos upload in portfolio : 3736932 init cache_photo without model_param we have 91 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740096159_195463 we have uploaded 91 photos in the portfolio 3736932 time of upload the photos Elapsed time : 34.273603439331055 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.7} filtre for class : carton hashtag_id of this class : 492774966 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 28 About to insert : list_path_to_insert length 28 new photo from crops ! About to upload 28 photos upload in portfolio : 3736932 init cache_photo without model_param we have 28 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740096205_195463 we have uploaded 28 photos in the portfolio 3736932 time of upload the photos Elapsed time : 9.086848497390747 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.7} filtre for class : metal hashtag_id of this class : 492628673 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740096216_195463 we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.370668888092041 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.7} filtre for class : pet_clair hashtag_id of this class : 2107755846 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 31 About to insert : list_path_to_insert length 31 new photo from crops ! About to upload 31 photos upload in portfolio : 3736932 init cache_photo without model_param we have 31 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740096234_195463 we have uploaded 31 photos in the portfolio 3736932 time of upload the photos Elapsed time : 15.876259326934814 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.7} filtre for class : autre hashtag_id of this class : 494826614 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 3736932 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740096252_195463 we have uploaded 3 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.7664721012115479 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.7} filtre for class : pehd hashtag_id of this class : 628944319 we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 3736932 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740096255_195463 we have uploaded 1 photos in the portfolio 3736932 time of upload the photos Elapsed time : 0.619863748550415 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.7} filtre for class : pet_fonce hashtag_id of this class : 2107755900 we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! we have both polygon and rles Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 3736932 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740096259_195463 we have uploaded 4 photos in the portfolio 3736932 time of upload the photos Elapsed time : 1.268239974975586 we have finished the crop for the class : pet_fonce delete rles from all chi we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles we have 0 chi objets contains the rles Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1338601912, 1338601909, 1338601900, 1338601869, 1338601865, 1338601861, 1338601857, 1338601850] Looping around the photos to save general results len do output : 162 /1338703564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703619Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703621Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703622Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703623Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703624Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338703790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601912', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601909', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601900', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601869', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601865', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601861', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601857', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601850', None, None, None, None, None, '2601834') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 494 time used for this insertion : 0.190460205078125 save_final save missing photos in datou_result : time spend for datou_step_exec : 119.8115005493164 time spend to save output : 0.1955275535583496 total time spend for step 2 : 120.00702810287476 step3:rle_unique_nms_with_priority Fri Feb 21 01:04:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array We expect there is only one output and this part is used while all output are not tuple or array VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 162 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 11 nb_hashtags : 3 time to prepare the origin masks : 6.813646078109741 time for calcul the mask position with numpy : 0.9784181118011475 nb_pixel_total : 6034483 time to create 1 rle with new method : 1.3425960540771484 time for calcul the mask position with numpy : 0.0328061580657959 nb_pixel_total : 21537 time to create 1 rle with old method : 0.024794578552246094 time for calcul the mask position with numpy : 0.034693002700805664 nb_pixel_total : 198594 time to create 1 rle with new method : 1.2358417510986328 time for calcul the mask position with numpy : 0.02115011215209961 nb_pixel_total : 11023 time to create 1 rle with old method : 0.013048171997070312 time for calcul the mask position with numpy : 0.023464679718017578 nb_pixel_total : 274586 time to create 1 rle with new method : 1.470942735671997 time for calcul the mask position with numpy : 0.03325295448303223 nb_pixel_total : 14628 time to create 1 rle with old method : 0.01674056053161621 time for calcul the mask position with numpy : 0.03575921058654785 nb_pixel_total : 8464 time to create 1 rle with old method : 0.009797811508178711 time for calcul the mask position with numpy : 0.03584122657775879 nb_pixel_total : 43290 time to create 1 rle with old method : 0.04878115653991699 time for calcul the mask position with numpy : 0.03657245635986328 nb_pixel_total : 47674 time to create 1 rle with old method : 0.05356717109680176 time for calcul the mask position with numpy : 0.0346982479095459 nb_pixel_total : 10998 time to create 1 rle with old method : 0.01379537582397461 time for calcul the mask position with numpy : 0.035735130310058594 nb_pixel_total : 96105 time to create 1 rle with old method : 0.10680055618286133 time for calcul the mask position with numpy : 0.03726458549499512 nb_pixel_total : 288858 time to create 1 rle with new method : 1.0408599376678467 create new chi : 6.82964015007019 time to delete rle : 0.05024123191833496 batch 1 Loaded 24 chid ids of type : 3594 +++++++++++++++++++Number RLEs to save : 9593 TO DO : save crop sub photo not yet done ! save time : 0.7440431118011475 nb_obj : 19 nb_hashtags : 6 time to prepare the origin masks : 10.76984977722168 time for calcul the mask position with numpy : 0.645078182220459 nb_pixel_total : 5755110 time to create 1 rle with new method : 0.4535961151123047 time for calcul the mask position with numpy : 0.03882002830505371 nb_pixel_total : 338264 time to create 1 rle with new method : 1.3320577144622803 time for calcul the mask position with numpy : 0.03690457344055176 nb_pixel_total : 18632 time to create 1 rle with old method : 0.025179386138916016 time for calcul the mask position with numpy : 0.03970670700073242 nb_pixel_total : 11384 time to create 1 rle with old method : 0.018512248992919922 time for calcul the mask position with numpy : 0.036884307861328125 nb_pixel_total : 10788 time to create 1 rle with old method : 0.0127105712890625 time for calcul the mask position with numpy : 0.03536701202392578 nb_pixel_total : 4755 time to create 1 rle with old method : 0.006005287170410156 time for calcul the mask position with numpy : 0.03519153594970703 nb_pixel_total : 32160 time to create 1 rle with old method : 0.0408782958984375 time for calcul the mask position with numpy : 0.03607964515686035 nb_pixel_total : 33617 time to create 1 rle with old method : 0.040592193603515625 time for calcul the mask position with numpy : 0.037169694900512695 nb_pixel_total : 11985 time to create 1 rle with old method : 0.015056610107421875 time for calcul the mask position with numpy : 0.03645753860473633 nb_pixel_total : 16509 time to create 1 rle with old method : 0.02094125747680664 time for calcul the mask position with numpy : 0.0375514030456543 nb_pixel_total : 220540 time to create 1 rle with new method : 1.594940185546875 time for calcul the mask position with numpy : 0.03428149223327637 nb_pixel_total : 32572 time to create 1 rle with old method : 0.037097930908203125 time for calcul the mask position with numpy : 0.03508949279785156 nb_pixel_total : 218615 time to create 1 rle with new method : 0.45433545112609863 time for calcul the mask position with numpy : 0.032387733459472656 nb_pixel_total : 8152 time to create 1 rle with old method : 0.009719133377075195 time for calcul the mask position with numpy : 0.03401947021484375 nb_pixel_total : 9441 time to create 1 rle with old method : 0.011143922805786133 time for calcul the mask position with numpy : 0.03385639190673828 nb_pixel_total : 5806 time to create 1 rle with old method : 0.006831169128417969 time for calcul the mask position with numpy : 0.035913705825805664 nb_pixel_total : 23467 time to create 1 rle with old method : 0.02944636344909668 time for calcul the mask position with numpy : 0.0345606803894043 nb_pixel_total : 38859 time to create 1 rle with old method : 0.04788780212402344 time for calcul the mask position with numpy : 0.036660194396972656 nb_pixel_total : 247234 time to create 1 rle with new method : 1.3962726593017578 time for calcul the mask position with numpy : 0.02312779426574707 nb_pixel_total : 12350 time to create 1 rle with old method : 0.014613866806030273 create new chi : 7.023895025253296 time to delete rle : 0.0026412010192871094 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++++++Number RLEs to save : 13025 TO DO : save crop sub photo not yet done ! save time : 2.441711664199829 nb_obj : 21 nb_hashtags : 5 time to prepare the origin masks : 18.856337308883667 time for calcul the mask position with numpy : 0.7022721767425537 nb_pixel_total : 6073925 time to create 1 rle with new method : 1.6267750263214111 time for calcul the mask position with numpy : 0.04178023338317871 nb_pixel_total : 11750 time to create 1 rle with old method : 0.017104625701904297 time for calcul the mask position with numpy : 0.04035639762878418 nb_pixel_total : 6429 time to create 1 rle with old method : 0.011209964752197266 time for calcul the mask position with numpy : 0.03695988655090332 nb_pixel_total : 14538 time to create 1 rle with old method : 0.016462326049804688 time for calcul the mask position with numpy : 0.03950786590576172 nb_pixel_total : 29474 time to create 1 rle with old method : 0.03508734703063965 time for calcul the mask position with numpy : 0.04012298583984375 nb_pixel_total : 104205 time to create 1 rle with old method : 0.12366414070129395 time for calcul the mask position with numpy : 0.035013437271118164 nb_pixel_total : 4734 time to create 1 rle with old method : 0.005662679672241211 time for calcul the mask position with numpy : 0.03499555587768555 nb_pixel_total : 14920 time to create 1 rle with old method : 0.01767563819885254 time for calcul the mask position with numpy : 0.024643659591674805 nb_pixel_total : 11785 time to create 1 rle with old method : 0.013965368270874023 time for calcul the mask position with numpy : 0.029650211334228516 nb_pixel_total : 133566 time to create 1 rle with old method : 0.1496260166168213 time for calcul the mask position with numpy : 0.03430008888244629 nb_pixel_total : 15900 time to create 1 rle with old method : 0.01854562759399414 time for calcul the mask position with numpy : 0.03508758544921875 nb_pixel_total : 8110 time to create 1 rle with old method : 0.00991058349609375 time for calcul the mask position with numpy : 0.03407096862792969 nb_pixel_total : 10485 time to create 1 rle with old method : 0.011993408203125 time for calcul the mask position with numpy : 0.033931732177734375 nb_pixel_total : 34668 time to create 1 rle with old method : 0.039366722106933594 time for calcul the mask position with numpy : 0.03540992736816406 nb_pixel_total : 263192 time to create 1 rle with new method : 0.45661187171936035 time for calcul the mask position with numpy : 0.034581899642944336 nb_pixel_total : 117129 time to create 1 rle with old method : 0.1306629180908203 time for calcul the mask position with numpy : 0.03402447700500488 nb_pixel_total : 26532 time to create 1 rle with old method : 0.03150773048400879 time for calcul the mask position with numpy : 0.032892465591430664 nb_pixel_total : 47948 time to create 1 rle with old method : 0.053521156311035156 time for calcul the mask position with numpy : 0.029128074645996094 nb_pixel_total : 6417 time to create 1 rle with old method : 0.007723808288574219 time for calcul the mask position with numpy : 0.021095752716064453 nb_pixel_total : 25087 time to create 1 rle with old method : 0.028625011444091797 time for calcul the mask position with numpy : 0.021661758422851562 nb_pixel_total : 62333 time to create 1 rle with old method : 0.06985187530517578 time for calcul the mask position with numpy : 0.021297931671142578 nb_pixel_total : 27113 time to create 1 rle with old method : 0.031005382537841797 create new chi : 4.373852014541626 time to delete rle : 0.0017347335815429688 batch 1 Loaded 43 chid ids of type : 3594 ++++++++++++++++++++++++Number RLEs to save : 11775 TO DO : save crop sub photo not yet done ! save time : 2.274460554122925 nb_obj : 10 nb_hashtags : 3 time to prepare the origin masks : 6.736291408538818 time for calcul the mask position with numpy : 0.7691376209259033 nb_pixel_total : 6581303 time to create 1 rle with new method : 0.8221926689147949 time for calcul the mask position with numpy : 0.04017329216003418 nb_pixel_total : 8436 time to create 1 rle with old method : 0.009947061538696289 time for calcul the mask position with numpy : 0.037069082260131836 nb_pixel_total : 20175 time to create 1 rle with old method : 0.02611231803894043 time for calcul the mask position with numpy : 0.034888505935668945 nb_pixel_total : 181868 time to create 1 rle with new method : 0.8093900680541992 time for calcul the mask position with numpy : 0.03229689598083496 nb_pixel_total : 29829 time to create 1 rle with old method : 0.033965110778808594 time for calcul the mask position with numpy : 0.03724217414855957 nb_pixel_total : 16315 time to create 1 rle with old method : 0.018541574478149414 time for calcul the mask position with numpy : 0.035437583923339844 nb_pixel_total : 33034 time to create 1 rle with old method : 0.038281917572021484 time for calcul the mask position with numpy : 0.04206681251525879 nb_pixel_total : 20063 time to create 1 rle with old method : 0.02362966537475586 time for calcul the mask position with numpy : 0.03958010673522949 nb_pixel_total : 37408 time to create 1 rle with old method : 0.042034149169921875 time for calcul the mask position with numpy : 0.03507399559020996 nb_pixel_total : 6326 time to create 1 rle with old method : 0.0076351165771484375 time for calcul the mask position with numpy : 0.034688711166381836 nb_pixel_total : 115483 time to create 1 rle with old method : 0.13010144233703613 create new chi : 3.1704506874084473 time to delete rle : 0.001077890396118164 batch 1 Loaded 21 chid ids of type : 3594 ++++++++++++++Number RLEs to save : 6672 TO DO : save crop sub photo not yet done ! save time : 2.6041200160980225 nb_obj : 19 nb_hashtags : 5 time to prepare the origin masks : 13.865900754928589 time for calcul the mask position with numpy : 0.42017436027526855 nb_pixel_total : 5870537 time to create 1 rle with new method : 1.1588146686553955 time for calcul the mask position with numpy : 0.0352175235748291 nb_pixel_total : 32769 time to create 1 rle with old method : 0.0369265079498291 time for calcul the mask position with numpy : 0.03568720817565918 nb_pixel_total : 99790 time to create 1 rle with old method : 0.12968993186950684 time for calcul the mask position with numpy : 0.03795289993286133 nb_pixel_total : 30949 time to create 1 rle with old method : 0.03563523292541504 time for calcul the mask position with numpy : 0.03603410720825195 nb_pixel_total : 32290 time to create 1 rle with old method : 0.03678393363952637 time for calcul the mask position with numpy : 0.03602123260498047 nb_pixel_total : 22295 time to create 1 rle with old method : 0.02535223960876465 time for calcul the mask position with numpy : 0.03468823432922363 nb_pixel_total : 117942 time to create 1 rle with old method : 0.13074517250061035 time for calcul the mask position with numpy : 0.034056901931762695 nb_pixel_total : 1576 time to create 1 rle with old method : 0.002002239227294922 time for calcul the mask position with numpy : 0.03471994400024414 nb_pixel_total : 35031 time to create 1 rle with old method : 0.04012417793273926 time for calcul the mask position with numpy : 0.036421775817871094 nb_pixel_total : 138336 time to create 1 rle with old method : 0.15204787254333496 time for calcul the mask position with numpy : 0.03454327583312988 nb_pixel_total : 70299 time to create 1 rle with old method : 0.0791170597076416 time for calcul the mask position with numpy : 0.03391575813293457 nb_pixel_total : 18991 time to create 1 rle with old method : 0.02203226089477539 time for calcul the mask position with numpy : 0.034822702407836914 nb_pixel_total : 88282 time to create 1 rle with old method : 0.10316824913024902 time for calcul the mask position with numpy : 0.03413224220275879 nb_pixel_total : 30151 time to create 1 rle with old method : 0.034522294998168945 time for calcul the mask position with numpy : 0.03553152084350586 nb_pixel_total : 207856 time to create 1 rle with new method : 0.8505408763885498 time for calcul the mask position with numpy : 0.03625941276550293 nb_pixel_total : 12742 time to create 1 rle with old method : 0.014964103698730469 time for calcul the mask position with numpy : 0.03678011894226074 nb_pixel_total : 62444 time to create 1 rle with old method : 0.0704042911529541 time for calcul the mask position with numpy : 0.03737950325012207 nb_pixel_total : 40148 time to create 1 rle with old method : 0.045424699783325195 time for calcul the mask position with numpy : 0.03713536262512207 nb_pixel_total : 108077 time to create 1 rle with old method : 0.12152719497680664 time for calcul the mask position with numpy : 0.035147905349731445 nb_pixel_total : 29735 time to create 1 rle with old method : 0.03444933891296387 create new chi : 4.284796237945557 time to delete rle : 0.0023794174194335938 batch 1 Loaded 39 chid ids of type : 3594 +++++++++++++++++++++++++++++Number RLEs to save : 14042 TO DO : save crop sub photo not yet done ! save time : 6.522346496582031 nb_obj : 29 nb_hashtags : 5 time to prepare the origin masks : 4.502609729766846 time for calcul the mask position with numpy : 0.48123979568481445 nb_pixel_total : 5249023 time to create 1 rle with new method : 1.4295618534088135 time for calcul the mask position with numpy : 0.030625581741333008 nb_pixel_total : 41753 time to create 1 rle with old method : 0.04844498634338379 time for calcul the mask position with numpy : 0.03087639808654785 nb_pixel_total : 92769 time to create 1 rle with old method : 0.10700464248657227 time for calcul the mask position with numpy : 0.029422760009765625 nb_pixel_total : 19293 time to create 1 rle with old method : 0.022195100784301758 time for calcul the mask position with numpy : 0.029399394989013672 nb_pixel_total : 42177 time to create 1 rle with old method : 0.04755568504333496 time for calcul the mask position with numpy : 0.029442548751831055 nb_pixel_total : 119980 time to create 1 rle with old method : 0.1341850757598877 time for calcul the mask position with numpy : 0.029220104217529297 nb_pixel_total : 52429 time to create 1 rle with old method : 0.05823230743408203 time for calcul the mask position with numpy : 0.02899622917175293 nb_pixel_total : 39811 time to create 1 rle with old method : 0.045258283615112305 time for calcul the mask position with numpy : 0.029596328735351562 nb_pixel_total : 44796 time to create 1 rle with old method : 0.05052471160888672 time for calcul the mask position with numpy : 0.02926802635192871 nb_pixel_total : 81912 time to create 1 rle with old method : 0.09276342391967773 time for calcul the mask position with numpy : 0.029201984405517578 nb_pixel_total : 28195 time to create 1 rle with old method : 0.03212785720825195 time for calcul the mask position with numpy : 0.029840946197509766 nb_pixel_total : 91660 time to create 1 rle with old method : 0.10845422744750977 time for calcul the mask position with numpy : 0.03303670883178711 nb_pixel_total : 172388 time to create 1 rle with new method : 0.6292872428894043 time for calcul the mask position with numpy : 0.029613494873046875 nb_pixel_total : 48234 time to create 1 rle with old method : 0.05697154998779297 time for calcul the mask position with numpy : 0.03002333641052246 nb_pixel_total : 96712 time to create 1 rle with old method : 0.11342620849609375 time for calcul the mask position with numpy : 0.03238797187805176 nb_pixel_total : 356307 time to create 1 rle with new method : 0.7349169254302979 time for calcul the mask position with numpy : 0.028930187225341797 nb_pixel_total : 4451 time to create 1 rle with old method : 0.005351066589355469 time for calcul the mask position with numpy : 0.028822898864746094 nb_pixel_total : 31033 time to create 1 rle with old method : 0.03475236892700195 time for calcul the mask position with numpy : 0.03232932090759277 nb_pixel_total : 71002 time to create 1 rle with old method : 0.08930635452270508 time for calcul the mask position with numpy : 0.030852794647216797 nb_pixel_total : 28246 time to create 1 rle with old method : 0.03188371658325195 time for calcul the mask position with numpy : 0.033693552017211914 nb_pixel_total : 44711 time to create 1 rle with old method : 0.0635385513305664 time for calcul the mask position with numpy : 0.029100894927978516 nb_pixel_total : 52414 time to create 1 rle with old method : 0.059110164642333984 time for calcul the mask position with numpy : 0.030018329620361328 nb_pixel_total : 91035 time to create 1 rle with old method : 0.10535907745361328 time for calcul the mask position with numpy : 0.029071569442749023 nb_pixel_total : 35826 time to create 1 rle with old method : 0.041283607482910156 time for calcul the mask position with numpy : 0.028937101364135742 nb_pixel_total : 27006 time to create 1 rle with old method : 0.030576705932617188 time for calcul the mask position with numpy : 0.028868913650512695 nb_pixel_total : 18139 time to create 1 rle with old method : 0.02052903175354004 time for calcul the mask position with numpy : 0.0290067195892334 nb_pixel_total : 29863 time to create 1 rle with old method : 0.033596038818359375 time for calcul the mask position with numpy : 0.028812885284423828 nb_pixel_total : 11053 time to create 1 rle with old method : 0.013507843017578125 time for calcul the mask position with numpy : 0.028830289840698242 nb_pixel_total : 11314 time to create 1 rle with old method : 0.012876510620117188 time for calcul the mask position with numpy : 0.029008865356445312 nb_pixel_total : 16708 time to create 1 rle with old method : 0.01916050910949707 create new chi : 5.707530975341797 time to delete rle : 0.0028541088104248047 batch 1 Loaded 59 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++++++Number RLEs to save : 19632 TO DO : save crop sub photo not yet done ! save time : 2.3658735752105713 nb_obj : 28 nb_hashtags : 3 time to prepare the origin masks : 3.9149599075317383 time for calcul the mask position with numpy : 0.5074481964111328 nb_pixel_total : 5912695 time to create 1 rle with new method : 0.9152712821960449 time for calcul the mask position with numpy : 0.029550790786743164 nb_pixel_total : 22469 time to create 1 rle with old method : 0.025812149047851562 time for calcul the mask position with numpy : 0.0290987491607666 nb_pixel_total : 6736 time to create 1 rle with old method : 0.008359193801879883 time for calcul the mask position with numpy : 0.029361724853515625 nb_pixel_total : 22252 time to create 1 rle with old method : 0.025315046310424805 time for calcul the mask position with numpy : 0.030538558959960938 nb_pixel_total : 4101 time to create 1 rle with old method : 0.00497746467590332 time for calcul the mask position with numpy : 0.028886079788208008 nb_pixel_total : 18100 time to create 1 rle with old method : 0.020678997039794922 time for calcul the mask position with numpy : 0.02900552749633789 nb_pixel_total : 20930 time to create 1 rle with old method : 0.02438974380493164 time for calcul the mask position with numpy : 0.03479290008544922 nb_pixel_total : 32905 time to create 1 rle with old method : 0.042696237564086914 time for calcul the mask position with numpy : 0.02993464469909668 nb_pixel_total : 41029 time to create 1 rle with old method : 0.05112624168395996 time for calcul the mask position with numpy : 0.030230998992919922 nb_pixel_total : 66170 time to create 1 rle with old method : 0.07857918739318848 time for calcul the mask position with numpy : 0.02950572967529297 nb_pixel_total : 103886 time to create 1 rle with old method : 0.1200108528137207 time for calcul the mask position with numpy : 0.031996965408325195 nb_pixel_total : 28201 time to create 1 rle with old method : 0.03614044189453125 time for calcul the mask position with numpy : 0.03219413757324219 nb_pixel_total : 11645 time to create 1 rle with old method : 0.0137176513671875 time for calcul the mask position with numpy : 0.029954195022583008 nb_pixel_total : 37540 time to create 1 rle with old method : 0.04666543006896973 time for calcul the mask position with numpy : 0.031116724014282227 nb_pixel_total : 7358 time to create 1 rle with old method : 0.008550643920898438 time for calcul the mask position with numpy : 0.029326200485229492 nb_pixel_total : 114020 time to create 1 rle with old method : 0.16014575958251953 time for calcul the mask position with numpy : 0.03033924102783203 nb_pixel_total : 15384 time to create 1 rle with old method : 0.01904582977294922 time for calcul the mask position with numpy : 0.03155088424682617 nb_pixel_total : 19590 time to create 1 rle with old method : 0.02247452735900879 time for calcul the mask position with numpy : 0.029738426208496094 nb_pixel_total : 49690 time to create 1 rle with old method : 0.06168508529663086 time for calcul the mask position with numpy : 0.03380894660949707 nb_pixel_total : 141832 time to create 1 rle with old method : 0.17325735092163086 time for calcul the mask position with numpy : 0.029911279678344727 nb_pixel_total : 80851 time to create 1 rle with old method : 0.09609127044677734 time for calcul the mask position with numpy : 0.02948760986328125 nb_pixel_total : 20278 time to create 1 rle with old method : 0.026627779006958008 time for calcul the mask position with numpy : 0.029907941818237305 nb_pixel_total : 48488 time to create 1 rle with old method : 0.0558323860168457 time for calcul the mask position with numpy : 0.03366255760192871 nb_pixel_total : 51739 time to create 1 rle with old method : 0.05958056449890137 time for calcul the mask position with numpy : 0.029846668243408203 nb_pixel_total : 2938 time to create 1 rle with old method : 0.0035660266876220703 time for calcul the mask position with numpy : 0.030112266540527344 nb_pixel_total : 17763 time to create 1 rle with old method : 0.02126479148864746 time for calcul the mask position with numpy : 0.03125905990600586 nb_pixel_total : 109753 time to create 1 rle with old method : 0.12874078750610352 time for calcul the mask position with numpy : 0.0306398868560791 nb_pixel_total : 29952 time to create 1 rle with old method : 0.03805828094482422 time for calcul the mask position with numpy : 0.02943706512451172 nb_pixel_total : 11945 time to create 1 rle with old method : 0.013440847396850586 create new chi : 3.702389717102051 time to delete rle : 0.0025739669799804688 batch 1 Loaded 57 chid ids of type : 3594 ++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 16755 TO DO : save crop sub photo not yet done ! save time : 1.722951889038086 nb_obj : 24 nb_hashtags : 4 time to prepare the origin masks : 9.6365966796875 time for calcul the mask position with numpy : 0.4299302101135254 nb_pixel_total : 5721290 time to create 1 rle with new method : 0.44447875022888184 time for calcul the mask position with numpy : 0.020885705947875977 nb_pixel_total : 8160 time to create 1 rle with old method : 0.009440183639526367 time for calcul the mask position with numpy : 0.02293682098388672 nb_pixel_total : 9123 time to create 1 rle with old method : 0.010893821716308594 time for calcul the mask position with numpy : 0.035329341888427734 nb_pixel_total : 66100 time to create 1 rle with old method : 0.07326602935791016 time for calcul the mask position with numpy : 0.03415799140930176 nb_pixel_total : 58596 time to create 1 rle with old method : 0.0672447681427002 time for calcul the mask position with numpy : 0.03419852256774902 nb_pixel_total : 70157 time to create 1 rle with old method : 0.08197355270385742 time for calcul the mask position with numpy : 0.03737187385559082 nb_pixel_total : 7703 time to create 1 rle with old method : 0.008855104446411133 time for calcul the mask position with numpy : 0.036916255950927734 nb_pixel_total : 40124 time to create 1 rle with old method : 0.04711270332336426 time for calcul the mask position with numpy : 0.03721261024475098 nb_pixel_total : 36213 time to create 1 rle with old method : 0.04215645790100098 time for calcul the mask position with numpy : 0.03778886795043945 nb_pixel_total : 128579 time to create 1 rle with old method : 0.14726901054382324 time for calcul the mask position with numpy : 0.02758646011352539 nb_pixel_total : 18917 time to create 1 rle with old method : 0.021801471710205078 time for calcul the mask position with numpy : 0.02214837074279785 nb_pixel_total : 15296 time to create 1 rle with old method : 0.01838541030883789 time for calcul the mask position with numpy : 0.024309873580932617 nb_pixel_total : 63458 time to create 1 rle with old method : 0.07468128204345703 time for calcul the mask position with numpy : 0.024129152297973633 nb_pixel_total : 139088 time to create 1 rle with old method : 0.16058731079101562 time for calcul the mask position with numpy : 0.02407693862915039 nb_pixel_total : 62133 time to create 1 rle with old method : 0.0702364444732666 time for calcul the mask position with numpy : 0.024538516998291016 nb_pixel_total : 23655 time to create 1 rle with old method : 0.02729630470275879 time for calcul the mask position with numpy : 0.02450728416442871 nb_pixel_total : 51418 time to create 1 rle with old method : 0.060446977615356445 time for calcul the mask position with numpy : 0.02326059341430664 nb_pixel_total : 67652 time to create 1 rle with old method : 0.0791938304901123 time for calcul the mask position with numpy : 0.02200627326965332 nb_pixel_total : 7414 time to create 1 rle with old method : 0.00871419906616211 time for calcul the mask position with numpy : 0.02338886260986328 nb_pixel_total : 90402 time to create 1 rle with old method : 0.12303614616394043 time for calcul the mask position with numpy : 0.024280786514282227 nb_pixel_total : 38202 time to create 1 rle with old method : 0.04878401756286621 time for calcul the mask position with numpy : 0.02404022216796875 nb_pixel_total : 32091 time to create 1 rle with old method : 0.03910660743713379 time for calcul the mask position with numpy : 0.02298593521118164 nb_pixel_total : 39240 time to create 1 rle with old method : 0.05013155937194824 time for calcul the mask position with numpy : 0.02466440200805664 nb_pixel_total : 239291 time to create 1 rle with new method : 0.36222124099731445 time for calcul the mask position with numpy : 0.0278472900390625 nb_pixel_total : 15938 time to create 1 rle with old method : 0.01805710792541504 create new chi : 3.2396583557128906 time to delete rle : 0.004328250885009766 batch 1 Loaded 49 chid ids of type : 3594 +++++++++++++++++++++++++++++++++++Number RLEs to save : 15982 TO DO : save crop sub photo not yet done ! save time : 1.1715915203094482 map_output_result : {1338601912: (0.0, 'Should be the crop_list due to order', 0), 1338601909: (0.0, 'Should be the crop_list due to order', 0), 1338601900: (0.0, 'Should be the crop_list due to order', 0), 1338601869: (0.0, 'Should be the crop_list due to order', 0), 1338601865: (0.0, 'Should be the crop_list due to order', 0), 1338601861: (0.0, 'Should be the crop_list due to order', 0), 1338601857: (0.0, 'Should be the crop_list due to order', 0), 1338601850: (0.0, 'Should be the crop_list due to order', 0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1338601912, 1338601909, 1338601900, 1338601869, 1338601865, 1338601861, 1338601857, 1338601850] Looping around the photos to save general results len do output : 8 /1338601912.Didn't retrieve data . /1338601909.Didn't retrieve data . /1338601900.Didn't retrieve data . /1338601869.Didn't retrieve data . /1338601865.Didn't retrieve data . /1338601861.Didn't retrieve data . /1338601857.Didn't retrieve data . /1338601850.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601912', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601909', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601900', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601869', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601865', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601861', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601857', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601850', None, None, None, None, None, '2601834') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.01398777961730957 save_final save missing photos in datou_result : time spend for datou_step_exec : 135.84179544448853 time spend to save output : 0.017145395278930664 total time spend for step 3 : 135.85894083976746 step4:ventilate_hashtags_in_portfolio Fri Feb 21 01:06:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20699408 get user id for portfolio 20699408 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20699408 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pet_clair','carton','autre','metal','environnement','pehd','pet_fonce','background','mal_croppe','flou')) AND mptpi.`min_score`=0.5 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20699408 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pet_clair','carton','autre','metal','environnement','pehd','pet_fonce','background','mal_croppe','flou')) AND mptpi.`min_score`=0.5 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20699408 AND mptpi.`type`=3594 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','pet_clair','carton','autre','metal','environnement','pehd','pet_fonce','background','mal_croppe','flou')) AND mptpi.`min_score`=0.5 To do lien utilise dans velours : https://www.fotonower.com/velours/20701828,20701829,20701830,20701831,20701832,20701833,20701834,20701835,20701836,20701837,20701838?tags=papier,pet_clair,carton,autre,metal,environnement,pehd,pet_fonce,background,mal_croppe,flou Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1338601912, 1338601909, 1338601900, 1338601869, 1338601865, 1338601861, 1338601857, 1338601850] Looping around the photos to save general results len do output : 1 /20699408. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601912', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601909', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601900', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601869', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601865', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601861', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601857', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601850', None, None, None, None, None, '2601834') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.02201366424560547 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.8844099044799805 time spend to save output : 0.02237725257873535 total time spend for step 4 : 0.9067871570587158 step5:final Fri Feb 21 01:06:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1338601912: ('0.16317802656363475',), 1338601909: ('0.16317802656363475',), 1338601900: ('0.16317802656363475',), 1338601869: ('0.16317802656363475',), 1338601865: ('0.16317802656363475',), 1338601861: ('0.16317802656363475',), 1338601857: ('0.16317802656363475',), 1338601850: ('0.16317802656363475',)} new output for save of step final : {1338601912: ('0.16317802656363475',), 1338601909: ('0.16317802656363475',), 1338601900: ('0.16317802656363475',), 1338601869: ('0.16317802656363475',), 1338601865: ('0.16317802656363475',), 1338601861: ('0.16317802656363475',), 1338601857: ('0.16317802656363475',), 1338601850: ('0.16317802656363475',)} [1338601912, 1338601909, 1338601900, 1338601869, 1338601865, 1338601861, 1338601857, 1338601850] Looping around the photos to save general results len do output : 8 /1338601912.Didn't retrieve data . /1338601909.Didn't retrieve data . /1338601900.Didn't retrieve data . /1338601869.Didn't retrieve data . /1338601865.Didn't retrieve data . /1338601861.Didn't retrieve data . /1338601857.Didn't retrieve data . /1338601850.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601912', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601909', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601900', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601869', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601865', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601861', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601857', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601850', None, None, None, None, None, '2601834') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 24 time used for this insertion : 0.04086017608642578 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.2122330665588379 time spend to save output : 0.04194188117980957 total time spend for step 5 : 0.25417494773864746 step6:blur_detection Fri Feb 21 01:06:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1740096029_195463_1338601912_f60fb696615356add19186b6b38d86f3.jpg resize: (2160, 3264) 1338601912 -4.120764399330703 treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5.jpg resize: (2160, 3264) 1338601909 -3.735454630803939 treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c.jpg resize: (2160, 3264) 1338601900 -4.0705689670147835 treat image : temp/1740096029_195463_1338601869_2ca8996f82251b50d6ed3e7774fd1bd7.jpg resize: (2160, 3264) 1338601869 -4.182924270336954 treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430.jpg resize: (2160, 3264) 1338601865 -4.339792578959008 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da.jpg resize: (2160, 3264) 1338601861 -4.97546767523308 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860.jpg resize: (2160, 3264) 1338601857 -5.213781320481584 treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15.jpg resize: (2160, 3264) 1338601850 -3.4487726745624583 treat image : temp/1740096029_195463_1338601912_f60fb696615356add19186b6b38d86f3_rle_crop_3681254639_0.png resize: (655, 686) 1338703564 -3.771234257114285 treat image : temp/1740096029_195463_1338601912_f60fb696615356add19186b6b38d86f3_rle_crop_3681254642_0.png resize: (231, 218) 1338703565 -3.0609928397592494 treat image : temp/1740096029_195463_1338601912_f60fb696615356add19186b6b38d86f3_rle_crop_3681254643_0.png resize: (109, 114) 1338703567 -3.974141618780588 treat image : temp/1740096029_195463_1338601912_f60fb696615356add19186b6b38d86f3_rle_crop_3681254640_0.png resize: (124, 119) 1338703568 -1.6692639518124797 treat image : temp/1740096029_195463_1338601912_f60fb696615356add19186b6b38d86f3_rle_crop_3681254636_0.png resize: (219, 281) 1338703569 -3.862665517590967 treat image : temp/1740096029_195463_1338601912_f60fb696615356add19186b6b38d86f3_rle_crop_3681254638_0.png resize: (157, 133) 1338703570 -4.295737281622827 treat image : temp/1740096029_195463_1338601912_f60fb696615356add19186b6b38d86f3_rle_crop_3681254637_0.png resize: (104, 116) 1338703571 -3.450445012645599 treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254647_0.png resize: (166, 254) 1338703572 -2.8754611057075854 treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254655_0.png resize: (185, 190) 1338703573 -2.172853423383667 treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254648_0.png resize: (104, 100) 1338703574 -3.4694976017074355 treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254657_0.png resize: (250, 220) 1338703575 -4.056063238513551 treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254656_0.png resize: (225, 216) 1338703576 -2.892076615777665 treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254659_0.png resize: (124, 118) 1338703577 -1.4977145881287195 treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254650_0.png resize: (106, 105) 1338703578 -1.9902179003796714 treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254649_0.png resize: (124, 149) 1338703579 -3.8338949010238794 treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254666_0.png resize: (86, 93) 1338703580 -3.093989972491409 treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254668_0.png resize: (185, 203) 1338703581 -3.808470067544291 treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254664_0.png resize: (337, 309) 1338703582 -2.5175716700549047 treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254681_0.png resize: (160, 144) 1338703583 -2.5517947753893258 treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254672_0.png resize: (190, 75) 1338703584 -1.3508342210001862 treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254683_0.png resize: (150, 134) 1338703585 -3.778970183294227 treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254671_0.png resize: (258, 240) 1338703586 -4.169378233237612 treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254663_0.png resize: (184, 196) 1338703587 -1.8545221870046034 treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254665_0.png resize: (206, 195) 1338703588 -2.1555388483211813 treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254677_0.png resize: (150, 157) 1338703589 -3.701903338957617 treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254673_0.png resize: (96, 115) 1338703590 -2.2469116702953924 treat image : temp/1740096029_195463_1338601869_2ca8996f82251b50d6ed3e7774fd1bd7_rle_crop_3681254689_0.png resize: (177, 142) 1338703591 -3.0720469080765698 treat image : temp/1740096029_195463_1338601869_2ca8996f82251b50d6ed3e7774fd1bd7_rle_crop_3681254688_0.png resize: (205, 248) 1338703592 -2.5966621020418392 treat image : temp/1740096029_195463_1338601869_2ca8996f82251b50d6ed3e7774fd1bd7_rle_crop_3681254692_0.png resize: (200, 153) 1338703593 -3.049791506508493 treat image : temp/1740096029_195463_1338601869_2ca8996f82251b50d6ed3e7774fd1bd7_rle_crop_3681254687_0.png resize: (188, 157) 1338703594 -3.794073615013054 treat image : temp/1740096029_195463_1338601869_2ca8996f82251b50d6ed3e7774fd1bd7_rle_crop_3681254693_0.png resize: (103, 133) 1338703595 -0.5932876592784044 treat image : temp/1740096029_195463_1338601869_2ca8996f82251b50d6ed3e7774fd1bd7_rle_crop_3681254685_0.png resize: (77, 126) 1338703596 -3.1105459016505446 treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254698_0.png resize: (141, 111) 1338703597 -1.048134414022488 treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254705_0.png resize: (344, 181) 1338703598 -2.3200901687524684 treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254710_0.png resize: (293, 379) 1338703599 -2.8352289224260416 treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254697_0.png resize: (351, 382) 1338703600 -3.6304155401871907 treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254703_0.png resize: (310, 370) 1338703601 -4.23683709634172 treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254707_0.png resize: (323, 433) 1338703602 -2.985964045637689 treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254706_0.png resize: (68, 126) 1338703603 -2.2027804032118965 treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254694_0.png resize: (188, 225) 1338703604 -1.8598093923445107 treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254695_0.png resize: (479, 434) 1338703605 -3.6196711850623027 treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254709_0.png resize: (236, 257) 1338703606 -3.4981979980839095 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254732_0.png resize: (255, 187) 1338703607 -0.05322682789286084 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254741_0.png resize: (226, 250) 1338703608 -2.00186116049852 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254716_0.png resize: (331, 257) 1338703609 -2.1147588355304126 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254722_0.png resize: (373, 658) 1338703610 -3.89406885221929 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254717_0.png resize: (430, 197) 1338703611 -3.5906704382161045 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254719_0.png resize: (292, 159) 1338703612 -4.007914684930305 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254725_0.png resize: (215, 188) 1338703613 -1.1558168988766186 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254736_0.png resize: (86, 148) 1338703614 2.086648865501125 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254714_0.png resize: (336, 499) 1338703615 -2.549036664218052 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254723_0.png resize: (258, 286) 1338703616 -4.271661078247588 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254731_0.png resize: (72, 183) 1338703617 -0.17725325151590696 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254748_0.png resize: (251, 194) 1338703618 -3.769577450117149 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254742_0.png resize: (426, 148) 1338703619 -3.2435601647590406 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254763_0.png resize: (140, 107) 1338703620 -3.9467306384580967 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254765_0.png resize: (241, 105) 1338703621 -2.726202005463498 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254769_0.png resize: (168, 90) 1338703622 -2.1838296248761613 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254750_0.png resize: (245, 140) 1338703623 -4.109051131795145 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254747_0.png resize: (430, 479) 1338703624 -4.049754466428803 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254749_0.png resize: (183, 267) 1338703625 -2.2710877576760318 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254743_0.png resize: (262, 342) 1338703626 -1.9838310184301176 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254745_0.png resize: (207, 339) 1338703627 -4.89060399156868 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254752_0.png resize: (340, 246) 1338703628 -2.5664764036154577 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254746_0.png resize: (142, 184) 1338703629 -3.4400403674506443 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254767_0.png resize: (85, 49) 1338703631 -0.3591424577358182 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254751_0.png resize: (338, 511) 1338703632 -2.1969383045102826 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254766_0.png resize: (213, 121) 1338703633 -3.940747664749737 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254756_0.png resize: (68, 242) 1338703634 -3.112090072939497 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254744_0.png resize: (262, 324) 1338703635 -2.376939980249124 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254759_0.png resize: (346, 385) 1338703636 -2.757335585126523 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254764_0.png resize: (384, 394) 1338703637 -1.997659175322292 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254753_0.png resize: (209, 199) 1338703638 -4.069321695164219 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254760_0.png resize: (169, 167) 1338703639 -3.245762172173329 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254758_0.png resize: (196, 296) 1338703640 -3.3034358935009447 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254754_0.png resize: (499, 429) 1338703641 -3.8649111994009075 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254755_0.png resize: (209, 135) 1338703642 -3.4849377017947574 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254757_0.png resize: (162, 74) 1338703643 -3.5945794437630285 treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254777_0.png resize: (382, 368) 1338703644 -3.7287510383966374 treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254786_0.png resize: (365, 243) 1338703645 -2.617001722586076 treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254790_0.png resize: (241, 326) 1338703646 -4.127956701958394 treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254793_0.png resize: (170, 141) 1338703647 -0.7905922580787688 treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254787_0.png resize: (263, 184) 1338703648 -1.2906067745897252 treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254770_0.png resize: (126, 205) 1338703649 -0.8152705924568309 treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254774_0.png resize: (283, 156) 1338703650 -2.5185152876535524 treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254773_0.png resize: (397, 286) 1338703651 -3.721535058871045 treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254772_0.png resize: (276, 251) 1338703652 -2.833619276923339 treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254776_0.png resize: (73, 137) 1338703653 -1.24448041480646 treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254783_0.png resize: (136, 147) 1338703654 -0.9807697754589659 treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254788_0.png resize: (105, 112) 1338703655 -2.16140705142516 treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254779_0.png resize: (279, 162) 1338703656 -2.9204565464066414 treat image : temp/1740096029_195463_1338601912_f60fb696615356add19186b6b38d86f3_rle_crop_3681254632_0.png resize: (657, 641) 1338703680 -4.735510752749747 treat image : temp/1740096029_195463_1338601912_f60fb696615356add19186b6b38d86f3_rle_crop_3681254634_0.png resize: (202, 183) 1338703681 -2.434298793900829 treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254662_0.png resize: (553, 864) 1338703682 -3.437468548634404 treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254644_0.png resize: (145, 137) 1338703683 -2.9641579677259253 treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254645_0.png resize: (702, 1112) 1338703684 -2.164680457485337 treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254658_0.png resize: (266, 180) 1338703685 -2.5317559380788475 treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254661_0.png resize: (145, 202) 1338703686 -3.3754517452329607 treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254646_0.png resize: (247, 275) 1338703687 -3.74889383455125 treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254674_0.png resize: (145, 146) 1338703688 -3.479198022698459 treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254676_0.png resize: (155, 100) 1338703689 -1.846042563757242 treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254679_0.png resize: (367, 398) 1338703690 -0.2704070851980953 treat image : temp/1740096029_195463_1338601869_2ca8996f82251b50d6ed3e7774fd1bd7_rle_crop_3681254684_0.png resize: (466, 402) 1338703691 -3.4666150258862665 treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254701_0.png resize: (400, 427) 1338703692 -5.119509391505346 treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254696_0.png resize: (163, 340) 1338703693 -3.2220746548672183 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254713_0.png resize: (204, 295) 1338703694 -2.2811610080538225 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254720_0.png resize: (439, 454) 1338703695 -3.376836454385514 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254739_0.png resize: (310, 419) 1338703696 -3.862424367956854 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254715_0.png resize: (635, 349) 1338703697 -2.056492374478644 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254724_0.png resize: (287, 233) 1338703698 -2.180434444457736 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254728_0.png resize: (158, 347) 1338703699 -3.5756940538239936 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254727_0.png resize: (153, 191) 1338703700 -2.4385662927114935 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254721_0.png resize: (90, 69) 1338703701 -2.2000200792281457 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254737_0.png resize: (120, 404) 1338703702 -3.7180265738413634 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254761_0.png resize: (172, 309) 1338703703 -4.176129171908308 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254768_0.png resize: (145, 257) 1338703704 -2.933918736183484 treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254785_0.png resize: (455, 368) 1338703705 -2.5497368146269004 treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254778_0.png resize: (254, 289) 1338703706 -0.02329198078207581 treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254791_0.png resize: (332, 320) 1338703707 -2.159250706570362 treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254654_0.png resize: (152, 135) 1338703710 -2.999218103707387 treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254680_0.png resize: (247, 144) 1338703711 -3.651936411816016 treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254678_0.png resize: (90, 77) 1338703712 -3.529577806113028 treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254784_0.png resize: (140, 157) 1338703713 -1.2980181417070014 treat image : temp/1740096029_195463_1338601912_f60fb696615356add19186b6b38d86f3_rle_crop_3681254635_0.png resize: (226, 296) 1338703740 -3.566956592661013 treat image : temp/1740096029_195463_1338601912_f60fb696615356add19186b6b38d86f3_rle_crop_3681254633_0.png resize: (349, 358) 1338703742 -3.7782989040053963 treat image : temp/1740096029_195463_1338601912_f60fb696615356add19186b6b38d86f3_rle_crop_3681254641_0.png resize: (362, 904) 1338703743 -0.7886187793694337 treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254651_0.png resize: (335, 1009) 1338703744 -0.8686395891286102 treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254652_0.png resize: (231, 209) 1338703745 -1.9915934962001753 treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254669_0.png resize: (412, 453) 1338703746 -3.2523418069108754 treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254675_0.png resize: (398, 494) 1338703748 -2.532861943988469 treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254667_0.png resize: (297, 219) 1338703749 -3.9438435534406575 treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254670_0.png resize: (417, 1162) 1338703750 -1.2236571754804162 treat image : temp/1740096029_195463_1338601869_2ca8996f82251b50d6ed3e7774fd1bd7_rle_crop_3681254686_0.png resize: (131, 358) 1338703751 -4.407003950283087 treat image : temp/1740096029_195463_1338601869_2ca8996f82251b50d6ed3e7774fd1bd7_rle_crop_3681254690_0.png resize: (142, 255) 1338703752 -3.6499463979833617 treat image : temp/1740096029_195463_1338601869_2ca8996f82251b50d6ed3e7774fd1bd7_rle_crop_3681254691_0.png resize: (350, 919) 1338703754 -1.035711416151893 treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254704_0.png resize: (318, 622) 1338703755 -4.642054459031734 treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254708_0.png resize: (140, 216) 1338703756 -0.5436312675156754 treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254699_0.png resize: (372, 964) 1338703757 -0.9645015343385533 treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254711_0.png resize: (326, 459) 1338703758 -2.648575713302028 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254740_0.png resize: (224, 563) 1338703759 -3.066709560101028 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254735_0.png resize: (811, 713) 1338703760 -4.434353887616636 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254734_0.png resize: (228, 374) 1338703761 -3.26016010009075 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254729_0.png resize: (457, 544) 1338703762 -2.830877791872886 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254718_0.png resize: (191, 341) 1338703763 -3.0694368239289336 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254730_0.png resize: (222, 539) 1338703764 -3.678750542791831 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254738_0.png resize: (309, 519) 1338703765 -1.1941391000648682 treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254762_0.png resize: (354, 372) 1338703766 -4.200327401508801 treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254781_0.png resize: (507, 812) 1338703767 -2.2269243475079707 treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254789_0.png resize: (265, 363) 1338703768 -3.6201126406998205 treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254792_0.png resize: (79, 170) 1338703769 -2.0242267134292797 treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254780_0.png resize: (304, 250) 1338703770 -4.855261833127847 treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254771_0.png resize: (385, 1155) 1338703771 -0.9210894543285405 treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254775_0.png resize: (375, 327) 1338703772 -2.484544157357762 treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254782_0.png resize: (473, 227) 1338703773 -3.4650708586730254 treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254682_0.png resize: (75, 102) 1338703782 -1.986599110856932 treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254712_0.png resize: (191, 220) 1338703783 0.03803122038568874 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254726_0.png resize: (152, 297) 1338703784 -3.0544926790780704 treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254660_0.png resize: (93, 161) 1338703785 -0.1503792880044253 treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254653_0.png resize: (527, 763) 1338703787 -1.5985842114120958 treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254700_0.png resize: (146, 252) 1338703788 -3.182941334826856 treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254702_0.png resize: (131, 216) 1338703789 -3.9227307142484715 treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254733_0.png resize: (68, 308) 1338703790 -2.9622348618721954 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 170 time used for this insertion : 0.022031068801879883 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 170 time used for this insertion : 0.03653860092163086 save missing photos in datou_result : time spend for datou_step_exec : 33.40758967399597 time spend to save output : 0.0672616958618164 total time spend for step 6 : 33.47485136985779 step7:brightness Fri Feb 21 01:07:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1740096029_195463_1338601912_f60fb696615356add19186b6b38d86f3.jpg treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5.jpg treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c.jpg treat image : temp/1740096029_195463_1338601869_2ca8996f82251b50d6ed3e7774fd1bd7.jpg treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430.jpg treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da.jpg treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860.jpg treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15.jpg treat image : temp/1740096029_195463_1338601912_f60fb696615356add19186b6b38d86f3_rle_crop_3681254639_0.png treat image : temp/1740096029_195463_1338601912_f60fb696615356add19186b6b38d86f3_rle_crop_3681254642_0.png treat image : temp/1740096029_195463_1338601912_f60fb696615356add19186b6b38d86f3_rle_crop_3681254643_0.png treat image : temp/1740096029_195463_1338601912_f60fb696615356add19186b6b38d86f3_rle_crop_3681254640_0.png treat image : temp/1740096029_195463_1338601912_f60fb696615356add19186b6b38d86f3_rle_crop_3681254636_0.png treat image : temp/1740096029_195463_1338601912_f60fb696615356add19186b6b38d86f3_rle_crop_3681254638_0.png treat image : temp/1740096029_195463_1338601912_f60fb696615356add19186b6b38d86f3_rle_crop_3681254637_0.png treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254647_0.png treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254655_0.png treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254648_0.png treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254657_0.png treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254656_0.png treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254659_0.png treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254650_0.png treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254649_0.png treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254666_0.png treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254668_0.png treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254664_0.png treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254681_0.png treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254672_0.png treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254683_0.png treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254671_0.png treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254663_0.png treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254665_0.png treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254677_0.png treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254673_0.png treat image : temp/1740096029_195463_1338601869_2ca8996f82251b50d6ed3e7774fd1bd7_rle_crop_3681254689_0.png treat image : temp/1740096029_195463_1338601869_2ca8996f82251b50d6ed3e7774fd1bd7_rle_crop_3681254688_0.png treat image : temp/1740096029_195463_1338601869_2ca8996f82251b50d6ed3e7774fd1bd7_rle_crop_3681254692_0.png treat image : temp/1740096029_195463_1338601869_2ca8996f82251b50d6ed3e7774fd1bd7_rle_crop_3681254687_0.png treat image : temp/1740096029_195463_1338601869_2ca8996f82251b50d6ed3e7774fd1bd7_rle_crop_3681254693_0.png treat image : temp/1740096029_195463_1338601869_2ca8996f82251b50d6ed3e7774fd1bd7_rle_crop_3681254685_0.png treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254698_0.png treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254705_0.png treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254710_0.png treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254697_0.png treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254703_0.png treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254707_0.png treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254706_0.png treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254694_0.png treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254695_0.png treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254709_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254732_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254741_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254716_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254722_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254717_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254719_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254725_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254736_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254714_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254723_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254731_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254748_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254742_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254763_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254765_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254769_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254750_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254747_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254749_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254743_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254745_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254752_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254746_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254767_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254751_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254766_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254756_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254744_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254759_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254764_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254753_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254760_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254758_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254754_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254755_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254757_0.png treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254777_0.png treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254786_0.png treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254790_0.png treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254793_0.png treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254787_0.png treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254770_0.png treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254774_0.png treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254773_0.png treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254772_0.png treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254776_0.png treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254783_0.png treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254788_0.png treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254779_0.png treat image : temp/1740096029_195463_1338601912_f60fb696615356add19186b6b38d86f3_rle_crop_3681254632_0.png treat image : temp/1740096029_195463_1338601912_f60fb696615356add19186b6b38d86f3_rle_crop_3681254634_0.png treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254662_0.png treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254644_0.png treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254645_0.png treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254658_0.png treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254661_0.png treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254646_0.png treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254674_0.png treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254676_0.png treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254679_0.png treat image : temp/1740096029_195463_1338601869_2ca8996f82251b50d6ed3e7774fd1bd7_rle_crop_3681254684_0.png treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254701_0.png treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254696_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254713_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254720_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254739_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254715_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254724_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254728_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254727_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254721_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254737_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254761_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254768_0.png treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254785_0.png treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254778_0.png treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254791_0.png treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254654_0.png treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254680_0.png treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254678_0.png treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254784_0.png treat image : temp/1740096029_195463_1338601912_f60fb696615356add19186b6b38d86f3_rle_crop_3681254635_0.png treat image : temp/1740096029_195463_1338601912_f60fb696615356add19186b6b38d86f3_rle_crop_3681254633_0.png treat image : temp/1740096029_195463_1338601912_f60fb696615356add19186b6b38d86f3_rle_crop_3681254641_0.png treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254651_0.png treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254652_0.png treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254669_0.png treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254675_0.png treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254667_0.png treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254670_0.png treat image : temp/1740096029_195463_1338601869_2ca8996f82251b50d6ed3e7774fd1bd7_rle_crop_3681254686_0.png treat image : temp/1740096029_195463_1338601869_2ca8996f82251b50d6ed3e7774fd1bd7_rle_crop_3681254690_0.png treat image : temp/1740096029_195463_1338601869_2ca8996f82251b50d6ed3e7774fd1bd7_rle_crop_3681254691_0.png treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254704_0.png treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254708_0.png treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254699_0.png treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254711_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254740_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254735_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254734_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254729_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254718_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254730_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254738_0.png treat image : temp/1740096029_195463_1338601857_0e2f3e8e8f6e83c5a3cd2aea6b7a4860_rle_crop_3681254762_0.png treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254781_0.png treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254789_0.png treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254792_0.png treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254780_0.png treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254771_0.png treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254775_0.png treat image : temp/1740096029_195463_1338601850_04d35d14fa2df7302d0d64c8a903db15_rle_crop_3681254782_0.png treat image : temp/1740096029_195463_1338601900_e811d34a0d11b847144cb71797bcc18c_rle_crop_3681254682_0.png treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254712_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254726_0.png treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254660_0.png treat image : temp/1740096029_195463_1338601909_41a1a0290f615bb2cb3ca1279820bed5_rle_crop_3681254653_0.png treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254700_0.png treat image : temp/1740096029_195463_1338601865_febd688d9023aa0299be26824b86b430_rle_crop_3681254702_0.png treat image : temp/1740096029_195463_1338601861_c676aae4440afdfac42ad2edd4d983da_rle_crop_3681254733_0.png Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 170 time used for this insertion : 0.017997026443481445 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 170 time used for this insertion : 0.034217119216918945 save missing photos in datou_result : time spend for datou_step_exec : 8.882413387298584 time spend to save output : 0.0628814697265625 total time spend for step 7 : 8.945294857025146 step8:velours_tree Fri Feb 21 01:07:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure can't find the photo_desc_type Inside saveOutput : final : False verbose : 0 ouput is None No outpout to save, returning out of save general time spend for datou_step_exec : 1.34014892578125 time spend to save output : 4.887580871582031e-05 total time spend for step 8 : 1.3401978015899658 step9:send_mail_cod Fri Feb 21 01:07:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Auto_P20699408_21-02-2025_01_07_21.pdf 20701828 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette207018281740096441 20701829 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette207018291740096442 20701830 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette207018301740096443 20701831 change filename to text .change filename to text .change filename to text .imagette207018311740096445 20701832 change filename to text .change filename to text .change filename to text .change filename to text .imagette207018321740096445 20701834 change filename to text .imagette207018341740096446 20701835 change filename to text .change filename to text .change filename to text .change filename to text .imagette207018351740096446 20701836 imagette207018361740096446 20701837 imagette207018371740096446 20701838 imagette207018381740096446 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20699408 and hashtag_type = 3594 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20701828,20701829,20701830,20701831,20701832,20701833,20701834,20701835,20701836,20701837,20701838?tags=papier,pet_clair,carton,autre,metal,environnement,pehd,pet_fonce,background,mal_croppe,flou args[1338601912] : ((1338601912, -4.120764399330703, 492609224), (1338601912, 0.037697272922608396, 2107752395), '0.16317802656363475') We are sending mail with results at report@fotonower.com args[1338601909] : ((1338601909, -3.735454630803939, 492609224), (1338601909, -0.20716866963626757, 496442774), '0.16317802656363475') We are sending mail with results at report@fotonower.com args[1338601900] : ((1338601900, -4.0705689670147835, 492609224), (1338601900, -0.2668597940464842, 496442774), '0.16317802656363475') We are sending mail with results at report@fotonower.com args[1338601869] : ((1338601869, -4.182924270336954, 492609224), (1338601869, 0.10898393917002364, 2107752395), '0.16317802656363475') We are sending mail with results at report@fotonower.com args[1338601865] : ((1338601865, -4.339792578959008, 492609224), (1338601865, 0.05530794253033991, 2107752395), '0.16317802656363475') We are sending mail with results at report@fotonower.com args[1338601861] : ((1338601861, -4.97546767523308, 492609224), (1338601861, -0.09155135638834594, 496442774), '0.16317802656363475') We are sending mail with results at report@fotonower.com args[1338601857] : ((1338601857, -5.213781320481584, 492609224), (1338601857, -0.13621096707151453, 496442774), '0.16317802656363475') We are sending mail with results at report@fotonower.com args[1338601850] : ((1338601850, -3.4487726745624583, 492609224), (1338601850, -0.05644611636034373, 2107752395), '0.16317802656363475') We are sending mail with results at report@fotonower.com refus_total : 0.16317802656363475 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20699408 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 SELECT photo_id, url FROM MTRBack.photos ph WHERE photo_id IN (1338601850,1338601857,1338601861,1338601865,1338601869,1338601900,1338601909,1338601912) Found this number of photos: 8 begin to download photo : 1338601850 begin to download photo : 1338601861 begin to download photo : 1338601869 begin to download photo : 1338601909 download finish for photo 1338601869 begin to download photo : 1338601900 download finish for photo 1338601909 begin to download photo : 1338601912 download finish for photo 1338601850 begin to download photo : 1338601857 download finish for photo 1338601861 begin to download photo : 1338601865 download finish for photo 1338601900 download finish for photo 1338601912 download finish for photo 1338601857 download finish for photo 1338601865 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20699408_21-02-2025_01_07_21.pdf results_Auto_P20699408_21-02-2025_01_07_21.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20699408_21-02-2025_01_07_21.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('3318','20699408','results_Auto_P20699408_21-02-2025_01_07_21.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20699408_21-02-2025_01_07_21.pdf','pdf','','0.87','0.16317802656363475') message_in_mail: Bonjour,
Veuillez trouver ci dessous les résultats du service carac on demand pour le portfolio: https://www.fotonower.com/view/20699408

https://www.fotonower.com/image?json=false&list_photos_id=1338601912
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1338601909
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1338601900
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1338601869
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1338601865
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1338601861
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1338601857
Bravo, la photo est bien prise.
https://www.fotonower.com/image?json=false&list_photos_id=1338601850
Bravo, la photo est bien prise.

Dans ces conditions,le taux de refus est: 16.32%
Veuillez trouver les photos des contaminants.

exemples de contaminants: papier: https://www.fotonower.com/view/20701828?limit=200
exemples de contaminants: pet_clair: https://www.fotonower.com/view/20701829?limit=200
exemples de contaminants: carton: https://www.fotonower.com/view/20701830?limit=200
exemples de contaminants: autre: https://www.fotonower.com/view/20701831?limit=200
exemples de contaminants: metal: https://www.fotonower.com/view/20701832?limit=200
exemples de contaminants: pehd: https://www.fotonower.com/view/20701834?limit=200
exemples de contaminants: pet_fonce: https://www.fotonower.com/view/20701835?limit=200
Veuillez trouver le rapport en pdf:https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20699408_21-02-2025_01_07_21.pdf.

Lien vers velours :https://www.fotonower.com/velours/20701828,20701829,20701830,20701831,20701832,20701833,20701834,20701835,20701836,20701837,20701838?tags=papier,pet_clair,carton,autre,metal,environnement,pehd,pet_fonce,background,mal_croppe,flou.


L'équipe Fotonower 202 b'' Server: nginx Date: Fri, 21 Feb 2025 00:07:29 GMT Content-Length: 0 Connection: close X-Message-Id: 17RJKx_oQACIrRzenAd4mg Access-Control-Allow-Origin: https://sendgrid.api-docs.io Access-Control-Allow-Methods: POST Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl Access-Control-Max-Age: 600 X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html Strict-Transport-Security: max-age=31536000; includeSubDomains Content-Security-Policy: frame-ancestors 'none' Cache-Control: no-cache X-Content-Type-Options: no-sniff Referrer-Policy: strict-origin-when-cross-origin Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1338601912, 1338601909, 1338601900, 1338601869, 1338601865, 1338601861, 1338601857, 1338601850] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601912', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601909', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601900', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601869', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601865', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601861', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601857', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601850', None, None, None, None, None, '2601834') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 8 time used for this insertion : 0.014832019805908203 save_final save missing photos in datou_result : time spend for datou_step_exec : 8.770072221755981 time spend to save output : 0.015039443969726562 total time spend for step 9 : 8.785111665725708 step10:split_time_score Fri Feb 21 01:07:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 1 VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 861, 'mtr_user_id': 31, 'name': 'Rungis_class_dechets_1212', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Rungis_Aluminium,Rungis_Carton,Rungis_Papier,Rungis_Plastique_clair,Rungis_Plastique_dur,Rungis_Plastique_fonce,Rungis_Tapis_vide,Rungis_Tetrapak', 'svm_portfolios_learning': '1160730,571842,571844,571839,571933,571840,571841,572307', 'photo_hashtag_type': 999, 'photo_desc_type': 3963, 'type_classification': 'caffe', 'hashtag_id_list': '2107751280,2107750907,2107750908,2107750909,2107750910,2107750911,2107750912,2107750913'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('11', 8),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 20022025 20699408 Nombre de photos uploadées : 8 / 23040 (0%) 20022025 20699408 Nombre de photos taguées (types de déchets): 0 / 8 (0%) 20022025 20699408 Nombre de photos taguées (volume) : 0 / 8 (0%) elapsed_time : load_data_split_time_score 2.384185791015625e-06 elapsed_time : order_list_meta_photo_and_scores 6.198883056640625e-06 ???????? elapsed_time : fill_and_build_computed_from_old_data 0.0003895759582519531 elapsed_time : insert_dashboard_record_day_entry 0.028487205505371094 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.9608671591978778 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20699402_21-02-2025_00_49_49.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20699402 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20699402 AND mptpi.`type`=3726 To do Qualite : 0.6267786478778448 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20699403_21-02-2025_00_45_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20699403 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20699403 AND mptpi.`type`=3726 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20699404 order by id desc limit 1 Qualite : 0.3329848280211983 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20699406_21-02-2025_00_39_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20699406 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20699406 AND mptpi.`type`=3726 To do Qualite : 0.16317802656363475 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20699408_21-02-2025_01_07_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20699408 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20699408 AND mptpi.`type`=3594 To do Qualite : 0.6814549659204545 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20699412_21-02-2025_00_35_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20699412 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20699412 AND mptpi.`type`=3726 To do Qualite : 0.20185023706776162 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20699421_21-02-2025_01_06_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20699421 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20699421 AND mptpi.`type`=3594 To do Qualite : 0.21633741933221104 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20699422_21-02-2025_00_52_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20699422 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20699422 AND mptpi.`type`=3594 To do Qualite : 0.7519938324117397 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20699439_21-02-2025_00_19_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20699439 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20699439 AND mptpi.`type`=3726 To do Qualite : 0.2402460767293029 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20699449_21-02-2025_00_43_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20699449 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20699449 AND mptpi.`type`=3594 To do Qualite : 0.16941512806656225 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Auto_P20699470_21-02-2025_00_37_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20699470 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20699470 AND mptpi.`type`=3594 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'20022025': {'nb_upload': 8, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1338601912, 1338601909, 1338601900, 1338601869, 1338601865, 1338601861, 1338601857, 1338601850] Looping around the photos to save general results len do output : 1 /20699408Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601912', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601909', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601900', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601869', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601865', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601861', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601857', None, None, None, None, None, '2601834') ('3318', None, None, None, None, None, None, None, '2601834') ('3318', '20699408', '1338601850', None, None, None, None, None, '2601834') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.01475834846496582 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.136103391647339 time spend to save output : 0.014957427978515625 total time spend for step 10 : 2.1510608196258545 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 8 set_done_treatment 164.14user 161.23system 7:06.16elapsed 76%CPU (0avgtext+0avgdata 4394668maxresident)k 1665432inputs+144440outputs (53345major+16601790minor)pagefaults 0swaps