python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 311655 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2594045'] with mtr_portfolio_ids : ['20615840'] and first list_photo_ids : [] new path : /proc/311655/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 3 ; length of list_pids : 3 ; length of list_args : 3 time to download the photos : 0.36892199516296387 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Mon Feb 17 18:20:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 7679 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-17 18:20:31.335585: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-17 18:20:31.363121: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-17 18:20:31.365477: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f33b0000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-17 18:20:31.365528: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-17 18:20:31.369730: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-17 18:20:31.620930: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1c24f6c0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-17 18:20:31.620976: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-17 18:20:31.622177: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-17 18:20:31.622718: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-17 18:20:31.627091: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-17 18:20:31.630238: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-17 18:20:31.630817: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-17 18:20:31.633569: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-17 18:20:31.634650: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-17 18:20:31.639613: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-17 18:20:31.640940: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-17 18:20:31.641011: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-17 18:20:31.641708: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-17 18:20:31.641726: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-17 18:20:31.641734: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-17 18:20:31.642963: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 7076 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-17 18:20:31.949414: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-17 18:20:31.949507: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-17 18:20:31.949528: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-17 18:20:31.949551: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-17 18:20:31.949569: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-17 18:20:31.949594: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-17 18:20:31.949614: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-17 18:20:31.949633: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-17 18:20:31.951180: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-17 18:20:31.952561: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-17 18:20:31.952598: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-17 18:20:31.952612: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-17 18:20:31.952624: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-17 18:20:31.952636: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-17 18:20:31.952648: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-17 18:20:31.952662: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-17 18:20:31.952678: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-17 18:20:31.953792: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-17 18:20:31.953827: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-17 18:20:31.953837: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-17 18:20:31.953846: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-17 18:20:31.955146: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 7076 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-17 18:20:40.691565: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-17 18:20:40.854607: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 3 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.31328 max: 147.12734 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.00012159347534179688 nb_pixel_total : 930 time to create 1 rle with old method : 0.001918792724609375 length of segment : 41 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 93 time to create 1 rle with old method : 0.00026679039001464844 length of segment : 16 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 151 time to create 1 rle with old method : 0.0003437995910644531 length of segment : 33 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 872 time to create 1 rle with old method : 0.0017900466918945312 length of segment : 36 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 155 time to create 1 rle with old method : 0.0003402233123779297 length of segment : 31 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 1 time to create 1 rle with old method : 2.9325485229492188e-05 length of segment : 1 time for calcul the mask position with numpy : 8.678436279296875e-05 nb_pixel_total : 1769 time to create 1 rle with old method : 0.003456592559814453 length of segment : 46 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.52813 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 422 time to create 1 rle with old method : 0.0006649494171142578 length of segment : 41 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 598 time to create 1 rle with old method : 0.0009641647338867188 length of segment : 33 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 786 time to create 1 rle with old method : 0.0011606216430664062 length of segment : 82 time for calcul the mask position with numpy : 0.00010180473327636719 nb_pixel_total : 2242 time to create 1 rle with old method : 0.0034437179565429688 length of segment : 51 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 46 time to create 1 rle with old method : 0.00010800361633300781 length of segment : 7 time for calcul the mask position with numpy : 8.392333984375e-05 nb_pixel_total : 2597 time to create 1 rle with old method : 0.003714323043823242 length of segment : 54 Processing 1 images image shape: (400, 400, 3) min: 22.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -101.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 0.00011801719665527344 nb_pixel_total : 1029 time to create 1 rle with old method : 0.0018210411071777344 length of segment : 87 time for calcul the mask position with numpy : 0.00016832351684570312 nb_pixel_total : 2298 time to create 1 rle with old method : 0.0034270286560058594 length of segment : 58 time for calcul the mask position with numpy : 0.0003867149353027344 nb_pixel_total : 18821 time to create 1 rle with old method : 0.023669719696044922 length of segment : 133 time for calcul the mask position with numpy : 0.00011348724365234375 nb_pixel_total : 2453 time to create 1 rle with old method : 0.0033712387084960938 length of segment : 66 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.28984 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 465 time to create 1 rle with old method : 0.0007772445678710938 length of segment : 24 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 713 time to create 1 rle with old method : 0.0016717910766601562 length of segment : 59 time for calcul the mask position with numpy : 8.0108642578125e-05 nb_pixel_total : 298 time to create 1 rle with old method : 0.0007941722869873047 length of segment : 20 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 102 time to create 1 rle with old method : 0.0002219676971435547 length of segment : 16 time for calcul the mask position with numpy : 0.0002193450927734375 nb_pixel_total : 10608 time to create 1 rle with old method : 0.012791156768798828 length of segment : 102 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 1033 time to create 1 rle with old method : 0.0013844966888427734 length of segment : 40 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 1195 time to create 1 rle with old method : 0.0015556812286376953 length of segment : 43 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 423 time to create 1 rle with old method : 0.0007376670837402344 length of segment : 24 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.77187 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 521 time to create 1 rle with old method : 0.0009641647338867188 length of segment : 21 time for calcul the mask position with numpy : 0.00010776519775390625 nb_pixel_total : 2009 time to create 1 rle with old method : 0.002821207046508789 length of segment : 68 time for calcul the mask position with numpy : 0.0005297660827636719 nb_pixel_total : 48773 time to create 1 rle with old method : 0.06712150573730469 length of segment : 292 time for calcul the mask position with numpy : 9.012222290039062e-05 nb_pixel_total : 371 time to create 1 rle with old method : 0.0006270408630371094 length of segment : 38 time for calcul the mask position with numpy : 0.00010704994201660156 nb_pixel_total : 880 time to create 1 rle with old method : 0.0014276504516601562 length of segment : 129 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 133 time to create 1 rle with old method : 0.00030231475830078125 length of segment : 11 Processing 1 images image shape: (400, 400, 3) min: 17.00000 max: 216.00000 molded_images shape: (1, 640, 640, 3) min: -88.86406 max: 82.75625 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0013284683227539062 nb_pixel_total : 154226 time to create 1 rle with new method : 0.002222776412963867 length of segment : 404 Processing 1 images image shape: (400, 400, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -102.60625 max: 148.89297 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.0001900196075439453 nb_pixel_total : 9709 time to create 1 rle with old method : 0.01317739486694336 length of segment : 125 time for calcul the mask position with numpy : 0.00013303756713867188 nb_pixel_total : 2453 time to create 1 rle with old method : 0.0035195350646972656 length of segment : 48 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 1292 time to create 1 rle with old method : 0.0018324851989746094 length of segment : 29 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.00028777122497558594 length of segment : 25 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 483 time to create 1 rle with old method : 0.0008175373077392578 length of segment : 17 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.15547 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 220 time to create 1 rle with old method : 0.0003654956817626953 length of segment : 15 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 177 time to create 1 rle with old method : 0.00031566619873046875 length of segment : 23 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 156 time to create 1 rle with old method : 0.00025463104248046875 length of segment : 14 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.00021147727966308594 length of segment : 16 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 169 time to create 1 rle with old method : 0.0002524852752685547 length of segment : 21 time for calcul the mask position with numpy : 0.0004048347473144531 nb_pixel_total : 10703 time to create 1 rle with old method : 0.012950897216796875 length of segment : 213 time for calcul the mask position with numpy : 9.012222290039062e-05 nb_pixel_total : 294 time to create 1 rle with old method : 0.0004742145538330078 length of segment : 37 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 365 time to create 1 rle with old method : 0.0007052421569824219 length of segment : 7 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 217 time to create 1 rle with old method : 0.0003306865692138672 length of segment : 17 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 210 time to create 1 rle with old method : 0.00034546852111816406 length of segment : 14 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 209 time to create 1 rle with old method : 0.00032639503479003906 length of segment : 14 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.60625 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 236 time to create 1 rle with old method : 0.00036263465881347656 length of segment : 25 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 786 time to create 1 rle with old method : 0.0010509490966796875 length of segment : 40 time for calcul the mask position with numpy : 0.00037026405334472656 nb_pixel_total : 15973 time to create 1 rle with old method : 0.01884317398071289 length of segment : 243 time for calcul the mask position with numpy : 0.0002086162567138672 nb_pixel_total : 991 time to create 1 rle with old method : 0.0016036033630371094 length of segment : 128 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 187 time to create 1 rle with old method : 0.00040912628173828125 length of segment : 19 time for calcul the mask position with numpy : 0.00013756752014160156 nb_pixel_total : 2627 time to create 1 rle with old method : 0.0032303333282470703 length of segment : 119 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 886 time to create 1 rle with old method : 0.0012636184692382812 length of segment : 24 time for calcul the mask position with numpy : 7.343292236328125e-05 nb_pixel_total : 694 time to create 1 rle with old method : 0.0009751319885253906 length of segment : 69 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 161 time to create 1 rle with old method : 0.0002703666687011719 length of segment : 13 time for calcul the mask position with numpy : 0.00029969215393066406 nb_pixel_total : 13694 time to create 1 rle with old method : 0.01661515235900879 length of segment : 143 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.0002734661102294922 length of segment : 15 time for calcul the mask position with numpy : 0.0004372596740722656 nb_pixel_total : 11024 time to create 1 rle with old method : 0.013594627380371094 length of segment : 180 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.06875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 8.273124694824219e-05 nb_pixel_total : 2202 time to create 1 rle with old method : 0.0029709339141845703 length of segment : 128 time for calcul the mask position with numpy : 0.0001316070556640625 nb_pixel_total : 2582 time to create 1 rle with old method : 0.003277301788330078 length of segment : 126 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 175 time to create 1 rle with old method : 0.0002765655517578125 length of segment : 30 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 1744 time to create 1 rle with old method : 0.0023195743560791016 length of segment : 41 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 564 time to create 1 rle with old method : 0.0008890628814697266 length of segment : 34 time for calcul the mask position with numpy : 8.654594421386719e-05 nb_pixel_total : 393 time to create 1 rle with old method : 0.0006003379821777344 length of segment : 56 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 492 time to create 1 rle with old method : 0.0007615089416503906 length of segment : 30 time for calcul the mask position with numpy : 9.059906005859375e-05 nb_pixel_total : 1893 time to create 1 rle with old method : 0.002382516860961914 length of segment : 89 time for calcul the mask position with numpy : 0.00020956993103027344 nb_pixel_total : 3528 time to create 1 rle with old method : 0.00443720817565918 length of segment : 238 Processing 1 images image shape: (280, 400, 3) min: 13.00000 max: 197.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 76.03750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.00212860107421875 nb_pixel_total : 105942 time to create 1 rle with old method : 0.16446971893310547 length of segment : 279 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.79922 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 0.00010704994201660156 nb_pixel_total : 2951 time to create 1 rle with old method : 0.0053293704986572266 length of segment : 49 time for calcul the mask position with numpy : 0.0001735687255859375 nb_pixel_total : 4563 time to create 1 rle with old method : 0.008071660995483398 length of segment : 113 time for calcul the mask position with numpy : 0.00012683868408203125 nb_pixel_total : 3163 time to create 1 rle with old method : 0.005706787109375 length of segment : 113 time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 1082 time to create 1 rle with old method : 0.0019268989562988281 length of segment : 64 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 312 time to create 1 rle with old method : 0.0006301403045654297 length of segment : 28 time for calcul the mask position with numpy : 9.465217590332031e-05 nb_pixel_total : 1985 time to create 1 rle with old method : 0.0034608840942382812 length of segment : 75 time for calcul the mask position with numpy : 0.0003132820129394531 nb_pixel_total : 3340 time to create 1 rle with old method : 0.007025957107543945 length of segment : 56 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.00024580955505371094 length of segment : 12 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 236 time to create 1 rle with old method : 0.0003783702850341797 length of segment : 23 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.22109 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 20 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 225 time to create 1 rle with old method : 0.0004267692565917969 length of segment : 11 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 102 time to create 1 rle with old method : 0.00019121170043945312 length of segment : 18 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 490 time to create 1 rle with old method : 0.0006535053253173828 length of segment : 36 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 350 time to create 1 rle with old method : 0.0005221366882324219 length of segment : 29 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.00036835670471191406 length of segment : 16 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 532 time to create 1 rle with old method : 0.0007359981536865234 length of segment : 28 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 655 time to create 1 rle with old method : 0.0009260177612304688 length of segment : 32 time for calcul the mask position with numpy : 8.106231689453125e-05 nb_pixel_total : 947 time to create 1 rle with old method : 0.0019292831420898438 length of segment : 29 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.0003795623779296875 length of segment : 20 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.00030040740966796875 length of segment : 22 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 186 time to create 1 rle with old method : 0.0003077983856201172 length of segment : 19 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 421 time to create 1 rle with old method : 0.0006062984466552734 length of segment : 25 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 124 time to create 1 rle with old method : 0.00020503997802734375 length of segment : 12 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 355 time to create 1 rle with old method : 0.0005259513854980469 length of segment : 20 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003592967987060547 length of segment : 26 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 329 time to create 1 rle with old method : 0.00048661231994628906 length of segment : 23 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 169 time to create 1 rle with old method : 0.00028824806213378906 length of segment : 12 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 499 time to create 1 rle with old method : 0.0006806850433349609 length of segment : 48 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 231 time to create 1 rle with old method : 0.0003914833068847656 length of segment : 21 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.0004100799560546875 length of segment : 54 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.00234 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 8.344650268554688e-05 nb_pixel_total : 513 time to create 1 rle with old method : 0.0009815692901611328 length of segment : 45 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 156 time to create 1 rle with old method : 0.00037598609924316406 length of segment : 12 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 577 time to create 1 rle with old method : 0.001720428466796875 length of segment : 29 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 556 time to create 1 rle with old method : 0.001645803451538086 length of segment : 47 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 163 time to create 1 rle with old method : 0.0003466606140136719 length of segment : 22 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.00044083595275878906 length of segment : 16 time for calcul the mask position with numpy : 9.703636169433594e-05 nb_pixel_total : 353 time to create 1 rle with old method : 0.0007989406585693359 length of segment : 61 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 339 time to create 1 rle with old method : 0.0006389617919921875 length of segment : 28 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 649 time to create 1 rle with old method : 0.0011625289916992188 length of segment : 40 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.0003516674041748047 length of segment : 14 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 111 time to create 1 rle with old method : 0.0002846717834472656 length of segment : 12 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.0002562999725341797 length of segment : 15 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 362 time to create 1 rle with old method : 0.0005247592926025391 length of segment : 42 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 583 time to create 1 rle with old method : 0.0008318424224853516 length of segment : 33 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 341 time to create 1 rle with old method : 0.0005450248718261719 length of segment : 25 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 133.78750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 93 time to create 1 rle with old method : 0.0003249645233154297 length of segment : 43 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 576 time to create 1 rle with old method : 0.0011031627655029297 length of segment : 36 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.94219 max: 145.42812 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 885 time to create 1 rle with old method : 0.0011987686157226562 length of segment : 40 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 50 time to create 1 rle with old method : 0.00014662742614746094 length of segment : 16 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 102 time to create 1 rle with old method : 0.0001659393310546875 length of segment : 28 time for calcul the mask position with numpy : 0.00016236305236816406 nb_pixel_total : 2961 time to create 1 rle with old method : 0.0039441585540771484 length of segment : 129 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 110 time to create 1 rle with old method : 0.00019359588623046875 length of segment : 36 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 38 time to create 1 rle with old method : 0.00013971328735351562 length of segment : 4 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.89922 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 7.557868957519531e-05 nb_pixel_total : 636 time to create 1 rle with old method : 0.0012392997741699219 length of segment : 31 time for calcul the mask position with numpy : 7.510185241699219e-05 nb_pixel_total : 896 time to create 1 rle with old method : 0.0016491413116455078 length of segment : 58 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 634 time to create 1 rle with old method : 0.0012857913970947266 length of segment : 35 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 343 time to create 1 rle with old method : 0.0006930828094482422 length of segment : 35 time for calcul the mask position with numpy : 0.0001010894775390625 nb_pixel_total : 2424 time to create 1 rle with old method : 0.004350185394287109 length of segment : 50 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 45 time to create 1 rle with old method : 0.0001323223114013672 length of segment : 7 time for calcul the mask position with numpy : 8.654594421386719e-05 nb_pixel_total : 2353 time to create 1 rle with old method : 0.004233360290527344 length of segment : 46 time for calcul the mask position with numpy : 0.00011134147644042969 nb_pixel_total : 2442 time to create 1 rle with old method : 0.004266023635864258 length of segment : 77 Processing 1 images image shape: (400, 400, 3) min: 23.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -87.89922 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 622 time to create 1 rle with old method : 0.001249551773071289 length of segment : 29 time for calcul the mask position with numpy : 0.00013685226440429688 nb_pixel_total : 2346 time to create 1 rle with old method : 0.004366636276245117 length of segment : 67 time for calcul the mask position with numpy : 0.0001380443572998047 nb_pixel_total : 2454 time to create 1 rle with old method : 0.004373311996459961 length of segment : 62 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.55156 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 466 time to create 1 rle with old method : 0.0009775161743164062 length of segment : 25 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 282 time to create 1 rle with old method : 0.0005693435668945312 length of segment : 21 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 643 time to create 1 rle with old method : 0.0012323856353759766 length of segment : 75 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 1094 time to create 1 rle with old method : 0.001972198486328125 length of segment : 42 time for calcul the mask position with numpy : 0.00028443336486816406 nb_pixel_total : 10480 time to create 1 rle with old method : 0.017772674560546875 length of segment : 81 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 455 time to create 1 rle with old method : 0.0010361671447753906 length of segment : 26 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 429 time to create 1 rle with old method : 0.0006690025329589844 length of segment : 42 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 54 time to create 1 rle with old method : 0.00018644332885742188 length of segment : 11 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 135.18984 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 8.559226989746094e-05 nb_pixel_total : 1341 time to create 1 rle with old method : 0.0023550987243652344 length of segment : 145 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 556 time to create 1 rle with old method : 0.0011088848114013672 length of segment : 21 time for calcul the mask position with numpy : 9.655952453613281e-05 nb_pixel_total : 1756 time to create 1 rle with old method : 0.0033407211303710938 length of segment : 73 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 538 time to create 1 rle with old method : 0.0010945796966552734 length of segment : 24 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 348 time to create 1 rle with old method : 0.0006561279296875 length of segment : 34 time for calcul the mask position with numpy : 0.0008249282836914062 nb_pixel_total : 59483 time to create 1 rle with old method : 0.07598471641540527 length of segment : 284 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 1905 time to create 1 rle with old method : 0.002927541732788086 length of segment : 51 Processing 1 images image shape: (400, 400, 3) min: 26.00000 max: 211.00000 molded_images shape: (1, 640, 640, 3) min: -88.86406 max: 77.54141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 9.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -108.41875 max: 149.06875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 1228 time to create 1 rle with old method : 0.0020236968994140625 length of segment : 25 time for calcul the mask position with numpy : 0.00015664100646972656 nb_pixel_total : 8876 time to create 1 rle with old method : 0.011295557022094727 length of segment : 121 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 174 time to create 1 rle with old method : 0.0002589225769042969 length of segment : 24 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 323 time to create 1 rle with old method : 0.0005283355712890625 length of segment : 14 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 607 time to create 1 rle with old method : 0.0008451938629150391 length of segment : 37 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 483 time to create 1 rle with old method : 0.0008006095886230469 length of segment : 35 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -110.38203 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.00026988983154296875 length of segment : 22 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.0003159046173095703 length of segment : 13 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 1092 time to create 1 rle with old method : 0.0014891624450683594 length of segment : 52 time for calcul the mask position with numpy : 0.00023865699768066406 nb_pixel_total : 14943 time to create 1 rle with old method : 0.017757415771484375 length of segment : 113 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 119 time to create 1 rle with old method : 0.00025582313537597656 length of segment : 10 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.00027179718017578125 length of segment : 22 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 1006 time to create 1 rle with old method : 0.0015175342559814453 length of segment : 39 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 161 time to create 1 rle with old method : 0.0002944469451904297 length of segment : 13 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 153 time to create 1 rle with old method : 0.0003421306610107422 length of segment : 13 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 869 time to create 1 rle with old method : 0.0017299652099609375 length of segment : 39 time for calcul the mask position with numpy : 9.5367431640625e-05 nb_pixel_total : 1038 time to create 1 rle with old method : 0.0019230842590332031 length of segment : 40 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 153 time to create 1 rle with old method : 0.00033974647521972656 length of segment : 18 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 732 time to create 1 rle with old method : 0.0010504722595214844 length of segment : 29 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 514 time to create 1 rle with old method : 0.0008029937744140625 length of segment : 65 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 1063 time to create 1 rle with old method : 0.0014138221740722656 length of segment : 40 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.57734 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 21 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 194 time to create 1 rle with old method : 0.00031447410583496094 length of segment : 22 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 898 time to create 1 rle with old method : 0.0012803077697753906 length of segment : 25 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 1101 time to create 1 rle with old method : 0.0017118453979492188 length of segment : 43 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.00038433074951171875 length of segment : 15 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 553 time to create 1 rle with old method : 0.0008835792541503906 length of segment : 51 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 1053 time to create 1 rle with old method : 0.0016002655029296875 length of segment : 23 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 711 time to create 1 rle with old method : 0.0009255409240722656 length of segment : 37 time for calcul the mask position with numpy : 7.772445678710938e-05 nb_pixel_total : 2028 time to create 1 rle with old method : 0.002717256546020508 length of segment : 47 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 303 time to create 1 rle with old method : 0.0004367828369140625 length of segment : 46 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 258 time to create 1 rle with old method : 0.0003981590270996094 length of segment : 19 time for calcul the mask position with numpy : 9.5367431640625e-05 nb_pixel_total : 914 time to create 1 rle with old method : 0.0012502670288085938 length of segment : 42 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 125 time to create 1 rle with old method : 0.0003135204315185547 length of segment : 6 time for calcul the mask position with numpy : 9.417533874511719e-05 nb_pixel_total : 48 time to create 1 rle with old method : 0.0001227855682373047 length of segment : 11 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 181 time to create 1 rle with old method : 0.00040340423583984375 length of segment : 13 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 252 time to create 1 rle with old method : 0.0005247592926025391 length of segment : 25 length of segment : 0 time for calcul the mask position with numpy : 0.0002608299255371094 nb_pixel_total : 2493 time to create 1 rle with old method : 0.00426173210144043 length of segment : 132 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 359 time to create 1 rle with old method : 0.0007922649383544922 length of segment : 21 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 90 time to create 1 rle with old method : 0.0002474784851074219 length of segment : 5 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 358 time to create 1 rle with old method : 0.0007417201995849609 length of segment : 22 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 259 time to create 1 rle with old method : 0.0004711151123046875 length of segment : 18 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.03750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 1030 time to create 1 rle with old method : 0.0014619827270507812 length of segment : 97 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 607 time to create 1 rle with old method : 0.0009441375732421875 length of segment : 28 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 1758 time to create 1 rle with old method : 0.0023298263549804688 length of segment : 40 time for calcul the mask position with numpy : 8.654594421386719e-05 nb_pixel_total : 1658 time to create 1 rle with old method : 0.0021257400512695312 length of segment : 83 time for calcul the mask position with numpy : 0.00010561943054199219 nb_pixel_total : 283 time to create 1 rle with old method : 0.0006701946258544922 length of segment : 46 time for calcul the mask position with numpy : 0.000240325927734375 nb_pixel_total : 3718 time to create 1 rle with old method : 0.004621744155883789 length of segment : 193 Processing 1 images image shape: (280, 400, 3) min: 13.00000 max: 204.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 78.06875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.001260995864868164 nb_pixel_total : 105567 time to create 1 rle with old method : 0.1248331069946289 length of segment : 283 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 595 time to create 1 rle with old method : 0.0008218288421630859 length of segment : 51 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.61172 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 0.0001609325408935547 nb_pixel_total : 7258 time to create 1 rle with old method : 0.00866556167602539 length of segment : 170 time for calcul the mask position with numpy : 0.00018906593322753906 nb_pixel_total : 4149 time to create 1 rle with old method : 0.005069255828857422 length of segment : 99 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 700 time to create 1 rle with old method : 0.0010650157928466797 length of segment : 31 time for calcul the mask position with numpy : 9.441375732421875e-05 nb_pixel_total : 3225 time to create 1 rle with old method : 0.004099845886230469 length of segment : 54 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.00046133995056152344 length of segment : 23 time for calcul the mask position with numpy : 0.00010418891906738281 nb_pixel_total : 2803 time to create 1 rle with old method : 0.0035355091094970703 length of segment : 49 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 569 time to create 1 rle with old method : 0.0007505416870117188 length of segment : 44 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 335 time to create 1 rle with old method : 0.0004813671112060547 length of segment : 25 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.57266 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 196 time to create 1 rle with old method : 0.0003414154052734375 length of segment : 10 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 276 time to create 1 rle with old method : 0.0004305839538574219 length of segment : 18 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 104 time to create 1 rle with old method : 0.0002052783966064453 length of segment : 19 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 225 time to create 1 rle with old method : 0.0006337165832519531 length of segment : 22 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 354 time to create 1 rle with old method : 0.0005178451538085938 length of segment : 28 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 354 time to create 1 rle with old method : 0.0005021095275878906 length of segment : 26 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 187 time to create 1 rle with old method : 0.0002989768981933594 length of segment : 21 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 1247 time to create 1 rle with old method : 0.00162506103515625 length of segment : 41 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.0003147125244140625 length of segment : 28 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 364 time to create 1 rle with old method : 0.0005271434783935547 length of segment : 25 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 92 time to create 1 rle with old method : 0.00016546249389648438 length of segment : 16 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.0003714561462402344 length of segment : 11 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.0002980232238769531 length of segment : 20 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 424 time to create 1 rle with old method : 0.0005846023559570312 length of segment : 28 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 237 time to create 1 rle with old method : 0.0005967617034912109 length of segment : 11 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.44375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 199 time to create 1 rle with old method : 0.0002830028533935547 length of segment : 30 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.00045299530029296875 length of segment : 47 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 583 time to create 1 rle with old method : 0.0007834434509277344 length of segment : 34 time for calcul the mask position with numpy : 7.510185241699219e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.00032973289489746094 length of segment : 38 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 771 time to create 1 rle with old method : 0.0010437965393066406 length of segment : 55 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 168 time to create 1 rle with old method : 0.00028204917907714844 length of segment : 24 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 160 time to create 1 rle with old method : 0.0003719329833984375 length of segment : 12 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 263 time to create 1 rle with old method : 0.0003757476806640625 length of segment : 29 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 487 time to create 1 rle with old method : 0.0007293224334716797 length of segment : 26 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 587 time to create 1 rle with old method : 0.0007948875427246094 length of segment : 41 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.00044918060302734375 length of segment : 26 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 74 time to create 1 rle with old method : 0.00014591217041015625 length of segment : 25 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 365 time to create 1 rle with old method : 0.0005128383636474609 length of segment : 36 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 116 time to create 1 rle with old method : 0.00018739700317382812 length of segment : 14 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 132.03750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 16 time to create 1 rle with old method : 6.651878356933594e-05 length of segment : 11 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.94219 max: 145.42812 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 791 time to create 1 rle with old method : 0.0010905265808105469 length of segment : 39 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 63 time to create 1 rle with old method : 0.0001838207244873047 length of segment : 17 time for calcul the mask position with numpy : 0.0002071857452392578 nb_pixel_total : 3180 time to create 1 rle with old method : 0.005322694778442383 length of segment : 133 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 788 time to create 1 rle with old method : 0.0011510848999023438 length of segment : 33 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 123 time to create 1 rle with old method : 0.00019311904907226562 length of segment : 35 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 2 time to create 1 rle with old method : 2.2649765014648438e-05 length of segment : 1 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 139 time to create 1 rle with old method : 0.00021147727966308594 length of segment : 33 time for calcul the mask position with numpy : 0.00033783912658691406 nb_pixel_total : 8671 time to create 1 rle with old method : 0.011158943176269531 length of segment : 224 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.32891 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 8.058547973632812e-05 nb_pixel_total : 2215 time to create 1 rle with old method : 0.0039157867431640625 length of segment : 46 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.0006334781646728516 length of segment : 34 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 994 time to create 1 rle with old method : 0.001813650131225586 length of segment : 64 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 79 time to create 1 rle with old method : 0.00018095970153808594 length of segment : 16 Processing 1 images image shape: (400, 400, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -88.50859 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 8.416175842285156e-05 nb_pixel_total : 2184 time to create 1 rle with old method : 0.0029320716857910156 length of segment : 58 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 467 time to create 1 rle with old method : 0.0006768703460693359 length of segment : 23 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.47344 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 7.700920104980469e-05 nb_pixel_total : 1006 time to create 1 rle with old method : 0.001310110092163086 length of segment : 61 time for calcul the mask position with numpy : 8.034706115722656e-05 nb_pixel_total : 436 time to create 1 rle with old method : 0.0008118152618408203 length of segment : 25 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 430 time to create 1 rle with old method : 0.0006783008575439453 length of segment : 23 time for calcul the mask position with numpy : 0.0001647472381591797 nb_pixel_total : 9288 time to create 1 rle with old method : 0.011630773544311523 length of segment : 112 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 96 time to create 1 rle with old method : 0.00017905235290527344 length of segment : 15 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 1182 time to create 1 rle with old method : 0.0015208721160888672 length of segment : 43 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 267 time to create 1 rle with old method : 0.0003941059112548828 length of segment : 20 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 87 time to create 1 rle with old method : 0.00014495849609375 length of segment : 13 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.00020265579223632812 length of segment : 17 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 1122 time to create 1 rle with old method : 0.001485586166381836 length of segment : 41 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.12344 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 531 time to create 1 rle with old method : 0.0007872581481933594 length of segment : 20 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 93 time to create 1 rle with old method : 0.0002269744873046875 length of segment : 10 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1290 time to create 1 rle with old method : 0.0017635822296142578 length of segment : 52 Processing 1 images image shape: (400, 400, 3) min: 25.00000 max: 213.00000 molded_images shape: (1, 640, 640, 3) min: -85.71563 max: 78.36562 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 10.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -102.34844 max: 149.16641 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 8.20159912109375e-05 nb_pixel_total : 2631 time to create 1 rle with old method : 0.0037615299224853516 length of segment : 49 time for calcul the mask position with numpy : 0.00022268295288085938 nb_pixel_total : 9004 time to create 1 rle with old method : 0.011278629302978516 length of segment : 134 time for calcul the mask position with numpy : 9.226799011230469e-05 nb_pixel_total : 1103 time to create 1 rle with old method : 0.0020084381103515625 length of segment : 27 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 215 time to create 1 rle with old method : 0.0004093647003173828 length of segment : 26 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 433 time to create 1 rle with old method : 0.0009670257568359375 length of segment : 18 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -102.49766 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 196 time to create 1 rle with old method : 0.00029754638671875 length of segment : 25 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 212 time to create 1 rle with old method : 0.00035452842712402344 length of segment : 15 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.0002372264862060547 length of segment : 14 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 1089 time to create 1 rle with old method : 0.0014257431030273438 length of segment : 50 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 141 time to create 1 rle with old method : 0.0003764629364013672 length of segment : 17 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 1326 time to create 1 rle with old method : 0.0021681785583496094 length of segment : 41 time for calcul the mask position with numpy : 0.0002696514129638672 nb_pixel_total : 15335 time to create 1 rle with old method : 0.01825094223022461 length of segment : 112 time for calcul the mask position with numpy : 7.414817810058594e-05 nb_pixel_total : 853 time to create 1 rle with old method : 0.0015726089477539062 length of segment : 38 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.00023221969604492188 length of segment : 21 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 178 time to create 1 rle with old method : 0.0002949237823486328 length of segment : 22 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 876 time to create 1 rle with old method : 0.0013020038604736328 length of segment : 40 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 130 time to create 1 rle with old method : 0.0002319812774658203 length of segment : 8 time for calcul the mask position with numpy : 0.00016808509826660156 nb_pixel_total : 11180 time to create 1 rle with old method : 0.014746427536010742 length of segment : 91 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.22734 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 9.107589721679688e-05 nb_pixel_total : 327 time to create 1 rle with old method : 0.0005042552947998047 length of segment : 19 time for calcul the mask position with numpy : 8.7738037109375e-05 nb_pixel_total : 1350 time to create 1 rle with old method : 0.0019333362579345703 length of segment : 53 time for calcul the mask position with numpy : 0.0003654956817626953 nb_pixel_total : 14163 time to create 1 rle with old method : 0.018548965454101562 length of segment : 234 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 250 time to create 1 rle with old method : 0.00041556358337402344 length of segment : 30 time for calcul the mask position with numpy : 9.846687316894531e-05 nb_pixel_total : 3440 time to create 1 rle with old method : 0.005082845687866211 length of segment : 73 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 154 time to create 1 rle with old method : 0.00025463104248046875 length of segment : 21 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 1723 time to create 1 rle with old method : 0.0024204254150390625 length of segment : 52 time for calcul the mask position with numpy : 8.559226989746094e-05 nb_pixel_total : 1923 time to create 1 rle with old method : 0.0026264190673828125 length of segment : 57 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 897 time to create 1 rle with old method : 0.0015091896057128906 length of segment : 25 time for calcul the mask position with numpy : 0.00012922286987304688 nb_pixel_total : 964 time to create 1 rle with old method : 0.0016450881958007812 length of segment : 139 time for calcul the mask position with numpy : 7.343292236328125e-05 nb_pixel_total : 440 time to create 1 rle with old method : 0.0008034706115722656 length of segment : 25 time for calcul the mask position with numpy : 0.0001957416534423828 nb_pixel_total : 6715 time to create 1 rle with old method : 0.009351491928100586 length of segment : 86 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 302 time to create 1 rle with old method : 0.0005939006805419922 length of segment : 44 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 221 time to create 1 rle with old method : 0.0003275871276855469 length of segment : 19 time for calcul the mask position with numpy : 0.0002124309539794922 nb_pixel_total : 7161 time to create 1 rle with old method : 0.010493755340576172 length of segment : 88 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.82266 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 9.703636169433594e-05 nb_pixel_total : 1795 time to create 1 rle with old method : 0.0027205944061279297 length of segment : 133 time for calcul the mask position with numpy : 0.000125885009765625 nb_pixel_total : 2055 time to create 1 rle with old method : 0.002927064895629883 length of segment : 133 time for calcul the mask position with numpy : 0.00012874603271484375 nb_pixel_total : 2262 time to create 1 rle with old method : 0.0032122135162353516 length of segment : 241 time for calcul the mask position with numpy : 7.367134094238281e-05 nb_pixel_total : 1842 time to create 1 rle with old method : 0.002477884292602539 length of segment : 46 time for calcul the mask position with numpy : 0.00023937225341796875 nb_pixel_total : 3007 time to create 1 rle with old method : 0.003991365432739258 length of segment : 197 time for calcul the mask position with numpy : 8.392333984375e-05 nb_pixel_total : 1830 time to create 1 rle with old method : 0.0025322437286376953 length of segment : 87 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 729 time to create 1 rle with old method : 0.0011425018310546875 length of segment : 73 time for calcul the mask position with numpy : 0.0001900196075439453 nb_pixel_total : 3668 time to create 1 rle with old method : 0.004960536956787109 length of segment : 216 Processing 1 images image shape: (280, 400, 3) min: 12.00000 max: 202.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 78.49453 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0008764266967773438 nb_pixel_total : 106061 time to create 1 rle with old method : 0.1217806339263916 length of segment : 281 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.54922 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 2803 time to create 1 rle with old method : 0.006069183349609375 length of segment : 51 time for calcul the mask position with numpy : 7.534027099609375e-05 nb_pixel_total : 3521 time to create 1 rle with old method : 0.005939006805419922 length of segment : 58 time for calcul the mask position with numpy : 0.00014925003051757812 nb_pixel_total : 4156 time to create 1 rle with old method : 0.0052394866943359375 length of segment : 167 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 351 time to create 1 rle with old method : 0.0006108283996582031 length of segment : 26 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 567 time to create 1 rle with old method : 0.0007283687591552734 length of segment : 45 time for calcul the mask position with numpy : 0.00010061264038085938 nb_pixel_total : 3238 time to create 1 rle with old method : 0.004158973693847656 length of segment : 114 time for calcul the mask position with numpy : 8.296966552734375e-05 nb_pixel_total : 1538 time to create 1 rle with old method : 0.002050161361694336 length of segment : 59 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 104 time to create 1 rle with old method : 0.00020456314086914062 length of segment : 9 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 2109 time to create 1 rle with old method : 0.0025746822357177734 length of segment : 85 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.0003464221954345703 length of segment : 41 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 225 time to create 1 rle with old method : 0.0004169940948486328 length of segment : 10 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 107 time to create 1 rle with old method : 0.00018644332885742188 length of segment : 16 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.00040078163146972656 length of segment : 18 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 344 time to create 1 rle with old method : 0.00046706199645996094 length of segment : 29 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.0003299713134765625 length of segment : 21 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 470 time to create 1 rle with old method : 0.0006575584411621094 length of segment : 36 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 338 time to create 1 rle with old method : 0.00047707557678222656 length of segment : 24 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 487 time to create 1 rle with old method : 0.0006618499755859375 length of segment : 28 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 456 time to create 1 rle with old method : 0.0006170272827148438 length of segment : 36 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.00036644935607910156 length of segment : 20 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 240 time to create 1 rle with old method : 0.0003573894500732422 length of segment : 22 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.0002644062042236328 length of segment : 19 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.0002982616424560547 length of segment : 18 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 1059 time to create 1 rle with old method : 0.0014319419860839844 length of segment : 39 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 269 time to create 1 rle with old method : 0.0004582405090332031 length of segment : 13 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.40078 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 441 time to create 1 rle with old method : 0.0006456375122070312 length of segment : 34 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.0003275871276855469 length of segment : 11 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 1066 time to create 1 rle with old method : 0.0016398429870605469 length of segment : 63 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 589 time to create 1 rle with old method : 0.0007722377777099609 length of segment : 47 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 168 time to create 1 rle with old method : 0.00026679039001464844 length of segment : 22 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 290 time to create 1 rle with old method : 0.0004799365997314453 length of segment : 54 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 235 time to create 1 rle with old method : 0.00033926963806152344 length of segment : 31 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 506 time to create 1 rle with old method : 0.0007035732269287109 length of segment : 33 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 224 time to create 1 rle with old method : 0.00033164024353027344 length of segment : 31 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 233 time to create 1 rle with old method : 0.0003466606140136719 length of segment : 19 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 142 time to create 1 rle with old method : 0.000217437744140625 length of segment : 30 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 197 time to create 1 rle with old method : 0.000316619873046875 length of segment : 17 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 298 time to create 1 rle with old method : 0.0004291534423828125 length of segment : 28 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 556 time to create 1 rle with old method : 0.0007624626159667969 length of segment : 32 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 129.85000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 682 time to create 1 rle with old method : 0.0010228157043457031 length of segment : 33 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 678 time to create 1 rle with old method : 0.0009016990661621094 length of segment : 32 Detection mask done ! Trying to reset tf kernel 312349 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2390 tf kernel not reseted sub process len(results) : 346 len(list_Values) 346 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 346 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 7679 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 346 chid ids of type : 4228 Number RLEs to save : 17414 save missing photos in datou_result : time spend for datou_step_exec : 28.29681134223938 time spend to save output : 1.8607127666473389 total time spend for step 1 : 30.15752410888672 step2:brightness Mon Feb 17 18:20:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1739812828_311655_1338193091_6a55bfb29ec959adc4cb4bd602ba9900.jpg treat image : temp/1739812828_311655_1338193086_8a0066945f3d611631dd47dc1c002218.jpg treat image : temp/1739812828_311655_1338193079_b9fc00c32e40198e017f16e141a4fdcc.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 3 time used for this insertion : 0.010698318481445312 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 3 time used for this insertion : 0.011096715927124023 save missing photos in datou_result : time spend for datou_step_exec : 0.8490238189697266 time spend to save output : 0.026280641555786133 total time spend for step 2 : 0.8753044605255127 step3:blur_detection Mon Feb 17 18:20:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1739812828_311655_1338193091_6a55bfb29ec959adc4cb4bd602ba9900.jpg resize: (1080, 1920) 1338193091 -7.639692438635878 treat image : temp/1739812828_311655_1338193086_8a0066945f3d611631dd47dc1c002218.jpg resize: (1080, 1920) 1338193086 -7.580260474746947 treat image : temp/1739812828_311655_1338193079_b9fc00c32e40198e017f16e141a4fdcc.jpg resize: (1080, 1920) 1338193079 -7.591623270131125 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 3 time used for this insertion : 0.010733604431152344 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 3 time used for this insertion : 0.010756492614746094 save missing photos in datou_result : time spend for datou_step_exec : 2.8420519828796387 time spend to save output : 0.025683879852294922 total time spend for step 3 : 2.8677358627319336 step4:rle_unique_nms_with_priority Mon Feb 17 18:21:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 346 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 115 nb_hashtags : 6 time to prepare the origin masks : 1.168095588684082 time for calcul the mask position with numpy : 1.0355722904205322 nb_pixel_total : 1629922 time to create 1 rle with new method : 0.10198354721069336 time for calcul the mask position with numpy : 0.008504152297973633 nb_pixel_total : 18821 time to create 1 rle with old method : 0.020512104034423828 time for calcul the mask position with numpy : 0.008405685424804688 nb_pixel_total : 1029 time to create 1 rle with old method : 0.0013430118560791016 time for calcul the mask position with numpy : 0.008239269256591797 nb_pixel_total : 880 time to create 1 rle with old method : 0.0010132789611816406 time for calcul the mask position with numpy : 0.008300065994262695 nb_pixel_total : 26 time to create 1 rle with old method : 4.9114227294921875e-05 time for calcul the mask position with numpy : 0.008176565170288086 nb_pixel_total : 422 time to create 1 rle with old method : 0.0005104541778564453 time for calcul the mask position with numpy : 0.008413553237915039 nb_pixel_total : 930 time to create 1 rle with old method : 0.0010752677917480469 time for calcul the mask position with numpy : 0.008472919464111328 nb_pixel_total : 151 time to create 1 rle with old method : 0.0001914501190185547 time for calcul the mask position with numpy : 0.008416891098022461 nb_pixel_total : 93 time to create 1 rle with old method : 0.00013947486877441406 time for calcul the mask position with numpy : 0.008350133895874023 nb_pixel_total : 598 time to create 1 rle with old method : 0.0007755756378173828 time for calcul the mask position with numpy : 0.008391380310058594 nb_pixel_total : 1769 time to create 1 rle with old method : 0.002132892608642578 time for calcul the mask position with numpy : 0.008364677429199219 nb_pixel_total : 19 time to create 1 rle with old method : 7.343292236328125e-05 time for calcul the mask position with numpy : 0.008367061614990234 nb_pixel_total : 355 time to create 1 rle with old method : 0.0005118846893310547 time for calcul the mask position with numpy : 0.008321523666381836 nb_pixel_total : 2242 time to create 1 rle with old method : 0.002541065216064453 time for calcul the mask position with numpy : 0.008452653884887695 nb_pixel_total : 1 time to create 1 rle with old method : 1.6689300537109375e-05 time for calcul the mask position with numpy : 0.008455276489257812 nb_pixel_total : 46 time to create 1 rle with old method : 7.033348083496094e-05 time for calcul the mask position with numpy : 0.008619308471679688 nb_pixel_total : 48773 time to create 1 rle with old method : 0.05450153350830078 time for calcul the mask position with numpy : 0.008577108383178711 nb_pixel_total : 713 time to create 1 rle with old method : 0.0008623600006103516 time for calcul the mask position with numpy : 0.008467912673950195 nb_pixel_total : 786 time to create 1 rle with old method : 0.0009663105010986328 time for calcul the mask position with numpy : 0.00828862190246582 nb_pixel_total : 297 time to create 1 rle with old method : 0.0003662109375 time for calcul the mask position with numpy : 0.008404731750488281 nb_pixel_total : 423 time to create 1 rle with old method : 0.0005309581756591797 time for calcul the mask position with numpy : 0.008228540420532227 nb_pixel_total : 2298 time to create 1 rle with old method : 0.002624034881591797 time for calcul the mask position with numpy : 0.008223533630371094 nb_pixel_total : 345 time to create 1 rle with old method : 0.0004734992980957031 time for calcul the mask position with numpy : 0.008226394653320312 nb_pixel_total : 371 time to create 1 rle with old method : 0.0004482269287109375 time for calcul the mask position with numpy : 0.008383989334106445 nb_pixel_total : 465 time to create 1 rle with old method : 0.0005838871002197266 time for calcul the mask position with numpy : 0.00801849365234375 nb_pixel_total : 10608 time to create 1 rle with old method : 0.012427330017089844 time for calcul the mask position with numpy : 0.008122682571411133 nb_pixel_total : 133 time to create 1 rle with old method : 0.0001773834228515625 time for calcul the mask position with numpy : 0.008323907852172852 nb_pixel_total : 2009 time to create 1 rle with old method : 0.0024056434631347656 time for calcul the mask position with numpy : 0.008411407470703125 nb_pixel_total : 164 time to create 1 rle with old method : 0.0002346038818359375 time for calcul the mask position with numpy : 0.008419036865234375 nb_pixel_total : 1033 time to create 1 rle with old method : 0.001245260238647461 time for calcul the mask position with numpy : 0.008164644241333008 nb_pixel_total : 521 time to create 1 rle with old method : 0.0006313323974609375 time for calcul the mask position with numpy : 0.008419990539550781 nb_pixel_total : 102 time to create 1 rle with old method : 0.00013113021850585938 time for calcul the mask position with numpy : 0.008388280868530273 nb_pixel_total : 154226 time to create 1 rle with new method : 0.2599070072174072 time for calcul the mask position with numpy : 0.008530855178833008 nb_pixel_total : 365 time to create 1 rle with old method : 0.0004775524139404297 time for calcul the mask position with numpy : 0.008211135864257812 nb_pixel_total : 10703 time to create 1 rle with old method : 0.012077569961547852 time for calcul the mask position with numpy : 0.008155107498168945 nb_pixel_total : 786 time to create 1 rle with old method : 0.0009622573852539062 time for calcul the mask position with numpy : 0.00827789306640625 nb_pixel_total : 236 time to create 1 rle with old method : 0.00028061866760253906 time for calcul the mask position with numpy : 0.00816488265991211 nb_pixel_total : 1744 time to create 1 rle with old method : 0.0021162033081054688 time for calcul the mask position with numpy : 0.007993936538696289 nb_pixel_total : 175 time to create 1 rle with old method : 0.00020503997802734375 time for calcul the mask position with numpy : 0.007985591888427734 nb_pixel_total : 9709 time to create 1 rle with old method : 0.01053309440612793 time for calcul the mask position with numpy : 0.008208751678466797 nb_pixel_total : 694 time to create 1 rle with old method : 0.0008382797241210938 time for calcul the mask position with numpy : 0.008093118667602539 nb_pixel_total : 15973 time to create 1 rle with old method : 0.0176849365234375 time for calcul the mask position with numpy : 0.008191347122192383 nb_pixel_total : 177 time to create 1 rle with old method : 0.00021409988403320312 time for calcul the mask position with numpy : 0.008164405822753906 nb_pixel_total : 210 time to create 1 rle with old method : 0.0002636909484863281 time for calcul the mask position with numpy : 0.008134126663208008 nb_pixel_total : 2627 time to create 1 rle with old method : 0.003068685531616211 time for calcul the mask position with numpy : 0.008240938186645508 nb_pixel_total : 52 time to create 1 rle with old method : 9.870529174804688e-05 time for calcul the mask position with numpy : 0.008047103881835938 nb_pixel_total : 17 time to create 1 rle with old method : 4.6253204345703125e-05 time for calcul the mask position with numpy : 0.007857799530029297 nb_pixel_total : 393 time to create 1 rle with old method : 0.0004830360412597656 time for calcul the mask position with numpy : 0.0078046321868896484 nb_pixel_total : 477 time to create 1 rle with old method : 0.0006117820739746094 time for calcul the mask position with numpy : 0.019282102584838867 nb_pixel_total : 12 time to create 1 rle with old method : 6.4849853515625e-05 time for calcul the mask position with numpy : 0.009734392166137695 nb_pixel_total : 2202 time to create 1 rle with old method : 0.0024595260620117188 time for calcul the mask position with numpy : 0.007678985595703125 nb_pixel_total : 2905 time to create 1 rle with old method : 0.003163576126098633 time for calcul the mask position with numpy : 0.007841348648071289 nb_pixel_total : 991 time to create 1 rle with old method : 0.001130819320678711 time for calcul the mask position with numpy : 0.007796764373779297 nb_pixel_total : 146 time to create 1 rle with old method : 0.0001919269561767578 time for calcul the mask position with numpy : 0.00781869888305664 nb_pixel_total : 1726 time to create 1 rle with old method : 0.002110004425048828 time for calcul the mask position with numpy : 0.008087635040283203 nb_pixel_total : 10 time to create 1 rle with old method : 1.6927719116210938e-05 time for calcul the mask position with numpy : 0.008002996444702148 nb_pixel_total : 2453 time to create 1 rle with old method : 0.0028519630432128906 time for calcul the mask position with numpy : 0.007928848266601562 nb_pixel_total : 1893 time to create 1 rle with old method : 0.002209186553955078 time for calcul the mask position with numpy : 0.00808572769165039 nb_pixel_total : 294 time to create 1 rle with old method : 0.00035572052001953125 time for calcul the mask position with numpy : 0.007894515991210938 nb_pixel_total : 156 time to create 1 rle with old method : 0.00019431114196777344 time for calcul the mask position with numpy : 0.007930517196655273 nb_pixel_total : 217 time to create 1 rle with old method : 0.00024580955505371094 time for calcul the mask position with numpy : 0.007735490798950195 nb_pixel_total : 187 time to create 1 rle with old method : 0.0002219676971435547 time for calcul the mask position with numpy : 0.007819890975952148 nb_pixel_total : 190 time to create 1 rle with old method : 0.00023102760314941406 time for calcul the mask position with numpy : 0.007855415344238281 nb_pixel_total : 136 time to create 1 rle with old method : 0.000148773193359375 time for calcul the mask position with numpy : 0.009003639221191406 nb_pixel_total : 169 time to create 1 rle with old method : 0.00020933151245117188 time for calcul the mask position with numpy : 0.008052349090576172 nb_pixel_total : 165 time to create 1 rle with old method : 0.00019240379333496094 time for calcul the mask position with numpy : 0.007668018341064453 nb_pixel_total : 1292 time to create 1 rle with old method : 0.0014731884002685547 time for calcul the mask position with numpy : 0.007689476013183594 nb_pixel_total : 886 time to create 1 rle with old method : 0.0010459423065185547 time for calcul the mask position with numpy : 0.0076351165771484375 nb_pixel_total : 220 time to create 1 rle with old method : 0.0002582073211669922 time for calcul the mask position with numpy : 0.0083770751953125 nb_pixel_total : 105942 time to create 1 rle with old method : 0.11239147186279297 time for calcul the mask position with numpy : 0.007999420166015625 nb_pixel_total : 111 time to create 1 rle with old method : 0.00014543533325195312 time for calcul the mask position with numpy : 0.007957696914672852 nb_pixel_total : 3340 time to create 1 rle with old method : 0.0037364959716796875 time for calcul the mask position with numpy : 0.007893085479736328 nb_pixel_total : 1985 time to create 1 rle with old method : 0.002268552780151367 time for calcul the mask position with numpy : 0.008008956909179688 nb_pixel_total : 577 time to create 1 rle with old method : 0.0006444454193115234 time for calcul the mask position with numpy : 0.008098125457763672 nb_pixel_total : 93 time to create 1 rle with old method : 0.0001327991485595703 time for calcul the mask position with numpy : 0.008718252182006836 nb_pixel_total : 226 time to create 1 rle with old method : 0.0003898143768310547 time for calcul the mask position with numpy : 0.009597539901733398 nb_pixel_total : 655 time to create 1 rle with old method : 0.0011019706726074219 time for calcul the mask position with numpy : 0.009591102600097656 nb_pixel_total : 185 time to create 1 rle with old method : 0.00032019615173339844 time for calcul the mask position with numpy : 0.009622335433959961 nb_pixel_total : 532 time to create 1 rle with old method : 0.0008997917175292969 time for calcul the mask position with numpy : 0.009274959564208984 nb_pixel_total : 355 time to create 1 rle with old method : 0.0003993511199951172 time for calcul the mask position with numpy : 0.008031845092773438 nb_pixel_total : 106 time to create 1 rle with old method : 0.00012874603271484375 time for calcul the mask position with numpy : 0.007989883422851562 nb_pixel_total : 236 time to create 1 rle with old method : 0.0002770423889160156 time for calcul the mask position with numpy : 0.007988929748535156 nb_pixel_total : 513 time to create 1 rle with old method : 0.0005865097045898438 time for calcul the mask position with numpy : 0.008002996444702148 nb_pixel_total : 225 time to create 1 rle with old method : 0.0002837181091308594 time for calcul the mask position with numpy : 0.008167266845703125 nb_pixel_total : 770 time to create 1 rle with old method : 0.0008511543273925781 time for calcul the mask position with numpy : 0.007912397384643555 nb_pixel_total : 1945 time to create 1 rle with old method : 0.0022525787353515625 time for calcul the mask position with numpy : 0.008130311965942383 nb_pixel_total : 2951 time to create 1 rle with old method : 0.003246307373046875 time for calcul the mask position with numpy : 0.00795292854309082 nb_pixel_total : 169 time to create 1 rle with old method : 0.00019621849060058594 time for calcul the mask position with numpy : 0.007833003997802734 nb_pixel_total : 10 time to create 1 rle with old method : 2.193450927734375e-05 time for calcul the mask position with numpy : 0.0076923370361328125 nb_pixel_total : 649 time to create 1 rle with old method : 0.0006864070892333984 time for calcul the mask position with numpy : 0.007695198059082031 nb_pixel_total : 3156 time to create 1 rle with old method : 0.0034525394439697266 time for calcul the mask position with numpy : 0.007750034332275391 nb_pixel_total : 156 time to create 1 rle with old method : 0.00019431114196777344 time for calcul the mask position with numpy : 0.007970094680786133 nb_pixel_total : 186 time to create 1 rle with old method : 0.00022411346435546875 time for calcul the mask position with numpy : 0.008120059967041016 nb_pixel_total : 211 time to create 1 rle with old method : 0.0002453327178955078 time for calcul the mask position with numpy : 0.007870197296142578 nb_pixel_total : 947 time to create 1 rle with old method : 0.00099945068359375 time for calcul the mask position with numpy : 0.0077435970306396484 nb_pixel_total : 490 time to create 1 rle with old method : 0.00054168701171875 time for calcul the mask position with numpy : 0.007860660552978516 nb_pixel_total : 204 time to create 1 rle with old method : 0.0002167224884033203 time for calcul the mask position with numpy : 0.007777690887451172 nb_pixel_total : 556 time to create 1 rle with old method : 0.0006613731384277344 time for calcul the mask position with numpy : 0.007748603820800781 nb_pixel_total : 34 time to create 1 rle with old method : 5.626678466796875e-05 time for calcul the mask position with numpy : 0.0077130794525146484 nb_pixel_total : 230 time to create 1 rle with old method : 0.00024580955505371094 time for calcul the mask position with numpy : 0.007764339447021484 nb_pixel_total : 339 time to create 1 rle with old method : 0.00037789344787597656 time for calcul the mask position with numpy : 0.007701873779296875 nb_pixel_total : 26 time to create 1 rle with old method : 4.482269287109375e-05 time for calcul the mask position with numpy : 0.007688999176025391 nb_pixel_total : 499 time to create 1 rle with old method : 0.0005326271057128906 time for calcul the mask position with numpy : 0.007731914520263672 nb_pixel_total : 576 time to create 1 rle with old method : 0.0006725788116455078 time for calcul the mask position with numpy : 0.007868528366088867 nb_pixel_total : 353 time to create 1 rle with old method : 0.00042629241943359375 time for calcul the mask position with numpy : 0.008047342300415039 nb_pixel_total : 421 time to create 1 rle with old method : 0.0004994869232177734 time for calcul the mask position with numpy : 0.007982730865478516 nb_pixel_total : 102 time to create 1 rle with old method : 0.00011801719665527344 time for calcul the mask position with numpy : 0.007966279983520508 nb_pixel_total : 231 time to create 1 rle with old method : 0.0002827644348144531 time for calcul the mask position with numpy : 0.008025646209716797 nb_pixel_total : 164 time to create 1 rle with old method : 0.00019979476928710938 time for calcul the mask position with numpy : 0.007996559143066406 nb_pixel_total : 158 time to create 1 rle with old method : 0.00018906593322753906 time for calcul the mask position with numpy : 0.00801706314086914 nb_pixel_total : 248 time to create 1 rle with old method : 0.00030112266540527344 time for calcul the mask position with numpy : 0.007794618606567383 nb_pixel_total : 583 time to create 1 rle with old method : 0.0006456375122070312 time for calcul the mask position with numpy : 0.007871627807617188 nb_pixel_total : 163 time to create 1 rle with old method : 0.0001819133758544922 time for calcul the mask position with numpy : 0.007889509201049805 nb_pixel_total : 359 time to create 1 rle with old method : 0.0004119873046875 time for calcul the mask position with numpy : 0.007836103439331055 nb_pixel_total : 350 time to create 1 rle with old method : 0.00040030479431152344 time for calcul the mask position with numpy : 0.007783174514770508 nb_pixel_total : 124 time to create 1 rle with old method : 0.00013899803161621094 create new chi : 2.6866660118103027 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.010309934616088867 batch 1 Loaded 116 chid ids of type : 4230 Number RLEs to save : 12472 TO DO : save crop sub photo not yet done ! save time : 0.7248392105102539 nb_obj : 118 nb_hashtags : 6 time to prepare the origin masks : 2.035175323486328 time for calcul the mask position with numpy : 0.05231475830078125 nb_pixel_total : 1799912 time to create 1 rle with new method : 0.8876919746398926 time for calcul the mask position with numpy : 0.007132530212402344 nb_pixel_total : 1341 time to create 1 rle with old method : 0.0015382766723632812 time for calcul the mask position with numpy : 0.006801128387451172 nb_pixel_total : 59483 time to create 1 rle with old method : 0.06562614440917969 time for calcul the mask position with numpy : 0.006296634674072266 nb_pixel_total : 343 time to create 1 rle with old method : 0.0004031658172607422 time for calcul the mask position with numpy : 0.007393598556518555 nb_pixel_total : 102 time to create 1 rle with old method : 0.00014638900756835938 time for calcul the mask position with numpy : 0.010079145431518555 nb_pixel_total : 636 time to create 1 rle with old method : 0.0010907649993896484 time for calcul the mask position with numpy : 0.00830841064453125 nb_pixel_total : 42 time to create 1 rle with old method : 0.00010466575622558594 time for calcul the mask position with numpy : 0.0075457096099853516 nb_pixel_total : 885 time to create 1 rle with old method : 0.001100301742553711 time for calcul the mask position with numpy : 0.006109952926635742 nb_pixel_total : 29 time to create 1 rle with old method : 5.7697296142578125e-05 time for calcul the mask position with numpy : 0.005974292755126953 nb_pixel_total : 50 time to create 1 rle with old method : 0.00014495849609375 time for calcul the mask position with numpy : 0.006151676177978516 nb_pixel_total : 124 time to create 1 rle with old method : 0.0002899169921875 time for calcul the mask position with numpy : 0.006157875061035156 nb_pixel_total : 2424 time to create 1 rle with old method : 0.0028085708618164062 time for calcul the mask position with numpy : 0.0065975189208984375 nb_pixel_total : 38 time to create 1 rle with old method : 8.106231689453125e-05 time for calcul the mask position with numpy : 0.0062177181243896484 nb_pixel_total : 45 time to create 1 rle with old method : 7.390975952148438e-05 time for calcul the mask position with numpy : 0.006099700927734375 nb_pixel_total : 2961 time to create 1 rle with old method : 0.0033533573150634766 time for calcul the mask position with numpy : 0.006138801574707031 nb_pixel_total : 643 time to create 1 rle with old method : 0.0008065700531005859 time for calcul the mask position with numpy : 0.0061151981353759766 nb_pixel_total : 1 time to create 1 rle with old method : 1.8358230590820312e-05 time for calcul the mask position with numpy : 0.006628274917602539 nb_pixel_total : 896 time to create 1 rle with old method : 0.0011017322540283203 time for calcul the mask position with numpy : 0.006177663803100586 nb_pixel_total : 429 time to create 1 rle with old method : 0.0005300045013427734 time for calcul the mask position with numpy : 0.010046958923339844 nb_pixel_total : 2442 time to create 1 rle with old method : 0.0031228065490722656 time for calcul the mask position with numpy : 0.008228302001953125 nb_pixel_total : 282 time to create 1 rle with old method : 0.00035858154296875 time for calcul the mask position with numpy : 0.006728410720825195 nb_pixel_total : 622 time to create 1 rle with old method : 0.0007750988006591797 time for calcul the mask position with numpy : 0.006912708282470703 nb_pixel_total : 455 time to create 1 rle with old method : 0.0005707740783691406 time for calcul the mask position with numpy : 0.006645679473876953 nb_pixel_total : 2346 time to create 1 rle with old method : 0.002747774124145508 time for calcul the mask position with numpy : 0.008583784103393555 nb_pixel_total : 187 time to create 1 rle with old method : 0.00029659271240234375 time for calcul the mask position with numpy : 0.0059452056884765625 nb_pixel_total : 348 time to create 1 rle with old method : 0.0004565715789794922 time for calcul the mask position with numpy : 0.006442546844482422 nb_pixel_total : 466 time to create 1 rle with old method : 0.0007915496826171875 time for calcul the mask position with numpy : 0.0069484710693359375 nb_pixel_total : 10480 time to create 1 rle with old method : 0.011976003646850586 time for calcul the mask position with numpy : 0.006240129470825195 nb_pixel_total : 301 time to create 1 rle with old method : 0.0004527568817138672 time for calcul the mask position with numpy : 0.0064928531646728516 nb_pixel_total : 1756 time to create 1 rle with old method : 0.002069711685180664 time for calcul the mask position with numpy : 0.0062716007232666016 nb_pixel_total : 1094 time to create 1 rle with old method : 0.001340627670288086 time for calcul the mask position with numpy : 0.005952596664428711 nb_pixel_total : 34 time to create 1 rle with old method : 8.893013000488281e-05 time for calcul the mask position with numpy : 0.006179094314575195 nb_pixel_total : 556 time to create 1 rle with old method : 0.0007174015045166016 time for calcul the mask position with numpy : 0.006196737289428711 nb_pixel_total : 1053 time to create 1 rle with old method : 0.0017707347869873047 time for calcul the mask position with numpy : 0.006072998046875 nb_pixel_total : 14943 time to create 1 rle with old method : 0.017026901245117188 time for calcul the mask position with numpy : 0.0064792633056640625 nb_pixel_total : 514 time to create 1 rle with old method : 0.0006499290466308594 time for calcul the mask position with numpy : 0.0057830810546875 nb_pixel_total : 125 time to create 1 rle with old method : 0.0001556873321533203 time for calcul the mask position with numpy : 0.0058743953704833984 nb_pixel_total : 869 time to create 1 rle with old method : 0.0010890960693359375 time for calcul the mask position with numpy : 0.00586700439453125 nb_pixel_total : 68 time to create 1 rle with old method : 0.0001404285430908203 time for calcul the mask position with numpy : 0.006037473678588867 nb_pixel_total : 553 time to create 1 rle with old method : 0.0006909370422363281 time for calcul the mask position with numpy : 0.00618433952331543 nb_pixel_total : 1101 time to create 1 rle with old method : 0.0014259815216064453 time for calcul the mask position with numpy : 0.006124973297119141 nb_pixel_total : 18 time to create 1 rle with old method : 4.673004150390625e-05 time for calcul the mask position with numpy : 0.006006002426147461 nb_pixel_total : 182 time to create 1 rle with old method : 0.00022125244140625 time for calcul the mask position with numpy : 0.006374835968017578 nb_pixel_total : 163 time to create 1 rle with old method : 0.000217437744140625 time for calcul the mask position with numpy : 0.005830287933349609 nb_pixel_total : 323 time to create 1 rle with old method : 0.00042176246643066406 time for calcul the mask position with numpy : 0.010188817977905273 nb_pixel_total : 1758 time to create 1 rle with old method : 0.002103567123413086 time for calcul the mask position with numpy : 0.00592803955078125 nb_pixel_total : 194 time to create 1 rle with old method : 0.0002586841583251953 time for calcul the mask position with numpy : 0.0065305233001708984 nb_pixel_total : 8876 time to create 1 rle with old method : 0.009906291961669922 time for calcul the mask position with numpy : 0.006381988525390625 nb_pixel_total : 407 time to create 1 rle with old method : 0.0005161762237548828 time for calcul the mask position with numpy : 0.006302595138549805 nb_pixel_total : 119 time to create 1 rle with old method : 0.00016164779663085938 time for calcul the mask position with numpy : 0.006258249282836914 nb_pixel_total : 167 time to create 1 rle with old method : 0.00021266937255859375 time for calcul the mask position with numpy : 0.006448030471801758 nb_pixel_total : 303 time to create 1 rle with old method : 0.0003821849822998047 time for calcul the mask position with numpy : 0.006183624267578125 nb_pixel_total : 146 time to create 1 rle with old method : 0.0001888275146484375 time for calcul the mask position with numpy : 0.006024837493896484 nb_pixel_total : 607 time to create 1 rle with old method : 0.0006961822509765625 time for calcul the mask position with numpy : 0.005991935729980469 nb_pixel_total : 2493 time to create 1 rle with old method : 0.0029022693634033203 time for calcul the mask position with numpy : 0.006066322326660156 nb_pixel_total : 1030 time to create 1 rle with old method : 0.0011527538299560547 time for calcul the mask position with numpy : 0.006342649459838867 nb_pixel_total : 3718 time to create 1 rle with old method : 0.004626750946044922 time for calcul the mask position with numpy : 0.0062007904052734375 nb_pixel_total : 44 time to create 1 rle with old method : 9.989738464355469e-05 time for calcul the mask position with numpy : 0.005999326705932617 nb_pixel_total : 2028 time to create 1 rle with old method : 0.0023729801177978516 time for calcul the mask position with numpy : 0.006091594696044922 nb_pixel_total : 161 time to create 1 rle with old method : 0.00021409988403320312 time for calcul the mask position with numpy : 0.006289958953857422 nb_pixel_total : 31 time to create 1 rle with old method : 0.00010371208190917969 time for calcul the mask position with numpy : 0.006913661956787109 nb_pixel_total : 47 time to create 1 rle with old method : 9.918212890625e-05 time for calcul the mask position with numpy : 0.0062253475189208984 nb_pixel_total : 1006 time to create 1 rle with old method : 0.0011744499206542969 time for calcul the mask position with numpy : 0.005730628967285156 nb_pixel_total : 1092 time to create 1 rle with old method : 0.0012161731719970703 time for calcul the mask position with numpy : 0.006075143814086914 nb_pixel_total : 159 time to create 1 rle with old method : 0.00021457672119140625 time for calcul the mask position with numpy : 0.007865428924560547 nb_pixel_total : 711 time to create 1 rle with old method : 0.0010628700256347656 time for calcul the mask position with numpy : 0.006230592727661133 nb_pixel_total : 1658 time to create 1 rle with old method : 0.0017871856689453125 time for calcul the mask position with numpy : 0.0060689449310302734 nb_pixel_total : 230 time to create 1 rle with old method : 0.0002980232238769531 time for calcul the mask position with numpy : 0.006364107131958008 nb_pixel_total : 8 time to create 1 rle with old method : 7.534027099609375e-05 time for calcul the mask position with numpy : 0.006276845932006836 nb_pixel_total : 32 time to create 1 rle with old method : 8.463859558105469e-05 time for calcul the mask position with numpy : 0.0059473514556884766 nb_pixel_total : 359 time to create 1 rle with old method : 0.00041794776916503906 time for calcul the mask position with numpy : 0.005900382995605469 nb_pixel_total : 48 time to create 1 rle with old method : 6.771087646484375e-05 time for calcul the mask position with numpy : 0.005896806716918945 nb_pixel_total : 153 time to create 1 rle with old method : 0.0001876354217529297 time for calcul the mask position with numpy : 0.005944967269897461 nb_pixel_total : 174 time to create 1 rle with old method : 0.00020623207092285156 time for calcul the mask position with numpy : 0.005796909332275391 nb_pixel_total : 153 time to create 1 rle with old method : 0.00018930435180664062 time for calcul the mask position with numpy : 0.006058692932128906 nb_pixel_total : 164 time to create 1 rle with old method : 0.00019121170043945312 time for calcul the mask position with numpy : 0.005908489227294922 nb_pixel_total : 1228 time to create 1 rle with old method : 0.001501321792602539 time for calcul the mask position with numpy : 0.0058972835540771484 nb_pixel_total : 898 time to create 1 rle with old method : 0.0010843276977539062 time for calcul the mask position with numpy : 0.0057888031005859375 nb_pixel_total : 204 time to create 1 rle with old method : 0.00022912025451660156 time for calcul the mask position with numpy : 0.0065746307373046875 nb_pixel_total : 105567 time to create 1 rle with old method : 0.10803985595703125 time for calcul the mask position with numpy : 0.005797624588012695 nb_pixel_total : 3225 time to create 1 rle with old method : 0.0036177635192871094 time for calcul the mask position with numpy : 0.00596165657043457 nb_pixel_total : 7258 time to create 1 rle with old method : 0.008069276809692383 time for calcul the mask position with numpy : 0.006343364715576172 nb_pixel_total : 276 time to create 1 rle with old method : 0.0003566741943359375 time for calcul the mask position with numpy : 0.005660057067871094 nb_pixel_total : 16 time to create 1 rle with old method : 4.00543212890625e-05 time for calcul the mask position with numpy : 0.005707263946533203 nb_pixel_total : 354 time to create 1 rle with old method : 0.0004239082336425781 time for calcul the mask position with numpy : 0.0058705806732177734 nb_pixel_total : 424 time to create 1 rle with old method : 0.0005259513854980469 time for calcul the mask position with numpy : 0.006175518035888672 nb_pixel_total : 254 time to create 1 rle with old method : 0.0003840923309326172 time for calcul the mask position with numpy : 0.006005764007568359 nb_pixel_total : 196 time to create 1 rle with old method : 0.00024580955505371094 time for calcul the mask position with numpy : 0.006022930145263672 nb_pixel_total : 363 time to create 1 rle with old method : 0.00047898292541503906 time for calcul the mask position with numpy : 0.005928993225097656 nb_pixel_total : 587 time to create 1 rle with old method : 0.0007157325744628906 time for calcul the mask position with numpy : 0.00591278076171875 nb_pixel_total : 74 time to create 1 rle with old method : 0.00010991096496582031 time for calcul the mask position with numpy : 0.006622314453125 nb_pixel_total : 335 time to create 1 rle with old method : 0.0004019737243652344 time for calcul the mask position with numpy : 0.006133556365966797 nb_pixel_total : 4044 time to create 1 rle with old method : 0.004544973373413086 time for calcul the mask position with numpy : 0.006169795989990234 nb_pixel_total : 160 time to create 1 rle with old method : 0.00022792816162109375 time for calcul the mask position with numpy : 0.006546497344970703 nb_pixel_total : 202 time to create 1 rle with old method : 0.00027561187744140625 time for calcul the mask position with numpy : 0.006329059600830078 nb_pixel_total : 116 time to create 1 rle with old method : 0.0001513957977294922 time for calcul the mask position with numpy : 0.0061397552490234375 nb_pixel_total : 187 time to create 1 rle with old method : 0.00023889541625976562 time for calcul the mask position with numpy : 0.006337642669677734 nb_pixel_total : 1247 time to create 1 rle with old method : 0.0014731884002685547 time for calcul the mask position with numpy : 0.0063419342041015625 nb_pixel_total : 700 time to create 1 rle with old method : 0.0008771419525146484 time for calcul the mask position with numpy : 0.009000539779663086 nb_pixel_total : 771 time to create 1 rle with old method : 0.0011417865753173828 time for calcul the mask position with numpy : 0.007665872573852539 nb_pixel_total : 92 time to create 1 rle with old method : 0.00012135505676269531 time for calcul the mask position with numpy : 0.0064089298248291016 nb_pixel_total : 263 time to create 1 rle with old method : 0.00035953521728515625 time for calcul the mask position with numpy : 0.0070836544036865234 nb_pixel_total : 314 time to create 1 rle with old method : 0.0003955364227294922 time for calcul the mask position with numpy : 0.00886988639831543 nb_pixel_total : 167 time to create 1 rle with old method : 0.00038743019104003906 time for calcul the mask position with numpy : 0.00709843635559082 nb_pixel_total : 104 time to create 1 rle with old method : 0.0001468658447265625 time for calcul the mask position with numpy : 0.00650477409362793 nb_pixel_total : 487 time to create 1 rle with old method : 0.000583648681640625 time for calcul the mask position with numpy : 0.006097078323364258 nb_pixel_total : 225 time to create 1 rle with old method : 0.0002567768096923828 time for calcul the mask position with numpy : 0.006529331207275391 nb_pixel_total : 199 time to create 1 rle with old method : 0.0002734661102294922 time for calcul the mask position with numpy : 0.00726628303527832 nb_pixel_total : 176 time to create 1 rle with old method : 0.00034689903259277344 time for calcul the mask position with numpy : 0.00765228271484375 nb_pixel_total : 364 time to create 1 rle with old method : 0.00045490264892578125 time for calcul the mask position with numpy : 0.006953716278076172 nb_pixel_total : 314 time to create 1 rle with old method : 0.00041985511779785156 time for calcul the mask position with numpy : 0.007118701934814453 nb_pixel_total : 207 time to create 1 rle with old method : 0.0002741813659667969 time for calcul the mask position with numpy : 0.007170915603637695 nb_pixel_total : 583 time to create 1 rle with old method : 0.0007040500640869141 time for calcul the mask position with numpy : 0.00649261474609375 nb_pixel_total : 146 time to create 1 rle with old method : 0.00021886825561523438 time for calcul the mask position with numpy : 0.006431102752685547 nb_pixel_total : 569 time to create 1 rle with old method : 0.0006892681121826172 time for calcul the mask position with numpy : 0.006822109222412109 nb_pixel_total : 365 time to create 1 rle with old method : 0.000457763671875 time for calcul the mask position with numpy : 0.008210897445678711 nb_pixel_total : 354 time to create 1 rle with old method : 0.00039887428283691406 time for calcul the mask position with numpy : 0.008002996444702148 nb_pixel_total : 18 time to create 1 rle with old method : 4.696846008300781e-05 time for calcul the mask position with numpy : 0.008023738861083984 nb_pixel_total : 226 time to create 1 rle with old method : 0.00025391578674316406 create new chi : 2.030766725540161 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0013935565948486328 batch 1 Loaded 119 chid ids of type : 4230 Number RLEs to save : 10645 TO DO : save crop sub photo not yet done ! save time : 0.6390476226806641 nb_obj : 109 nb_hashtags : 7 time to prepare the origin masks : 1.2906925678253174 time for calcul the mask position with numpy : 0.019095182418823242 nb_pixel_total : 1833657 time to create 1 rle with new method : 0.036440134048461914 time for calcul the mask position with numpy : 0.010190725326538086 nb_pixel_total : 38 time to create 1 rle with old method : 7.43865966796875e-05 time for calcul the mask position with numpy : 0.005725860595703125 nb_pixel_total : 63 time to create 1 rle with old method : 9.942054748535156e-05 time for calcul the mask position with numpy : 0.005812644958496094 nb_pixel_total : 273 time to create 1 rle with old method : 0.0003566741943359375 time for calcul the mask position with numpy : 0.0057218074798583984 nb_pixel_total : 123 time to create 1 rle with old method : 0.00015544891357421875 time for calcul the mask position with numpy : 0.005965232849121094 nb_pixel_total : 791 time to create 1 rle with old method : 0.0008616447448730469 time for calcul the mask position with numpy : 0.005693674087524414 nb_pixel_total : 60 time to create 1 rle with old method : 0.00011467933654785156 time for calcul the mask position with numpy : 0.0055887699127197266 nb_pixel_total : 79 time to create 1 rle with old method : 9.894371032714844e-05 time for calcul the mask position with numpy : 0.005631208419799805 nb_pixel_total : 2 time to create 1 rle with old method : 2.1457672119140625e-05 time for calcul the mask position with numpy : 0.005528926849365234 nb_pixel_total : 2215 time to create 1 rle with old method : 0.002337217330932617 time for calcul the mask position with numpy : 0.005558967590332031 nb_pixel_total : 5650 time to create 1 rle with old method : 0.005997419357299805 time for calcul the mask position with numpy : 0.00940251350402832 nb_pixel_total : 1006 time to create 1 rle with old method : 0.0011601448059082031 time for calcul the mask position with numpy : 0.009662151336669922 nb_pixel_total : 7 time to create 1 rle with old method : 3.528594970703125e-05 time for calcul the mask position with numpy : 0.009534358978271484 nb_pixel_total : 3180 time to create 1 rle with old method : 0.003650665283203125 time for calcul the mask position with numpy : 0.009578943252563477 nb_pixel_total : 994 time to create 1 rle with old method : 0.0011615753173828125 time for calcul the mask position with numpy : 0.00589299201965332 nb_pixel_total : 143 time to create 1 rle with old method : 0.0001919269561767578 time for calcul the mask position with numpy : 0.0057566165924072266 nb_pixel_total : 467 time to create 1 rle with old method : 0.0005133152008056641 time for calcul the mask position with numpy : 0.0057201385498046875 nb_pixel_total : 436 time to create 1 rle with old method : 0.0005424022674560547 time for calcul the mask position with numpy : 0.005782604217529297 nb_pixel_total : 2184 time to create 1 rle with old method : 0.0025358200073242188 time for calcul the mask position with numpy : 0.005631685256958008 nb_pixel_total : 430 time to create 1 rle with old method : 0.0004794597625732422 time for calcul the mask position with numpy : 0.0059185028076171875 nb_pixel_total : 9288 time to create 1 rle with old method : 0.010387182235717773 time for calcul the mask position with numpy : 0.005556344985961914 nb_pixel_total : 93 time to create 1 rle with old method : 0.00012612342834472656 time for calcul the mask position with numpy : 0.0059740543365478516 nb_pixel_total : 87 time to create 1 rle with old method : 0.00012159347534179688 time for calcul the mask position with numpy : 0.005593061447143555 nb_pixel_total : 1290 time to create 1 rle with old method : 0.0014929771423339844 time for calcul the mask position with numpy : 0.005634307861328125 nb_pixel_total : 1182 time to create 1 rle with old method : 0.0013134479522705078 time for calcul the mask position with numpy : 0.005636930465698242 nb_pixel_total : 20 time to create 1 rle with old method : 3.695487976074219e-05 time for calcul the mask position with numpy : 0.005615711212158203 nb_pixel_total : 531 time to create 1 rle with old method : 0.0006325244903564453 time for calcul the mask position with numpy : 0.005536794662475586 nb_pixel_total : 96 time to create 1 rle with old method : 0.0001270771026611328 time for calcul the mask position with numpy : 0.0057604312896728516 nb_pixel_total : 15335 time to create 1 rle with old method : 0.018044233322143555 time for calcul the mask position with numpy : 0.006093502044677734 nb_pixel_total : 2262 time to create 1 rle with old method : 0.0027790069580078125 time for calcul the mask position with numpy : 0.006083488464355469 nb_pixel_total : 302 time to create 1 rle with old method : 0.00038886070251464844 time for calcul the mask position with numpy : 0.006125211715698242 nb_pixel_total : 154 time to create 1 rle with old method : 0.00019884109497070312 time for calcul the mask position with numpy : 0.005998849868774414 nb_pixel_total : 221 time to create 1 rle with old method : 0.0002732276916503906 time for calcul the mask position with numpy : 0.006387948989868164 nb_pixel_total : 481 time to create 1 rle with old method : 0.000993490219116211 time for calcul the mask position with numpy : 0.007129669189453125 nb_pixel_total : 6715 time to create 1 rle with old method : 0.010693073272705078 time for calcul the mask position with numpy : 0.0063686370849609375 nb_pixel_total : 238 time to create 1 rle with old method : 0.0004119873046875 time for calcul the mask position with numpy : 0.00646209716796875 nb_pixel_total : 853 time to create 1 rle with old method : 0.0012209415435791016 time for calcul the mask position with numpy : 0.006358623504638672 nb_pixel_total : 51 time to create 1 rle with old method : 0.0001308917999267578 time for calcul the mask position with numpy : 0.006342649459838867 nb_pixel_total : 1350 time to create 1 rle with old method : 0.0015864372253417969 time for calcul the mask position with numpy : 0.006117343902587891 nb_pixel_total : 250 time to create 1 rle with old method : 0.00035381317138671875 time for calcul the mask position with numpy : 0.005904436111450195 nb_pixel_total : 1842 time to create 1 rle with old method : 0.002230405807495117 time for calcul the mask position with numpy : 0.006047248840332031 nb_pixel_total : 9004 time to create 1 rle with old method : 0.010811805725097656 time for calcul the mask position with numpy : 0.00612330436706543 nb_pixel_total : 13836 time to create 1 rle with old method : 0.015595197677612305 time for calcul the mask position with numpy : 0.006376028060913086 nb_pixel_total : 196 time to create 1 rle with old method : 0.00031256675720214844 time for calcul the mask position with numpy : 0.005888462066650391 nb_pixel_total : 130 time to create 1 rle with old method : 0.0001857280731201172 time for calcul the mask position with numpy : 0.00617218017578125 nb_pixel_total : 384 time to create 1 rle with old method : 0.0007545948028564453 time for calcul the mask position with numpy : 0.006287574768066406 nb_pixel_total : 1795 time to create 1 rle with old method : 0.0021283626556396484 time for calcul the mask position with numpy : 0.0057337284088134766 nb_pixel_total : 574 time to create 1 rle with old method : 0.0007319450378417969 time for calcul the mask position with numpy : 0.006090641021728516 nb_pixel_total : 3440 time to create 1 rle with old method : 0.003924369812011719 time for calcul the mask position with numpy : 0.006094455718994141 nb_pixel_total : 3007 time to create 1 rle with old method : 0.003603219985961914 time for calcul the mask position with numpy : 0.00590205192565918 nb_pixel_total : 964 time to create 1 rle with old method : 0.001230001449584961 time for calcul the mask position with numpy : 0.005839109420776367 nb_pixel_total : 1326 time to create 1 rle with old method : 0.0015540122985839844 time for calcul the mask position with numpy : 0.005817890167236328 nb_pixel_total : 59 time to create 1 rle with old method : 9.989738464355469e-05 time for calcul the mask position with numpy : 0.005834817886352539 nb_pixel_total : 1089 time to create 1 rle with old method : 0.0013287067413330078 time for calcul the mask position with numpy : 0.005896329879760742 nb_pixel_total : 327 time to create 1 rle with old method : 0.0004100799560546875 time for calcul the mask position with numpy : 0.006081104278564453 nb_pixel_total : 613 time to create 1 rle with old method : 0.0007007122039794922 time for calcul the mask position with numpy : 0.006345272064208984 nb_pixel_total : 1923 time to create 1 rle with old method : 0.0023932456970214844 time for calcul the mask position with numpy : 0.0059125423431396484 nb_pixel_total : 2631 time to create 1 rle with old method : 0.0030248165130615234 time for calcul the mask position with numpy : 0.006091117858886719 nb_pixel_total : 437 time to create 1 rle with old method : 0.000560760498046875 time for calcul the mask position with numpy : 0.006031513214111328 nb_pixel_total : 1682 time to create 1 rle with old method : 0.0019617080688476562 time for calcul the mask position with numpy : 0.006049156188964844 nb_pixel_total : 1522 time to create 1 rle with old method : 0.0018608570098876953 time for calcul the mask position with numpy : 0.006081104278564453 nb_pixel_total : 158 time to create 1 rle with old method : 0.0002090930938720703 time for calcul the mask position with numpy : 0.006167173385620117 nb_pixel_total : 178 time to create 1 rle with old method : 0.00022339820861816406 time for calcul the mask position with numpy : 0.0059125423431396484 nb_pixel_total : 215 time to create 1 rle with old method : 0.0002720355987548828 time for calcul the mask position with numpy : 0.006049633026123047 nb_pixel_total : 141 time to create 1 rle with old method : 0.00018143653869628906 time for calcul the mask position with numpy : 0.00586390495300293 nb_pixel_total : 158 time to create 1 rle with old method : 0.00021004676818847656 time for calcul the mask position with numpy : 0.006088733673095703 nb_pixel_total : 1103 time to create 1 rle with old method : 0.0013022422790527344 time for calcul the mask position with numpy : 0.006173372268676758 nb_pixel_total : 897 time to create 1 rle with old method : 0.0011246204376220703 time for calcul the mask position with numpy : 0.0060656070709228516 nb_pixel_total : 212 time to create 1 rle with old method : 0.00025272369384765625 time for calcul the mask position with numpy : 0.0068056583404541016 nb_pixel_total : 106061 time to create 1 rle with old method : 0.11700868606567383 time for calcul the mask position with numpy : 0.005894899368286133 nb_pixel_total : 3521 time to create 1 rle with old method : 0.004054546356201172 time for calcul the mask position with numpy : 0.005986452102661133 nb_pixel_total : 1515 time to create 1 rle with old method : 0.0018448829650878906 time for calcul the mask position with numpy : 0.005646228790283203 nb_pixel_total : 273 time to create 1 rle with old method : 0.0003523826599121094 time for calcul the mask position with numpy : 0.005628108978271484 nb_pixel_total : 338 time to create 1 rle with old method : 0.0004649162292480469 time for calcul the mask position with numpy : 0.005906581878662109 nb_pixel_total : 487 time to create 1 rle with old method : 0.0005567073822021484 time for calcul the mask position with numpy : 0.005799055099487305 nb_pixel_total : 2536 time to create 1 rle with old method : 0.003034353256225586 time for calcul the mask position with numpy : 0.0058040618896484375 nb_pixel_total : 207 time to create 1 rle with old method : 0.00027489662170410156 time for calcul the mask position with numpy : 0.005822181701660156 nb_pixel_total : 1066 time to create 1 rle with old method : 0.0012907981872558594 time for calcul the mask position with numpy : 0.005842447280883789 nb_pixel_total : 104 time to create 1 rle with old method : 0.0001430511474609375 time for calcul the mask position with numpy : 0.005972385406494141 nb_pixel_total : 225 time to create 1 rle with old method : 0.00028133392333984375 time for calcul the mask position with numpy : 0.009893655776977539 nb_pixel_total : 298 time to create 1 rle with old method : 0.0003561973571777344 time for calcul the mask position with numpy : 0.009535074234008789 nb_pixel_total : 2803 time to create 1 rle with old method : 0.00319671630859375 time for calcul the mask position with numpy : 0.009315013885498047 nb_pixel_total : 441 time to create 1 rle with old method : 0.0005021095275878906 time for calcul the mask position with numpy : 0.00970005989074707 nb_pixel_total : 142 time to create 1 rle with old method : 0.0001862049102783203 time for calcul the mask position with numpy : 0.00983119010925293 nb_pixel_total : 351 time to create 1 rle with old method : 0.0004334449768066406 time for calcul the mask position with numpy : 0.009863615036010742 nb_pixel_total : 3221 time to create 1 rle with old method : 0.0036911964416503906 time for calcul the mask position with numpy : 0.009887456893920898 nb_pixel_total : 316 time to create 1 rle with old method : 0.00044155120849609375 time for calcul the mask position with numpy : 0.009873151779174805 nb_pixel_total : 146 time to create 1 rle with old method : 0.000194549560546875 time for calcul the mask position with numpy : 0.006131410598754883 nb_pixel_total : 201 time to create 1 rle with old method : 0.00022864341735839844 time for calcul the mask position with numpy : 0.0058362483978271484 nb_pixel_total : 197 time to create 1 rle with old method : 0.00025081634521484375 time for calcul the mask position with numpy : 0.005952119827270508 nb_pixel_total : 1059 time to create 1 rle with old method : 0.0013566017150878906 time for calcul the mask position with numpy : 0.006103992462158203 nb_pixel_total : 470 time to create 1 rle with old method : 0.0005557537078857422 time for calcul the mask position with numpy : 0.006192445755004883 nb_pixel_total : 589 time to create 1 rle with old method : 0.0007219314575195312 time for calcul the mask position with numpy : 0.006099224090576172 nb_pixel_total : 191 time to create 1 rle with old method : 0.0002491474151611328 time for calcul the mask position with numpy : 0.0057833194732666016 nb_pixel_total : 235 time to create 1 rle with old method : 0.00027489662170410156 time for calcul the mask position with numpy : 0.00601506233215332 nb_pixel_total : 240 time to create 1 rle with old method : 0.0002925395965576172 time for calcul the mask position with numpy : 0.005831003189086914 nb_pixel_total : 682 time to create 1 rle with old method : 0.0007658004760742188 time for calcul the mask position with numpy : 0.005887269973754883 nb_pixel_total : 290 time to create 1 rle with old method : 0.0003695487976074219 time for calcul the mask position with numpy : 0.0060274600982666016 nb_pixel_total : 15 time to create 1 rle with old method : 5.245208740234375e-05 time for calcul the mask position with numpy : 0.006042957305908203 nb_pixel_total : 107 time to create 1 rle with old method : 0.00013518333435058594 time for calcul the mask position with numpy : 0.005850791931152344 nb_pixel_total : 233 time to create 1 rle with old method : 0.0002951622009277344 time for calcul the mask position with numpy : 0.005765676498413086 nb_pixel_total : 213 time to create 1 rle with old method : 0.00025844573974609375 time for calcul the mask position with numpy : 0.0059320926666259766 nb_pixel_total : 224 time to create 1 rle with old method : 0.00027298927307128906 time for calcul the mask position with numpy : 0.005674600601196289 nb_pixel_total : 64 time to create 1 rle with old method : 0.00010991096496582031 time for calcul the mask position with numpy : 0.005630016326904297 nb_pixel_total : 506 time to create 1 rle with old method : 0.0005898475646972656 time for calcul the mask position with numpy : 0.005858898162841797 nb_pixel_total : 168 time to create 1 rle with old method : 0.00021314620971679688 time for calcul the mask position with numpy : 0.006074190139770508 nb_pixel_total : 567 time to create 1 rle with old method : 0.0006496906280517578 time for calcul the mask position with numpy : 0.00594019889831543 nb_pixel_total : 344 time to create 1 rle with old method : 0.00040411949157714844 time for calcul the mask position with numpy : 0.005907297134399414 nb_pixel_total : 245 time to create 1 rle with old method : 0.0002751350402832031 time for calcul the mask position with numpy : 0.005906581878662109 nb_pixel_total : 269 time to create 1 rle with old method : 0.0003504753112792969 create new chi : 1.0342051982879639 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0014193058013916016 batch 1 Loaded 110 chid ids of type : 4230 Number RLEs to save : 11451 TO DO : save crop sub photo not yet done ! save time : 0.6425988674163818 map_output_result : {1338193091: (0.0, 'Should be the crop_list due to order', 0.0), 1338193086: (0.0, 'Should be the crop_list due to order', 0.0), 1338193079: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1338193091, 1338193086, 1338193079] Looping around the photos to save general results len do output : 3 /1338193091.Didn't retrieve data . /1338193086.Didn't retrieve data . /1338193079.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2594045') ('4234', '20615840', '1338193091', None, None, None, None, None, '2594045') ('4234', None, None, None, None, None, None, None, '2594045') ('4234', '20615840', '1338193086', None, None, None, None, None, '2594045') ('4234', None, None, None, None, None, None, None, '2594045') ('4234', '20615840', '1338193079', None, None, None, None, None, '2594045') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.011635780334472656 save_final save missing photos in datou_result : time spend for datou_step_exec : 12.697144269943237 time spend to save output : 0.011932849884033203 total time spend for step 4 : 12.70907711982727 step5:crop_condition Mon Feb 17 18:21:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 3 ! batch 1 Loaded 345 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 133 About to insert : list_path_to_insert length 133 new photo from crops ! About to upload 133 photos upload in portfolio : 4869462 init cache_photo without model_param we have 133 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739812877_311655 we have uploaded 133 photos in the portfolio 4869462 time of upload the photos Elapsed time : 31.646954774856567 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 43 About to insert : list_path_to_insert length 43 new photo from crops ! About to upload 43 photos upload in portfolio : 4869462 init cache_photo without model_param we have 43 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739812910_311655 we have uploaded 43 photos in the portfolio 4869462 time of upload the photos Elapsed time : 14.975006103515625 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 7 About to insert : list_path_to_insert length 7 new photo from crops ! About to upload 7 photos upload in portfolio : 4869462 init cache_photo without model_param we have 7 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739812925_311655 we have uploaded 7 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.9773170948028564 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 20 About to insert : list_path_to_insert length 20 new photo from crops ! About to upload 20 photos upload in portfolio : 4869462 init cache_photo without model_param we have 20 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739812927_311655 we have uploaded 20 photos in the portfolio 4869462 time of upload the photos Elapsed time : 6.375017166137695 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 49 About to insert : list_path_to_insert length 49 new photo from crops ! About to upload 49 photos upload in portfolio : 4869462 init cache_photo without model_param we have 49 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739812934_311655 we have uploaded 49 photos in the portfolio 4869462 time of upload the photos Elapsed time : 16.963966369628906 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1338193091, 1338193086, 1338193079] Looping around the photos to save general results len do output : 252 /1338199318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199554Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199563Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199569Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199591Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1338199604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2594045') ('4234', '20615840', '1338193091', None, None, None, None, None, '2594045') ('4234', None, None, None, None, None, None, None, '2594045') ('4234', '20615840', '1338193086', None, None, None, None, None, '2594045') ('4234', None, None, None, None, None, None, None, '2594045') ('4234', '20615840', '1338193079', None, None, None, None, None, '2594045') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 759 time used for this insertion : 0.042003631591796875 save_final save missing photos in datou_result : time spend for datou_step_exec : 76.37356376647949 time spend to save output : 0.0496826171875 total time spend for step 5 : 76.42324638366699 step6:thcl Mon Feb 17 18:22:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.012943029403686523 time to convert the images to numpy array : 0.054317474365234375 time to import caffe and check if the image exist : 0.014968395233154297 time to convert the images to numpy array : 0.06366133689880371 time to import caffe and check if the image exist : 0.018451452255249023 time to convert the images to numpy array : 0.06493425369262695 time to import caffe and check if the image exist : 0.014094829559326172 time to convert the images to numpy array : 0.07294821739196777 time to import caffe and check if the image exist : 0.024746179580688477 time to convert the images to numpy array : 0.062029123306274414 time to import caffe and check if the image exist : 0.0233609676361084 time to convert the images to numpy array : 0.06589579582214355 time to import caffe and check if the image exist : 0.022780418395996094 time to convert the images to numpy array : 0.06784224510192871 time to import caffe and check if the image exist : 0.018372535705566406 time to convert the images to numpy array : 0.07456755638122559 time to import caffe and check if the image exist : 0.01853156089782715 time to convert the images to numpy array : 0.07473635673522949 time to import caffe and check if the image exist : 0.026327133178710938 time to convert the images to numpy array : 0.06768989562988281 total time to convert the images to numpy array : 0.47072696685791016 list photo_ids error: [] list photo_ids correct : [1338199587, 1338199588, 1338199589, 1338199590, 1338199591, 1338199592, 1338199593, 1338199594, 1338199595, 1338199596, 1338199597, 1338199598, 1338199599, 1338199600, 1338199601, 1338199602, 1338199603, 1338199604, 1338199427, 1338199428, 1338199430, 1338199431, 1338199432, 1338199433, 1338199434, 1338199435, 1338199436, 1338199437, 1338199438, 1338199439, 1338199440, 1338199441, 1338199442, 1338199443, 1338199444, 1338199445, 1338199446, 1338199447, 1338199448, 1338199449, 1338199450, 1338199451, 1338199452, 1338199453, 1338199373, 1338199374, 1338199375, 1338199376, 1338199377, 1338199378, 1338199379, 1338199380, 1338199381, 1338199382, 1338199383, 1338199384, 1338199385, 1338199386, 1338199387, 1338199388, 1338199389, 1338199390, 1338199391, 1338199392, 1338199393, 1338199394, 1338199395, 1338199396, 1338199397, 1338199398, 1338199318, 1338199319, 1338199320, 1338199321, 1338199322, 1338199323, 1338199324, 1338199325, 1338199326, 1338199327, 1338199328, 1338199329, 1338199330, 1338199331, 1338199332, 1338199333, 1338199335, 1338199336, 1338199337, 1338199338, 1338199339, 1338199340, 1338199341, 1338199342, 1338199343, 1338199344, 1338199559, 1338199560, 1338199561, 1338199562, 1338199563, 1338199564, 1338199565, 1338199566, 1338199567, 1338199568, 1338199569, 1338199570, 1338199573, 1338199574, 1338199575, 1338199576, 1338199577, 1338199578, 1338199579, 1338199580, 1338199581, 1338199582, 1338199583, 1338199584, 1338199585, 1338199586, 1338199517, 1338199529, 1338199530, 1338199531, 1338199532, 1338199533, 1338199534, 1338199535, 1338199536, 1338199537, 1338199538, 1338199539, 1338199540, 1338199541, 1338199542, 1338199543, 1338199544, 1338199545, 1338199546, 1338199547, 1338199548, 1338199554, 1338199555, 1338199556, 1338199557, 1338199558, 1338199345, 1338199346, 1338199347, 1338199348, 1338199349, 1338199350, 1338199351, 1338199352, 1338199353, 1338199354, 1338199356, 1338199357, 1338199358, 1338199359, 1338199360, 1338199361, 1338199362, 1338199364, 1338199365, 1338199366, 1338199367, 1338199368, 1338199369, 1338199370, 1338199371, 1338199372, 1338199491, 1338199492, 1338199493, 1338199494, 1338199495, 1338199496, 1338199497, 1338199498, 1338199499, 1338199500, 1338199501, 1338199502, 1338199503, 1338199504, 1338199505, 1338199506, 1338199507, 1338199508, 1338199509, 1338199510, 1338199511, 1338199512, 1338199513, 1338199514, 1338199515, 1338199516, 1338199454, 1338199455, 1338199456, 1338199467, 1338199468, 1338199469, 1338199470, 1338199471, 1338199472, 1338199473, 1338199474, 1338199475, 1338199476, 1338199477, 1338199478, 1338199480, 1338199481, 1338199482, 1338199483, 1338199484, 1338199485, 1338199486, 1338199487, 1338199488, 1338199489, 1338199490, 1338199399, 1338199400, 1338199401, 1338199402, 1338199403, 1338199405, 1338199406, 1338199407, 1338199408, 1338199409, 1338199410, 1338199411, 1338199412, 1338199413, 1338199414, 1338199415, 1338199416, 1338199417, 1338199418, 1338199419, 1338199420, 1338199421, 1338199422, 1338199423, 1338199425, 1338199426] number of photos to traite : 252 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 7679 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 7460 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 1.2012627124786377 time used to do the prediction : 0.9887442588806152 save descriptor for thcl : 3237 time to traite the descriptors : 1.5534148216247559 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1338199587 To insert : 1338199588 To insert : 1338199589 To insert : 1338199590 To insert : 1338199591 To insert : 1338199592 To insert : 1338199593 To insert : 1338199594 To insert : 1338199595 To insert : 1338199596 To insert : 1338199597 To insert : 1338199598 To insert : 1338199599 To insert : 1338199600 To insert : 1338199601 To insert : 1338199602 To insert : 1338199603 To insert : 1338199604 To insert : 1338199427 To insert : 1338199428 To insert : 1338199430 To insert : 1338199431 To insert : 1338199432 To insert : 1338199433 To insert : 1338199434 To insert : 1338199435 To insert : 1338199436 To insert : 1338199437 To insert : 1338199438 To insert : 1338199439 To insert : 1338199440 To insert : 1338199441 To insert : 1338199442 To insert : 1338199443 To insert : 1338199444 To insert : 1338199445 To insert : 1338199446 To insert : 1338199447 To insert : 1338199448 To insert : 1338199449 To insert : 1338199450 To insert : 1338199451 To insert : 1338199452 To insert : 1338199453 To insert : 1338199373 To insert : 1338199374 To insert : 1338199375 To insert : 1338199376 To insert : 1338199377 To insert : 1338199378 To insert : 1338199379 To insert : 1338199380 To insert : 1338199381 To insert : 1338199382 To insert : 1338199383 To insert : 1338199384 To insert : 1338199385 To insert : 1338199386 To insert : 1338199387 To insert : 1338199388 To insert : 1338199389 To insert : 1338199390 To insert : 1338199391 To insert : 1338199392 To insert : 1338199393 To insert : 1338199394 To insert : 1338199395 To insert : 1338199396 To insert : 1338199397 To insert : 1338199398 To insert : 1338199318 To insert : 1338199319 To insert : 1338199320 To insert : 1338199321 To insert : 1338199322 To insert : 1338199323 To insert : 1338199324 To insert : 1338199325 To insert : 1338199326 To insert : 1338199327 To insert : 1338199328 To insert : 1338199329 To insert : 1338199330 To insert : 1338199331 To insert : 1338199332 To insert : 1338199333 To insert : 1338199335 To insert : 1338199336 To insert : 1338199337 To insert : 1338199338 To insert : 1338199339 To insert : 1338199340 To insert : 1338199341 To insert : 1338199342 To insert : 1338199343 To insert : 1338199344 To insert : 1338199559 To insert : 1338199560 To insert : 1338199561 To insert : 1338199562 To insert : 1338199563 To insert : 1338199564 To insert : 1338199565 To insert : 1338199566 To insert : 1338199567 To insert : 1338199568 To insert : 1338199569 To insert : 1338199570 To insert : 1338199573 To insert : 1338199574 To insert : 1338199575 To insert : 1338199576 To insert : 1338199577 To insert : 1338199578 To insert : 1338199579 To insert : 1338199580 To insert : 1338199581 To insert : 1338199582 To insert : 1338199583 To insert : 1338199584 To insert : 1338199585 To insert : 1338199586 To insert : 1338199517 To insert : 1338199529 To insert : 1338199530 To insert : 1338199531 To insert : 1338199532 To insert : 1338199533 To insert : 1338199534 To insert : 1338199535 To insert : 1338199536 To insert : 1338199537 To insert : 1338199538 To insert : 1338199539 To insert : 1338199540 To insert : 1338199541 To insert : 1338199542 To insert : 1338199543 To insert : 1338199544 To insert : 1338199545 To insert : 1338199546 To insert : 1338199547 To insert : 1338199548 To insert : 1338199554 To insert : 1338199555 To insert : 1338199556 To insert : 1338199557 To insert : 1338199558 To insert : 1338199345 To insert : 1338199346 To insert : 1338199347 To insert : 1338199348 To insert : 1338199349 To insert : 1338199350 To insert : 1338199351 To insert : 1338199352 To insert : 1338199353 To insert : 1338199354 To insert : 1338199356 To insert : 1338199357 To insert : 1338199358 To insert : 1338199359 To insert : 1338199360 To insert : 1338199361 To insert : 1338199362 To insert : 1338199364 To insert : 1338199365 To insert : 1338199366 To insert : 1338199367 To insert : 1338199368 To insert : 1338199369 To insert : 1338199370 To insert : 1338199371 To insert : 1338199372 To insert : 1338199491 To insert : 1338199492 To insert : 1338199493 To insert : 1338199494 To insert : 1338199495 To insert : 1338199496 To insert : 1338199497 To insert : 1338199498 To insert : 1338199499 To insert : 1338199500 To insert : 1338199501 To insert : 1338199502 To insert : 1338199503 To insert : 1338199504 To insert : 1338199505 To insert : 1338199506 To insert : 1338199507 To insert : 1338199508 To insert : 1338199509 To insert : 1338199510 To insert : 1338199511 To insert : 1338199512 To insert : 1338199513 To insert : 1338199514 To insert : 1338199515 To insert : 1338199516 To insert : 1338199454 To insert : 1338199455 To insert : 1338199456 To insert : 1338199467 To insert : 1338199468 To insert : 1338199469 To insert : 1338199470 To insert : 1338199471 To insert : 1338199472 To insert : 1338199473 To insert : 1338199474 To insert : 1338199475 To insert : 1338199476 To insert : 1338199477 To insert : 1338199478 To insert : 1338199480 To insert : 1338199481 To insert : 1338199482 To insert : 1338199483 To insert : 1338199484 To insert : 1338199485 To insert : 1338199486 To insert : 1338199487 To insert : 1338199488 To insert : 1338199489 To insert : 1338199490 To insert : 1338199399 To insert : 1338199400 To insert : 1338199401 To insert : 1338199402 To insert : 1338199403 To insert : 1338199405 To insert : 1338199406 To insert : 1338199407 To insert : 1338199408 To insert : 1338199409 To insert : 1338199410 To insert : 1338199411 To insert : 1338199412 To insert : 1338199413 To insert : 1338199414 To insert : 1338199415 To insert : 1338199416 To insert : 1338199417 To insert : 1338199418 To insert : 1338199419 To insert : 1338199420 To insert : 1338199421 To insert : 1338199422 To insert : 1338199423 To insert : 1338199425 To insert : 1338199426 time to insert the descriptors : 47.73934483528137 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 388 time used for this insertion : 0.029473304748535156 save missing photos in datou_result : time spend for datou_step_exec : 56.01577615737915 time spend to save output : 0.08168697357177734 total time spend for step 6 : 56.09746313095093 step7:ventilate_hashtags_in_portfolio Mon Feb 17 18:23:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20615840 get user id for portfolio 20615840 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20615840 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','pehd','PEHD','metal','pet_fonce','PET_fonce','environnement','refus','mal_croppe','flou','Tetrapak','papier','autre','Papier','Carton','Film_plastique','PET_clair','pet_clair')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20615840 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','pehd','PEHD','metal','pet_fonce','PET_fonce','environnement','refus','mal_croppe','flou','Tetrapak','papier','autre','Papier','Carton','Film_plastique','PET_clair','pet_clair')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20615840 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','pehd','PEHD','metal','pet_fonce','PET_fonce','environnement','refus','mal_croppe','flou','Tetrapak','papier','autre','Papier','Carton','Film_plastique','PET_clair','pet_clair')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20615840 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('carton','pehd','PEHD','metal','pet_fonce','PET_fonce','environnement','refus','mal_croppe','flou','Tetrapak','papier','autre','Papier','Carton','Film_plastique','PET_clair','pet_clair')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20616590,20616578,20616579,20616581,20616582,20616583,20616584,20616585,20616586,20616589,20616588,20616591,20616593?tags=carton,pehd,metal,pet_fonce,environnement,refus,mal_croppe,flou,tetrapak,papier,autre,film_plastique,pet_clair&datou_id_consolidate=4235&port_consolidate=20615840 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1338193091, 1338193086, 1338193079] Looping around the photos to save general results len do output : 1 /20615840. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2594045') ('4234', '20615840', '1338193091', None, None, None, None, None, '2594045') ('4234', None, None, None, None, None, None, None, '2594045') ('4234', '20615840', '1338193086', None, None, None, None, None, '2594045') ('4234', None, None, None, None, None, None, None, '2594045') ('4234', '20615840', '1338193079', None, None, None, None, None, '2594045') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.012528181076049805 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.3393940925598145 time spend to save output : 0.012803316116333008 total time spend for step 7 : 2.3521974086761475 step8:final Mon Feb 17 18:23:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1338193091: ('0.20641900846457686',), 1338193086: ('0.20641900846457686',), 1338193079: ('0.20641900846457686',)} new output for save of step final : {1338193091: ('0.20641900846457686',), 1338193086: ('0.20641900846457686',), 1338193079: ('0.20641900846457686',)} [1338193091, 1338193086, 1338193079] Looping around the photos to save general results len do output : 3 /1338193091.Didn't retrieve data . /1338193086.Didn't retrieve data . /1338193079.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2594045') ('4234', '20615840', '1338193091', None, None, None, None, None, '2594045') ('4234', None, None, None, None, None, None, None, '2594045') ('4234', '20615840', '1338193086', None, None, None, None, None, '2594045') ('4234', None, None, None, None, None, None, None, '2594045') ('4234', '20615840', '1338193079', None, None, None, None, None, '2594045') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.012467384338378906 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12022519111633301 time spend to save output : 0.012737035751342773 total time spend for step 8 : 0.13296222686767578 step9:velours_tree Mon Feb 17 18:23:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20616590,20616578,20616579,20616581,20616582,20616583,20616584,20616585,20616586,20616589,20616588,20616591,20616593 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20616590 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20616578 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20616579 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20616581 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20616582 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20616583 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20616584 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20616585 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20616586 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20616589 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20616588 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20616591 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20616593 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 252 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [4 0 1 1 5 1 3 1 5 1 4 2 2 2 2 3 2 2 2 2 2 0 2 3 2 2 5 2 2 2 4 3 2 3 0 3 2 0 4 2 2 0 0 3 2 2 2 4 0 5 3 1 5 1 2 3 2 2 2 2 2 2 2 0 2 2 0 2 4 2 2 4 3 0 0 2 0 2 0 3 0 3 3 3 2 5 2 1 2 1 4 5 4 5 1 1 5 1 3 1 5 2 2 2 5 2 5 2 2 2 2 0 2 2 2 3 4 4 0 5 3 2 2 2 2 0 0 3 2 3 2 2 2 0 4 1 0 1 2 3 0 1 2 0 4 0 1 5 0 4 1 5 1 1 2 3 3 1 0 5 1 3 0 4 1 2 1 2 3 3 0 1 1 0 1 5 4 5 2 3 1 3 2 2 2 5 2 0 3 2 2 5 0 3 2 2 2 2 1 3 2 3 0 4 3 2 2 5 0 0 2 5 5 2 3 5 2 3 4 5 2 0 3 2 2 2 5 4 4 3 4 3 2 4 5 2 4 3 3 5 5 4 3 2 2 2 5 5 2 5 5 3] Elapsed time: 0.044449806213378906 graph_id used : 79105 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20616590,20616578,20616579,20616581,20616582,20616583,20616584,20616585,20616586,20616589,20616588,20616591,20616593?tags=carton,pehd,metal,pet_fonce,environnement,refus,mal_croppe,flou,tetrapak,papier,autre,film_plastique,pet_clair&datou_id_consolidate=4235&port_consolidate=20615840&tree_id=79105 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1338193091, 1338193086, 1338193079] Looping around the photos to save general results len do output : 1 /20615840Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2594045') ('4234', '20615840', '1338193091', None, None, None, None, None, '2594045') ('4234', None, None, None, None, None, None, None, '2594045') ('4234', '20615840', '1338193086', None, None, None, None, None, '2594045') ('4234', None, None, None, None, None, None, None, '2594045') ('4234', '20615840', '1338193079', None, None, None, None, None, '2594045') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.012293815612792969 save_final save missing photos in datou_result : time spend for datou_step_exec : 17.667113304138184 time spend to save output : 0.012508392333984375 total time spend for step 9 : 17.679621696472168 step10:send_mail_cod Mon Feb 17 18:23:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20615840_17-02-2025_18_23_47.pdf 20616572 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette206165721739813027 20616560 imagette206165601739813028 20616561 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette206165611739813028 20616563 imagette206165631739813029 20616565 imagette206165651739813029 20616566 imagette206165661739813029 20616567 imagette206165671739813029 20616568 imagette206165681739813029 20616571 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette206165711739813029 20616570 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette206165701739813030 20616573 imagette206165731739813031 20616575 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette206165751739813031 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20615840 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20616590,20616578,20616579,20616581,20616582,20616583,20616584,20616585,20616586,20616589,20616588,20616591,20616593?tags=carton,pehd,metal,pet_fonce,environnement,refus,mal_croppe,flou,tetrapak,papier,autre,film_plastique,pet_clair&datou_id_consolidate=4235&port_consolidate=20615840&tree_id=79105 your option no_mail is active, we will not send the real mail to your client args[1338193091] : ((1338193091, -7.639692438635878, 492609224), (1338193091, -0.3341173651740419, 496442774), '0.20641900846457686') apple ((1338193091, -7.639692438635878, 492609224), (1338193091, -0.3341173651740419, 496442774), '0.20641900846457686') We are sending mail with results at cod@fotonower.com args[1338193086] : ((1338193086, -7.580260474746947, 492609224), (1338193086, -0.31713897878435116, 496442774), '0.20641900846457686') apple ((1338193086, -7.580260474746947, 492609224), (1338193086, -0.31713897878435116, 496442774), '0.20641900846457686') We are sending mail with results at cod@fotonower.com args[1338193079] : ((1338193079, -7.591623270131125, 492609224), (1338193079, -0.3380945440653478, 496442774), '0.20641900846457686') apple ((1338193079, -7.591623270131125, 492609224), (1338193079, -0.3380945440653478, 496442774), '0.20641900846457686') We are sending mail with results at cod@fotonower.com refus_total : 0.20641900846457686 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20615840 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20615840_17-02-2025_18_23_47.pdf results_Qualipapia_P20615840_17-02-2025_18_23_47.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20615840_17-02-2025_18_23_47.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20615840','results_Qualipapia_P20615840_17-02-2025_18_23_47.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20615840_17-02-2025_18_23_47.pdf','pdf','','0.18','0.20641900846457686') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1338193091, 1338193086, 1338193079] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2594045') ('4234', '20615840', '1338193091', None, None, None, None, None, '2594045') ('4234', None, None, None, None, None, None, None, '2594045') ('4234', '20615840', '1338193086', None, None, None, None, None, '2594045') ('4234', None, None, None, None, None, None, None, '2594045') ('4234', '20615840', '1338193079', None, None, None, None, None, '2594045') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.01250147819519043 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.137052536010742 time spend to save output : 0.012700319290161133 total time spend for step 10 : 5.149752855300903 step11:split_time_score Mon Feb 17 18:23:53 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 3),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 17022025 20615840 Nombre de photos uploadées : 3 / 23040 (0%) 17022025 20615840 Nombre de photos taguées (types de déchets): 3 / 3 (100%) 17022025 20615840 Nombre de photos taguées (volume) : 0 / 3 (0%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 6.198883056640625e-06 ??? elapsed_time : fill_and_build_computed_from_old_data 0.00026226043701171875 elapsed_time : insert_dashboard_record_day_entry 0.0225832462310791 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.2450372109965428 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20608074_17-02-2025_13_41_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20608074 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20608074 AND mptpi.`type`=4230 To do Qualite : 0.21215706772961557 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20608529_17-02-2025_14_30_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20608529 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20608529 AND mptpi.`type`=4230 To do Qualite : 0.2641071698528965 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20608530_17-02-2025_15_32_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20608530 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20608530 AND mptpi.`type`=4230 To do Qualite : 0.25837907801535653 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20608531_17-02-2025_14_20_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20608531 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20608531 AND mptpi.`type`=4230 To do Qualite : 0.23128722582754532 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20609543_17-02-2025_14_36_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20609543 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20609543 AND mptpi.`type`=4230 To do Qualite : 0.22136737047905578 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20614895_17-02-2025_17_46_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20614895 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20614895 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20615837 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20615838 order by id desc limit 1 Qualite : 0.22382367753571827 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20615839_17-02-2025_18_23_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20615839 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20615839 AND mptpi.`type`=4230 To do Qualite : 0.20641900846457686 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20615840_17-02-2025_18_23_47.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20615840 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20615840 AND mptpi.`type`=4230 To do Qualite : 0.20851665521164317 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20615841_17-02-2025_18_12_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20615841 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20615841 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'17022025': {'nb_upload': 3, 'nb_taggue_class': 3, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1338193091, 1338193086, 1338193079] Looping around the photos to save general results len do output : 1 /20615840Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2594045') ('4234', '20615840', '1338193091', None, None, None, None, None, '2594045') ('4234', None, None, None, None, None, None, None, '2594045') ('4234', '20615840', '1338193086', None, None, None, None, None, '2594045') ('4234', None, None, None, None, None, None, None, '2594045') ('4234', '20615840', '1338193079', None, None, None, None, None, '2594045') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.01236271858215332 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.2805445194244385 time spend to save output : 0.012554407119750977 total time spend for step 11 : 2.2930989265441895 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 3 set_done_treatment 44.41user 30.01system 3:30.31elapsed 35%CPU (0avgtext+0avgdata 2486588maxresident)k 901600inputs+18352outputs (4161major+2444184minor)pagefaults 0swaps