python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1555482 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2574893'] with mtr_portfolio_ids : ['20430845'] and first list_photo_ids : [] new path : /proc/1555482/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.32570719718933105 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Tue Feb 11 07:20:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10998 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-11 07:20:32.205168: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-11 07:20:32.231314: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-11 07:20:32.232867: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f1010000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-11 07:20:32.232902: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-11 07:20:32.235259: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-11 07:20:32.547284: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xb4fb950 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-11 07:20:32.547331: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-11 07:20:32.549006: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-11 07:20:32.549383: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-11 07:20:32.554094: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-11 07:20:32.556915: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-11 07:20:32.558905: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-11 07:20:32.563601: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-11 07:20:32.565151: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-11 07:20:32.574638: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-11 07:20:32.576398: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-11 07:20:32.576468: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-11 07:20:32.577686: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-11 07:20:32.577706: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-11 07:20:32.577717: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-11 07:20:32.579413: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-11 07:20:32.916797: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-11 07:20:32.916880: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-11 07:20:32.916903: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-11 07:20:32.916924: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-11 07:20:32.916943: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-11 07:20:32.916962: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-11 07:20:32.916981: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-11 07:20:32.917000: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-11 07:20:32.918730: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-11 07:20:32.920206: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-11 07:20:32.920246: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-11 07:20:32.920268: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-11 07:20:32.920288: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-11 07:20:32.920307: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-11 07:20:32.920327: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-11 07:20:32.920347: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-11 07:20:32.920366: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-11 07:20:32.921578: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-11 07:20:32.921608: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-11 07:20:32.921616: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-11 07:20:32.921624: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-11 07:20:32.922880: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10193 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-11 07:20:40.231422: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-11 07:20:40.404276: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 1 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.91094 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 7.557868957519531e-05 nb_pixel_total : 340 time to create 1 rle with old method : 0.0007178783416748047 length of segment : 18 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 269 time to create 1 rle with old method : 0.0005266666412353516 length of segment : 26 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 474 time to create 1 rle with old method : 0.0009000301361083984 length of segment : 47 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 331 time to create 1 rle with old method : 0.000644683837890625 length of segment : 24 time for calcul the mask position with numpy : 0.0002739429473876953 nb_pixel_total : 8180 time to create 1 rle with old method : 0.02994227409362793 length of segment : 236 time for calcul the mask position with numpy : 9.512901306152344e-05 nb_pixel_total : 341 time to create 1 rle with old method : 0.0007071495056152344 length of segment : 21 time for calcul the mask position with numpy : 0.0004105567932128906 nb_pixel_total : 17256 time to create 1 rle with old method : 0.029308319091796875 length of segment : 212 Processing 1 images image shape: (400, 400, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.53984 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 235 time to create 1 rle with old method : 0.0004220008850097656 length of segment : 18 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002551078796386719 length of segment : 27 time for calcul the mask position with numpy : 0.000244140625 nb_pixel_total : 12054 time to create 1 rle with old method : 0.014328956604003906 length of segment : 138 time for calcul the mask position with numpy : 0.00030875205993652344 nb_pixel_total : 17207 time to create 1 rle with old method : 0.023125648498535156 length of segment : 147 time for calcul the mask position with numpy : 0.00011348724365234375 nb_pixel_total : 823 time to create 1 rle with old method : 0.0013587474822998047 length of segment : 59 Processing 1 images image shape: (400, 400, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.57891 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 1311 time to create 1 rle with old method : 0.0018925666809082031 length of segment : 31 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 358 time to create 1 rle with old method : 0.0005660057067871094 length of segment : 18 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 546 time to create 1 rle with old method : 0.0006952285766601562 length of segment : 39 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 705 time to create 1 rle with old method : 0.0012781620025634766 length of segment : 26 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 271 time to create 1 rle with old method : 0.0005006790161132812 length of segment : 16 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 700 time to create 1 rle with old method : 0.0011129379272460938 length of segment : 27 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.90313 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 667 time to create 1 rle with old method : 0.0010509490966796875 length of segment : 41 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 436 time to create 1 rle with old method : 0.0006380081176757812 length of segment : 31 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 614 time to create 1 rle with old method : 0.0009729862213134766 length of segment : 55 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 727 time to create 1 rle with old method : 0.0011157989501953125 length of segment : 43 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 630 time to create 1 rle with old method : 0.0009832382202148438 length of segment : 29 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 276 time to create 1 rle with old method : 0.00042939186096191406 length of segment : 22 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 1850 time to create 1 rle with old method : 0.0026025772094726562 length of segment : 67 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 305 time to create 1 rle with old method : 0.00047850608825683594 length of segment : 24 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 685 time to create 1 rle with old method : 0.0010006427764892578 length of segment : 30 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 125 time to create 1 rle with old method : 0.00023984909057617188 length of segment : 17 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 336 time to create 1 rle with old method : 0.0005283355712890625 length of segment : 20 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 425 time to create 1 rle with old method : 0.00074005126953125 length of segment : 29 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 1041 time to create 1 rle with old method : 0.001550436019897461 length of segment : 27 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 1014 time to create 1 rle with old method : 0.0016283988952636719 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.88750 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.96953 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 389 time to create 1 rle with old method : 0.0007336139678955078 length of segment : 22 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 160.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 51.24844 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.000370025634765625 nb_pixel_total : 26395 time to create 1 rle with old method : 0.03641009330749512 length of segment : 405 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.79375 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 8.96453857421875e-05 nb_pixel_total : 384 time to create 1 rle with old method : 0.0008182525634765625 length of segment : 32 time for calcul the mask position with numpy : 0.00011491775512695312 nb_pixel_total : 1330 time to create 1 rle with old method : 0.0027246475219726562 length of segment : 44 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 678 time to create 1 rle with old method : 0.0012226104736328125 length of segment : 40 time for calcul the mask position with numpy : 8.821487426757812e-05 nb_pixel_total : 623 time to create 1 rle with old method : 0.0011892318725585938 length of segment : 33 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 637 time to create 1 rle with old method : 0.0013282299041748047 length of segment : 29 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 429 time to create 1 rle with old method : 0.0008022785186767578 length of segment : 29 time for calcul the mask position with numpy : 0.00011396408081054688 nb_pixel_total : 1070 time to create 1 rle with old method : 0.0018625259399414062 length of segment : 68 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 232 time to create 1 rle with old method : 0.0005745887756347656 length of segment : 17 time for calcul the mask position with numpy : 0.0001163482666015625 nb_pixel_total : 1341 time to create 1 rle with old method : 0.002643108367919922 length of segment : 54 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.0005080699920654297 length of segment : 18 time for calcul the mask position with numpy : 0.00013303756713867188 nb_pixel_total : 1351 time to create 1 rle with old method : 0.0032846927642822266 length of segment : 56 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.0005698204040527344 length of segment : 18 time for calcul the mask position with numpy : 8.106231689453125e-05 nb_pixel_total : 397 time to create 1 rle with old method : 0.0009632110595703125 length of segment : 18 time for calcul the mask position with numpy : 8.034706115722656e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.0004811286926269531 length of segment : 27 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.48906 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 28 time for calcul the mask position with numpy : 0.0001811981201171875 nb_pixel_total : 946 time to create 1 rle with old method : 0.0018463134765625 length of segment : 40 time for calcul the mask position with numpy : 0.0001227855682373047 nb_pixel_total : 1467 time to create 1 rle with old method : 0.002877950668334961 length of segment : 56 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.00054931640625 length of segment : 22 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 691 time to create 1 rle with old method : 0.001375436782836914 length of segment : 41 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.0006473064422607422 length of segment : 17 time for calcul the mask position with numpy : 9.608268737792969e-05 nb_pixel_total : 947 time to create 1 rle with old method : 0.0020456314086914062 length of segment : 45 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 375 time to create 1 rle with old method : 0.0007405281066894531 length of segment : 23 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.0007123947143554688 length of segment : 21 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.0005815029144287109 length of segment : 18 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 1376 time to create 1 rle with old method : 0.0024864673614501953 length of segment : 48 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 887 time to create 1 rle with old method : 0.0016870498657226562 length of segment : 44 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 2086 time to create 1 rle with old method : 0.002597808837890625 length of segment : 70 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 2016 time to create 1 rle with old method : 0.0025620460510253906 length of segment : 51 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 2399 time to create 1 rle with old method : 0.002961874008178711 length of segment : 76 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 403 time to create 1 rle with old method : 0.0005414485931396484 length of segment : 25 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 364 time to create 1 rle with old method : 0.0004985332489013672 length of segment : 34 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 674 time to create 1 rle with old method : 0.0008385181427001953 length of segment : 26 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 1095 time to create 1 rle with old method : 0.0014297962188720703 length of segment : 37 time for calcul the mask position with numpy : 2.7894973754882812e-05 nb_pixel_total : 92 time to create 1 rle with old method : 0.00014472007751464844 length of segment : 19 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 364 time to create 1 rle with old method : 0.00057220458984375 length of segment : 15 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 520 time to create 1 rle with old method : 0.0007448196411132812 length of segment : 29 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 1051 time to create 1 rle with old method : 0.0013632774353027344 length of segment : 49 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.0003993511199951172 length of segment : 17 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 137 time to create 1 rle with old method : 0.00021266937255859375 length of segment : 16 time for calcul the mask position with numpy : 8.153915405273438e-05 nb_pixel_total : 2539 time to create 1 rle with old method : 0.003082275390625 length of segment : 71 time for calcul the mask position with numpy : 7.367134094238281e-05 nb_pixel_total : 822 time to create 1 rle with old method : 0.0011761188507080078 length of segment : 39 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 935 time to create 1 rle with old method : 0.0012254714965820312 length of segment : 50 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 1016 time to create 1 rle with old method : 0.0013322830200195312 length of segment : 37 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.44609 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 30 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 1092 time to create 1 rle with old method : 0.0015633106231689453 length of segment : 43 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 312 time to create 1 rle with old method : 0.0004603862762451172 length of segment : 33 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 354 time to create 1 rle with old method : 0.0004897117614746094 length of segment : 27 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 1097 time to create 1 rle with old method : 0.0014443397521972656 length of segment : 40 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 408 time to create 1 rle with old method : 0.0005495548248291016 length of segment : 34 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 825 time to create 1 rle with old method : 0.0010950565338134766 length of segment : 44 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.00033402442932128906 length of segment : 12 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 1219 time to create 1 rle with old method : 0.0015385150909423828 length of segment : 52 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 217 time to create 1 rle with old method : 0.0005457401275634766 length of segment : 20 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 378 time to create 1 rle with old method : 0.0005517005920410156 length of segment : 27 time for calcul the mask position with numpy : 9.584426879882812e-05 nb_pixel_total : 2163 time to create 1 rle with old method : 0.0029201507568359375 length of segment : 57 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 270 time to create 1 rle with old method : 0.0004119873046875 length of segment : 19 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 2043 time to create 1 rle with old method : 0.002655506134033203 length of segment : 70 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 2161 time to create 1 rle with old method : 0.002798795700073242 length of segment : 70 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 277 time to create 1 rle with old method : 0.00039505958557128906 length of segment : 29 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 401 time to create 1 rle with old method : 0.0005767345428466797 length of segment : 21 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.0003371238708496094 length of segment : 14 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 856 time to create 1 rle with old method : 0.0011093616485595703 length of segment : 39 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 1438 time to create 1 rle with old method : 0.001817464828491211 length of segment : 47 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 251 time to create 1 rle with old method : 0.00034880638122558594 length of segment : 45 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 177 time to create 1 rle with old method : 0.0004909038543701172 length of segment : 9 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 620 time to create 1 rle with old method : 0.0012514591217041016 length of segment : 29 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 818 time to create 1 rle with old method : 0.0016624927520751953 length of segment : 39 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 892 time to create 1 rle with old method : 0.0016925334930419922 length of segment : 37 time for calcul the mask position with numpy : 0.00010800361633300781 nb_pixel_total : 2121 time to create 1 rle with old method : 0.0039331912994384766 length of segment : 55 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 131 time to create 1 rle with old method : 0.00029087066650390625 length of segment : 40 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 94 time to create 1 rle with old method : 0.00022554397583007812 length of segment : 22 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 197 time to create 1 rle with old method : 0.0004668235778808594 length of segment : 16 time for calcul the mask position with numpy : 8.678436279296875e-05 nb_pixel_total : 1096 time to create 1 rle with old method : 0.0020933151245117188 length of segment : 89 time for calcul the mask position with numpy : 8.463859558105469e-05 nb_pixel_total : 1291 time to create 1 rle with old method : 0.002541780471801758 length of segment : 35 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.61016 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 41 time for calcul the mask position with numpy : 8.487701416015625e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.0005295276641845703 length of segment : 19 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.0004210472106933594 length of segment : 22 time for calcul the mask position with numpy : 9.274482727050781e-05 nb_pixel_total : 708 time to create 1 rle with old method : 0.0013301372528076172 length of segment : 23 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 233 time to create 1 rle with old method : 0.0005180835723876953 length of segment : 16 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 767 time to create 1 rle with old method : 0.0013685226440429688 length of segment : 39 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 1054 time to create 1 rle with old method : 0.0014383792877197266 length of segment : 37 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 265 time to create 1 rle with old method : 0.0004329681396484375 length of segment : 29 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 593 time to create 1 rle with old method : 0.0011882781982421875 length of segment : 38 time for calcul the mask position with numpy : 0.00015282630920410156 nb_pixel_total : 1252 time to create 1 rle with old method : 0.002187490463256836 length of segment : 73 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 1015 time to create 1 rle with old method : 0.0013651847839355469 length of segment : 44 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.0003783702850341797 length of segment : 15 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 321 time to create 1 rle with old method : 0.0004584789276123047 length of segment : 28 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 301 time to create 1 rle with old method : 0.0005142688751220703 length of segment : 18 time for calcul the mask position with numpy : 0.00010323524475097656 nb_pixel_total : 1926 time to create 1 rle with old method : 0.002689361572265625 length of segment : 51 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.00022673606872558594 length of segment : 11 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 1235 time to create 1 rle with old method : 0.0016734600067138672 length of segment : 35 time for calcul the mask position with numpy : 9.918212890625e-05 nb_pixel_total : 1951 time to create 1 rle with old method : 0.0032050609588623047 length of segment : 51 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 433 time to create 1 rle with old method : 0.0007386207580566406 length of segment : 23 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0006444454193115234 length of segment : 19 time for calcul the mask position with numpy : 7.534027099609375e-05 nb_pixel_total : 541 time to create 1 rle with old method : 0.0015404224395751953 length of segment : 36 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 466 time to create 1 rle with old method : 0.0007283687591552734 length of segment : 27 time for calcul the mask position with numpy : 0.00011944770812988281 nb_pixel_total : 1507 time to create 1 rle with old method : 0.004410982131958008 length of segment : 73 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 604 time to create 1 rle with old method : 0.0008704662322998047 length of segment : 32 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 461 time to create 1 rle with old method : 0.0007162094116210938 length of segment : 30 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 1347 time to create 1 rle with old method : 0.002432584762573242 length of segment : 55 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 93 time to create 1 rle with old method : 0.00016164779663085938 length of segment : 14 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 370 time to create 1 rle with old method : 0.0005116462707519531 length of segment : 53 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 973 time to create 1 rle with old method : 0.0012218952178955078 length of segment : 36 time for calcul the mask position with numpy : 9.131431579589844e-05 nb_pixel_total : 1907 time to create 1 rle with old method : 0.0030558109283447266 length of segment : 52 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 268 time to create 1 rle with old method : 0.0004086494445800781 length of segment : 24 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 569 time to create 1 rle with old method : 0.0007784366607666016 length of segment : 34 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 1355 time to create 1 rle with old method : 0.0018115043640136719 length of segment : 47 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 535 time to create 1 rle with old method : 0.0007953643798828125 length of segment : 23 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 373 time to create 1 rle with old method : 0.0006186962127685547 length of segment : 27 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 407 time to create 1 rle with old method : 0.0006110668182373047 length of segment : 29 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 330 time to create 1 rle with old method : 0.0005776882171630859 length of segment : 45 time for calcul the mask position with numpy : 0.0001125335693359375 nb_pixel_total : 541 time to create 1 rle with old method : 0.0009355545043945312 length of segment : 22 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 427 time to create 1 rle with old method : 0.00058746337890625 length of segment : 28 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 1289 time to create 1 rle with old method : 0.0016391277313232422 length of segment : 55 time for calcul the mask position with numpy : 8.177757263183594e-05 nb_pixel_total : 625 time to create 1 rle with old method : 0.0009784698486328125 length of segment : 57 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 359 time to create 1 rle with old method : 0.0004940032958984375 length of segment : 26 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.16484 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 20 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 269 time to create 1 rle with old method : 0.0004851818084716797 length of segment : 15 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 970 time to create 1 rle with old method : 0.001249074935913086 length of segment : 60 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 446 time to create 1 rle with old method : 0.0006692409515380859 length of segment : 25 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 790 time to create 1 rle with old method : 0.001237630844116211 length of segment : 23 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 260 time to create 1 rle with old method : 0.0005958080291748047 length of segment : 12 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 285 time to create 1 rle with old method : 0.00060272216796875 length of segment : 24 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 473 time to create 1 rle with old method : 0.0009202957153320312 length of segment : 27 time for calcul the mask position with numpy : 8.606910705566406e-05 nb_pixel_total : 617 time to create 1 rle with old method : 0.0010521411895751953 length of segment : 46 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 225 time to create 1 rle with old method : 0.00035452842712402344 length of segment : 15 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 517 time to create 1 rle with old method : 0.0006916522979736328 length of segment : 21 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 1078 time to create 1 rle with old method : 0.0013887882232666016 length of segment : 46 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 1153 time to create 1 rle with old method : 0.001834869384765625 length of segment : 53 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 403 time to create 1 rle with old method : 0.0006265640258789062 length of segment : 35 time for calcul the mask position with numpy : 0.00013256072998046875 nb_pixel_total : 4006 time to create 1 rle with old method : 0.005373477935791016 length of segment : 71 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 376 time to create 1 rle with old method : 0.0005605220794677734 length of segment : 50 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 157 time to create 1 rle with old method : 0.0002224445343017578 length of segment : 21 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 1012 time to create 1 rle with old method : 0.0013000965118408203 length of segment : 37 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 126 time to create 1 rle with old method : 0.00022792816162109375 length of segment : 9 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 1075 time to create 1 rle with old method : 0.0014033317565917969 length of segment : 40 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 507 time to create 1 rle with old method : 0.0010230541229248047 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.32109 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 8.559226989746094e-05 nb_pixel_total : 1324 time to create 1 rle with old method : 0.0019614696502685547 length of segment : 35 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.00033593177795410156 length of segment : 21 time for calcul the mask position with numpy : 9.274482727050781e-05 nb_pixel_total : 1754 time to create 1 rle with old method : 0.0031538009643554688 length of segment : 61 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.0002288818359375 length of segment : 8 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 259 time to create 1 rle with old method : 0.00042366981506347656 length of segment : 17 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 297 time to create 1 rle with old method : 0.0004246234893798828 length of segment : 34 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 485 time to create 1 rle with old method : 0.0007381439208984375 length of segment : 31 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 1098 time to create 1 rle with old method : 0.0015251636505126953 length of segment : 45 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 654 time to create 1 rle with old method : 0.0008723735809326172 length of segment : 42 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 155 time to create 1 rle with old method : 0.00028634071350097656 length of segment : 15 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.000362396240234375 length of segment : 17 time for calcul the mask position with numpy : 8.869171142578125e-05 nb_pixel_total : 1876 time to create 1 rle with old method : 0.0023488998413085938 length of segment : 67 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.71719 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 1347 time to create 1 rle with old method : 0.002057790756225586 length of segment : 87 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 321 time to create 1 rle with old method : 0.0004475116729736328 length of segment : 23 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 773 time to create 1 rle with old method : 0.0009927749633789062 length of segment : 59 time for calcul the mask position with numpy : 0.00011467933654785156 nb_pixel_total : 1474 time to create 1 rle with old method : 0.0021359920501708984 length of segment : 90 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 328 time to create 1 rle with old method : 0.0004756450653076172 length of segment : 22 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.21172 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 292 time to create 1 rle with old method : 0.0004985332489013672 length of segment : 22 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.0003952980041503906 length of segment : 14 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 877 time to create 1 rle with old method : 0.0014622211456298828 length of segment : 32 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.00047850608825683594 length of segment : 17 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 157 time to create 1 rle with old method : 0.00029540061950683594 length of segment : 13 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 565 time to create 1 rle with old method : 0.0007388591766357422 length of segment : 30 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 263 time to create 1 rle with old method : 0.00039076805114746094 length of segment : 29 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 284 time to create 1 rle with old method : 0.0004017353057861328 length of segment : 23 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 552 time to create 1 rle with old method : 0.0007379055023193359 length of segment : 31 Processing 1 images image shape: (400, 400, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.56328 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 21 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 357 time to create 1 rle with old method : 0.0004992485046386719 length of segment : 21 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 392 time to create 1 rle with old method : 0.0005645751953125 length of segment : 27 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 829 time to create 1 rle with old method : 0.0011203289031982422 length of segment : 34 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 228 time to create 1 rle with old method : 0.0003161430358886719 length of segment : 25 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003707408905029297 length of segment : 12 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 504 time to create 1 rle with old method : 0.0006542205810546875 length of segment : 34 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 408 time to create 1 rle with old method : 0.0005695819854736328 length of segment : 32 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 387 time to create 1 rle with old method : 0.0004966259002685547 length of segment : 24 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 570 time to create 1 rle with old method : 0.0007374286651611328 length of segment : 28 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 321 time to create 1 rle with old method : 0.00045490264892578125 length of segment : 23 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 276 time to create 1 rle with old method : 0.0004322528839111328 length of segment : 18 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 1502 time to create 1 rle with old method : 0.0018651485443115234 length of segment : 49 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 1918 time to create 1 rle with old method : 0.0025436878204345703 length of segment : 51 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 468 time to create 1 rle with old method : 0.0006628036499023438 length of segment : 54 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 511 time to create 1 rle with old method : 0.0007045269012451172 length of segment : 65 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 798 time to create 1 rle with old method : 0.0012621879577636719 length of segment : 30 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 1048 time to create 1 rle with old method : 0.001285552978515625 length of segment : 43 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 185 time to create 1 rle with old method : 0.00027942657470703125 length of segment : 15 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 712 time to create 1 rle with old method : 0.001203775405883789 length of segment : 40 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 543 time to create 1 rle with old method : 0.0007448196411132812 length of segment : 18 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 618 time to create 1 rle with old method : 0.0007758140563964844 length of segment : 27 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.51641 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 22 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 342 time to create 1 rle with old method : 0.0005090236663818359 length of segment : 28 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 240 time to create 1 rle with old method : 0.00038433074951171875 length of segment : 18 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 1126 time to create 1 rle with old method : 0.001459360122680664 length of segment : 31 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 376 time to create 1 rle with old method : 0.0005853176116943359 length of segment : 16 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0005426406860351562 length of segment : 39 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 535 time to create 1 rle with old method : 0.0007586479187011719 length of segment : 30 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 209 time to create 1 rle with old method : 0.0003383159637451172 length of segment : 18 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 184 time to create 1 rle with old method : 0.0003113746643066406 length of segment : 31 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 1111 time to create 1 rle with old method : 0.001462697982788086 length of segment : 39 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 1245 time to create 1 rle with old method : 0.0017447471618652344 length of segment : 40 time for calcul the mask position with numpy : 8.296966552734375e-05 nb_pixel_total : 1843 time to create 1 rle with old method : 0.002399444580078125 length of segment : 94 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 702 time to create 1 rle with old method : 0.001041412353515625 length of segment : 52 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.0002682209014892578 length of segment : 16 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.0004611015319824219 length of segment : 45 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 422 time to create 1 rle with old method : 0.0006303787231445312 length of segment : 36 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 168 time to create 1 rle with old method : 0.0002925395965576172 length of segment : 10 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 264 time to create 1 rle with old method : 0.00042319297790527344 length of segment : 22 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 407 time to create 1 rle with old method : 0.0006411075592041016 length of segment : 19 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 1100 time to create 1 rle with old method : 0.0015444755554199219 length of segment : 35 time for calcul the mask position with numpy : 9.703636169433594e-05 nb_pixel_total : 1701 time to create 1 rle with old method : 0.002337932586669922 length of segment : 54 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 656 time to create 1 rle with old method : 0.0009205341339111328 length of segment : 31 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 1197 time to create 1 rle with old method : 0.0016894340515136719 length of segment : 33 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.37969 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 36 time for calcul the mask position with numpy : 9.870529174804688e-05 nb_pixel_total : 1669 time to create 1 rle with old method : 0.002635478973388672 length of segment : 48 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 902 time to create 1 rle with old method : 0.0014493465423583984 length of segment : 47 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 299 time to create 1 rle with old method : 0.0004336833953857422 length of segment : 35 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 2875 time to create 1 rle with old method : 0.0038149356842041016 length of segment : 57 time for calcul the mask position with numpy : 0.00022983551025390625 nb_pixel_total : 7703 time to create 1 rle with old method : 0.009311199188232422 length of segment : 216 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 800 time to create 1 rle with old method : 0.0010945796966552734 length of segment : 31 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 1021 time to create 1 rle with old method : 0.0012989044189453125 length of segment : 48 time for calcul the mask position with numpy : 0.00010371208190917969 nb_pixel_total : 3021 time to create 1 rle with old method : 0.0036890506744384766 length of segment : 93 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 1372 time to create 1 rle with old method : 0.0017650127410888672 length of segment : 28 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 1852 time to create 1 rle with old method : 0.002453327178955078 length of segment : 46 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 470 time to create 1 rle with old method : 0.0006437301635742188 length of segment : 30 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 911 time to create 1 rle with old method : 0.0012028217315673828 length of segment : 35 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 673 time to create 1 rle with old method : 0.00101470947265625 length of segment : 32 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 703 time to create 1 rle with old method : 0.0009906291961669922 length of segment : 35 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 1586 time to create 1 rle with old method : 0.0020551681518554688 length of segment : 45 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 575 time to create 1 rle with old method : 0.0008132457733154297 length of segment : 42 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 180 time to create 1 rle with old method : 0.00029397010803222656 length of segment : 18 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 1076 time to create 1 rle with old method : 0.0014350414276123047 length of segment : 35 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 1188 time to create 1 rle with old method : 0.0015404224395751953 length of segment : 35 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 491 time to create 1 rle with old method : 0.0007045269012451172 length of segment : 18 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 844 time to create 1 rle with old method : 0.0011889934539794922 length of segment : 34 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 1008 time to create 1 rle with old method : 0.0012691020965576172 length of segment : 76 time for calcul the mask position with numpy : 7.343292236328125e-05 nb_pixel_total : 1652 time to create 1 rle with old method : 0.0021381378173828125 length of segment : 54 time for calcul the mask position with numpy : 9.465217590332031e-05 nb_pixel_total : 2171 time to create 1 rle with old method : 0.0028595924377441406 length of segment : 48 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 1102 time to create 1 rle with old method : 0.0014200210571289062 length of segment : 34 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 1043 time to create 1 rle with old method : 0.0014510154724121094 length of segment : 37 time for calcul the mask position with numpy : 0.00013875961303710938 nb_pixel_total : 4685 time to create 1 rle with old method : 0.005720853805541992 length of segment : 114 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 170 time to create 1 rle with old method : 0.00026345252990722656 length of segment : 17 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 160 time to create 1 rle with old method : 0.0002913475036621094 length of segment : 16 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 837 time to create 1 rle with old method : 0.0010535717010498047 length of segment : 31 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 1323 time to create 1 rle with old method : 0.0018415451049804688 length of segment : 39 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 424 time to create 1 rle with old method : 0.0006012916564941406 length of segment : 27 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 1251 time to create 1 rle with old method : 0.0016908645629882812 length of segment : 27 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 765 time to create 1 rle with old method : 0.0010068416595458984 length of segment : 26 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 387 time to create 1 rle with old method : 0.0005257129669189453 length of segment : 28 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 428 time to create 1 rle with old method : 0.0005645751953125 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.66094 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 605 time to create 1 rle with old method : 0.001131296157836914 length of segment : 25 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 340 time to create 1 rle with old method : 0.0007014274597167969 length of segment : 20 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 798 time to create 1 rle with old method : 0.0015697479248046875 length of segment : 43 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 400 time to create 1 rle with old method : 0.0007789134979248047 length of segment : 23 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 218 time to create 1 rle with old method : 0.0004985332489013672 length of segment : 19 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 810 time to create 1 rle with old method : 0.001016378402709961 length of segment : 62 time for calcul the mask position with numpy : 8.487701416015625e-05 nb_pixel_total : 1018 time to create 1 rle with old method : 0.001386880874633789 length of segment : 113 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 930 time to create 1 rle with old method : 0.0012021064758300781 length of segment : 54 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 151 time to create 1 rle with old method : 0.0002446174621582031 length of segment : 16 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 465 time to create 1 rle with old method : 0.0006768703460693359 length of segment : 39 time for calcul the mask position with numpy : 8.678436279296875e-05 nb_pixel_total : 1576 time to create 1 rle with old method : 0.002015352249145508 length of segment : 69 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 434 time to create 1 rle with old method : 0.0006244182586669922 length of segment : 49 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 791 time to create 1 rle with old method : 0.001077890396118164 length of segment : 44 time for calcul the mask position with numpy : 9.441375732421875e-05 nb_pixel_total : 940 time to create 1 rle with old method : 0.0017120838165283203 length of segment : 53 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 312 time to create 1 rle with old method : 0.000637054443359375 length of segment : 16 time for calcul the mask position with numpy : 9.751319885253906e-05 nb_pixel_total : 1573 time to create 1 rle with old method : 0.0027277469635009766 length of segment : 68 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 585 time to create 1 rle with old method : 0.0010609626770019531 length of segment : 26 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.63359 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 1262 time to create 1 rle with old method : 0.001760721206665039 length of segment : 64 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 1760 time to create 1 rle with old method : 0.0024275779724121094 length of segment : 48 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 84 time to create 1 rle with old method : 0.00023698806762695312 length of segment : 24 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 1003 time to create 1 rle with old method : 0.0013344287872314453 length of segment : 48 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 1381 time to create 1 rle with old method : 0.0017282962799072266 length of segment : 51 time for calcul the mask position with numpy : 8.153915405273438e-05 nb_pixel_total : 3394 time to create 1 rle with old method : 0.005576610565185547 length of segment : 82 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 1389 time to create 1 rle with old method : 0.0023679733276367188 length of segment : 51 time for calcul the mask position with numpy : 8.654594421386719e-05 nb_pixel_total : 2495 time to create 1 rle with old method : 0.00429224967956543 length of segment : 47 time for calcul the mask position with numpy : 9.441375732421875e-05 nb_pixel_total : 1319 time to create 1 rle with old method : 0.0023322105407714844 length of segment : 66 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 818 time to create 1 rle with old method : 0.0014808177947998047 length of segment : 25 time for calcul the mask position with numpy : 7.367134094238281e-05 nb_pixel_total : 1325 time to create 1 rle with old method : 0.0023195743560791016 length of segment : 41 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 1262 time to create 1 rle with old method : 0.0021772384643554688 length of segment : 45 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 178.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 65.11172 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.26797 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 607 time to create 1 rle with old method : 0.000988006591796875 length of segment : 15 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 161 time to create 1 rle with old method : 0.0002608299255371094 length of segment : 14 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 771 time to create 1 rle with old method : 0.0010156631469726562 length of segment : 28 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 2383 time to create 1 rle with old method : 0.003065347671508789 length of segment : 70 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 423 time to create 1 rle with old method : 0.000583648681640625 length of segment : 22 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.0003070831298828125 length of segment : 16 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 361 time to create 1 rle with old method : 0.0005545616149902344 length of segment : 18 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 76 time to create 1 rle with old method : 0.00013709068298339844 length of segment : 10 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 356 time to create 1 rle with old method : 0.00049591064453125 length of segment : 22 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 1252 time to create 1 rle with old method : 0.0016412734985351562 length of segment : 60 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 282 time to create 1 rle with old method : 0.00041556358337402344 length of segment : 19 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 1786 time to create 1 rle with old method : 0.002312898635864258 length of segment : 40 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 85 time to create 1 rle with old method : 0.00018072128295898438 length of segment : 6 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 110 time to create 1 rle with old method : 0.00018930435180664062 length of segment : 11 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.00038814544677734375 length of segment : 20 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.0002512931823730469 length of segment : 12 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.00018906593322753906 length of segment : 12 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 135 time to create 1 rle with old method : 0.00021529197692871094 length of segment : 13 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 357 time to create 1 rle with old method : 0.0005214214324951172 length of segment : 19 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 408 time to create 1 rle with old method : 0.0005445480346679688 length of segment : 29 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 761 time to create 1 rle with old method : 0.0010218620300292969 length of segment : 49 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 330 time to create 1 rle with old method : 0.0007660388946533203 length of segment : 19 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 71 time to create 1 rle with old method : 0.00012922286987304688 length of segment : 9 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 642 time to create 1 rle with old method : 0.0007936954498291016 length of segment : 41 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 116 time to create 1 rle with old method : 0.0002117156982421875 length of segment : 11 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002942085266113281 length of segment : 23 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 344 time to create 1 rle with old method : 0.0005123615264892578 length of segment : 21 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 24 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.000400543212890625 length of segment : 23 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 933 time to create 1 rle with old method : 0.0012812614440917969 length of segment : 42 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 352 time to create 1 rle with old method : 0.0005106925964355469 length of segment : 14 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.00037980079650878906 length of segment : 10 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 1468 time to create 1 rle with old method : 0.0017900466918945312 length of segment : 57 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 471 time to create 1 rle with old method : 0.0006654262542724609 length of segment : 34 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 236 time to create 1 rle with old method : 0.0003447532653808594 length of segment : 22 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 343 time to create 1 rle with old method : 0.00046515464782714844 length of segment : 23 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 1443 time to create 1 rle with old method : 0.0018832683563232422 length of segment : 60 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.00026226043701171875 length of segment : 21 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 737 time to create 1 rle with old method : 0.0010037422180175781 length of segment : 43 time for calcul the mask position with numpy : 9.322166442871094e-05 nb_pixel_total : 1657 time to create 1 rle with old method : 0.0031883716583251953 length of segment : 47 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 313 time to create 1 rle with old method : 0.0004572868347167969 length of segment : 22 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 240 time to create 1 rle with old method : 0.0003707408905029297 length of segment : 22 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 178 time to create 1 rle with old method : 0.0002899169921875 length of segment : 23 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 97 time to create 1 rle with old method : 0.00016355514526367188 length of segment : 10 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.0002033710479736328 length of segment : 15 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 241 time to create 1 rle with old method : 0.0003466606140136719 length of segment : 22 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 389 time to create 1 rle with old method : 0.0005581378936767578 length of segment : 21 time for calcul the mask position with numpy : 9.822845458984375e-05 nb_pixel_total : 1418 time to create 1 rle with old method : 0.0025556087493896484 length of segment : 53 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.0003452301025390625 length of segment : 19 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 331 time to create 1 rle with old method : 0.0004515647888183594 length of segment : 21 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 496 time to create 1 rle with old method : 0.0007503032684326172 length of segment : 29 time for calcul the mask position with numpy : 0.00014901161193847656 nb_pixel_total : 6203 time to create 1 rle with old method : 0.007551670074462891 length of segment : 154 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.00038695335388183594 length of segment : 18 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 270 time to create 1 rle with old method : 0.0003819465637207031 length of segment : 17 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.00019621849060058594 length of segment : 11 time for calcul the mask position with numpy : 0.00010538101196289062 nb_pixel_total : 6405 time to create 1 rle with old method : 0.007433176040649414 length of segment : 66 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 591 time to create 1 rle with old method : 0.0008518695831298828 length of segment : 22 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 122 time to create 1 rle with old method : 0.0001900196075439453 length of segment : 16 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 124 time to create 1 rle with old method : 0.00018858909606933594 length of segment : 16 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 880 time to create 1 rle with old method : 0.001171112060546875 length of segment : 28 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.10781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 2077 time to create 1 rle with old method : 0.0036857128143310547 length of segment : 51 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.0003674030303955078 length of segment : 13 time for calcul the mask position with numpy : 0.00043082237243652344 nb_pixel_total : 31568 time to create 1 rle with old method : 0.05140948295593262 length of segment : 165 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 384 time to create 1 rle with old method : 0.0005693435668945312 length of segment : 21 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 193 time to create 1 rle with old method : 0.0003256797790527344 length of segment : 12 Processing 1 images image shape: (240, 160, 3) min: 0.00000 max: 217.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 103.87496 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 105 time to create 1 rle with old method : 0.00023508071899414062 length of segment : 15 Detection mask done ! Trying to reset tf kernel 1556099 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 26 tf kernel not reseted sub process len(results) : 366 len(list_Values) 366 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 366 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5315 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 366 chid ids of type : 4228 Number RLEs to save : 13867 save missing photos in datou_result : time spend for datou_step_exec : 24.607237577438354 time spend to save output : 2.1648693084716797 total time spend for step 1 : 26.772106885910034 step2:brightness Tue Feb 11 07:20:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1739254828_1555482_1336717164_391c27e1b7f5c4116a1b84fa910930ad.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 1 time used for this insertion : 0.011130332946777344 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 1 time used for this insertion : 0.1532289981842041 save missing photos in datou_result : time spend for datou_step_exec : 0.5483267307281494 time spend to save output : 0.16878509521484375 total time spend for step 2 : 0.7171118259429932 step3:blur_detection Tue Feb 11 07:20:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1739254828_1555482_1336717164_391c27e1b7f5c4116a1b84fa910930ad.jpg resize: (1440, 2560) 1336717164 -8.205989268505697 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 1 time used for this insertion : 0.014461517333984375 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 1 time used for this insertion : 0.01848149299621582 save missing photos in datou_result : time spend for datou_step_exec : 1.9230072498321533 time spend to save output : 0.03797006607055664 total time spend for step 3 : 1.96097731590271 step4:rle_unique_nms_with_priority Tue Feb 11 07:20:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 366 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 362 nb_hashtags : 7 time to prepare the origin masks : 1.9243476390838623 time for calcul the mask position with numpy : 0.28533077239990234 nb_pixel_total : 3351009 time to create 1 rle with new method : 1.2015681266784668 time for calcul the mask position with numpy : 0.015636205673217773 nb_pixel_total : 26395 time to create 1 rle with old method : 0.028788089752197266 time for calcul the mask position with numpy : 0.014509916305541992 nb_pixel_total : 8180 time to create 1 rle with old method : 0.009595155715942383 time for calcul the mask position with numpy : 0.014470577239990234 nb_pixel_total : 9612 time to create 1 rle with old method : 0.010403633117675781 time for calcul the mask position with numpy : 0.015002250671386719 nb_pixel_total : 389 time to create 1 rle with old method : 0.0004456043243408203 time for calcul the mask position with numpy : 0.015656471252441406 nb_pixel_total : 358 time to create 1 rle with old method : 0.0004315376281738281 time for calcul the mask position with numpy : 0.014562606811523438 nb_pixel_total : 20 time to create 1 rle with old method : 3.886222839355469e-05 time for calcul the mask position with numpy : 0.015091896057128906 nb_pixel_total : 1311 time to create 1 rle with old method : 0.0015518665313720703 time for calcul the mask position with numpy : 0.015344381332397461 nb_pixel_total : 30 time to create 1 rle with old method : 8.893013000488281e-05 time for calcul the mask position with numpy : 0.015244007110595703 nb_pixel_total : 1041 time to create 1 rle with old method : 0.0011782646179199219 time for calcul the mask position with numpy : 0.014951705932617188 nb_pixel_total : 474 time to create 1 rle with old method : 0.0005767345428466797 time for calcul the mask position with numpy : 0.015375375747680664 nb_pixel_total : 5843 time to create 1 rle with old method : 0.006455421447753906 time for calcul the mask position with numpy : 0.014781713485717773 nb_pixel_total : 11819 time to create 1 rle with old method : 0.012575626373291016 time for calcul the mask position with numpy : 0.015251636505126953 nb_pixel_total : 305 time to create 1 rle with old method : 0.0003428459167480469 time for calcul the mask position with numpy : 0.015050649642944336 nb_pixel_total : 235 time to create 1 rle with old method : 0.0002834796905517578 time for calcul the mask position with numpy : 0.015286445617675781 nb_pixel_total : 727 time to create 1 rle with old method : 0.00086212158203125 time for calcul the mask position with numpy : 0.014941215515136719 nb_pixel_total : 1850 time to create 1 rle with old method : 0.0020258426666259766 time for calcul the mask position with numpy : 0.01556849479675293 nb_pixel_total : 614 time to create 1 rle with old method : 0.0037949085235595703 time for calcul the mask position with numpy : 0.017892122268676758 nb_pixel_total : 685 time to create 1 rle with old method : 0.0008420944213867188 time for calcul the mask position with numpy : 0.01567864418029785 nb_pixel_total : 269 time to create 1 rle with old method : 0.0003807544708251953 time for calcul the mask position with numpy : 0.0155792236328125 nb_pixel_total : 336 time to create 1 rle with old method : 0.000415802001953125 time for calcul the mask position with numpy : 0.01600193977355957 nb_pixel_total : 340 time to create 1 rle with old method : 0.00044655799865722656 time for calcul the mask position with numpy : 0.01572585105895996 nb_pixel_total : 667 time to create 1 rle with old method : 0.0008211135864257812 time for calcul the mask position with numpy : 0.015488386154174805 nb_pixel_total : 630 time to create 1 rle with old method : 0.0007643699645996094 time for calcul the mask position with numpy : 0.015931367874145508 nb_pixel_total : 1 time to create 1 rle with old method : 2.7179718017578125e-05 time for calcul the mask position with numpy : 0.017698287963867188 nb_pixel_total : 546 time to create 1 rle with old method : 0.0010118484497070312 time for calcul the mask position with numpy : 0.02087545394897461 nb_pixel_total : 171 time to create 1 rle with old method : 0.00022125244140625 time for calcul the mask position with numpy : 0.01574087142944336 nb_pixel_total : 331 time to create 1 rle with old method : 0.0010528564453125 time for calcul the mask position with numpy : 0.016371965408325195 nb_pixel_total : 276 time to create 1 rle with old method : 0.0003573894500732422 time for calcul the mask position with numpy : 0.015182971954345703 nb_pixel_total : 125 time to create 1 rle with old method : 0.00016736984252929688 time for calcul the mask position with numpy : 0.01509237289428711 nb_pixel_total : 436 time to create 1 rle with old method : 0.00054168701171875 time for calcul the mask position with numpy : 0.015014410018920898 nb_pixel_total : 6 time to create 1 rle with old method : 3.1948089599609375e-05 time for calcul the mask position with numpy : 0.015475273132324219 nb_pixel_total : 31 time to create 1 rle with old method : 8.082389831542969e-05 time for calcul the mask position with numpy : 0.015509605407714844 nb_pixel_total : 705 time to create 1 rle with old method : 0.0008704662322998047 time for calcul the mask position with numpy : 0.014883279800415039 nb_pixel_total : 254 time to create 1 rle with old method : 0.00031256675720214844 time for calcul the mask position with numpy : 0.014818429946899414 nb_pixel_total : 354 time to create 1 rle with old method : 0.00043487548828125 time for calcul the mask position with numpy : 0.01506495475769043 nb_pixel_total : 269 time to create 1 rle with old method : 0.00035834312438964844 time for calcul the mask position with numpy : 0.015503406524658203 nb_pixel_total : 157 time to create 1 rle with old method : 0.0002129077911376953 time for calcul the mask position with numpy : 0.01519155502319336 nb_pixel_total : 34 time to create 1 rle with old method : 8.749961853027344e-05 time for calcul the mask position with numpy : 0.015069723129272461 nb_pixel_total : 1341 time to create 1 rle with old method : 0.0016634464263916016 time for calcul the mask position with numpy : 0.015528202056884766 nb_pixel_total : 155 time to create 1 rle with old method : 0.00021314620971679688 time for calcul the mask position with numpy : 0.01515960693359375 nb_pixel_total : 22 time to create 1 rle with old method : 7.271766662597656e-05 time for calcul the mask position with numpy : 0.015252113342285156 nb_pixel_total : 593 time to create 1 rle with old method : 0.0007357597351074219 time for calcul the mask position with numpy : 0.015227794647216797 nb_pixel_total : 38 time to create 1 rle with old method : 0.00015497207641601562 time for calcul the mask position with numpy : 0.016225814819335938 nb_pixel_total : 373 time to create 1 rle with old method : 0.0005452632904052734 time for calcul the mask position with numpy : 0.023065805435180664 nb_pixel_total : 403 time to create 1 rle with old method : 0.0009551048278808594 time for calcul the mask position with numpy : 0.027919530868530273 nb_pixel_total : 137 time to create 1 rle with old method : 0.0001900196075439453 time for calcul the mask position with numpy : 0.015144824981689453 nb_pixel_total : 136 time to create 1 rle with old method : 0.00021123886108398438 time for calcul the mask position with numpy : 0.015460968017578125 nb_pixel_total : 211 time to create 1 rle with old method : 0.0002677440643310547 time for calcul the mask position with numpy : 0.015305519104003906 nb_pixel_total : 255 time to create 1 rle with old method : 0.00033664703369140625 time for calcul the mask position with numpy : 0.015363931655883789 nb_pixel_total : 520 time to create 1 rle with old method : 0.0005981922149658203 time for calcul the mask position with numpy : 0.015323400497436523 nb_pixel_total : 113 time to create 1 rle with old method : 0.0001556873321533203 time for calcul the mask position with numpy : 0.015285253524780273 nb_pixel_total : 1097 time to create 1 rle with old method : 0.001230478286743164 time for calcul the mask position with numpy : 0.015435934066772461 nb_pixel_total : 604 time to create 1 rle with old method : 0.0007386207580566406 time for calcul the mask position with numpy : 0.015420675277709961 nb_pixel_total : 238 time to create 1 rle with old method : 0.0003097057342529297 time for calcul the mask position with numpy : 0.01543426513671875 nb_pixel_total : 257 time to create 1 rle with old method : 0.0003247261047363281 time for calcul the mask position with numpy : 0.015497684478759766 nb_pixel_total : 378 time to create 1 rle with old method : 0.000492095947265625 time for calcul the mask position with numpy : 0.015429496765136719 nb_pixel_total : 197 time to create 1 rle with old method : 0.0002524852752685547 time for calcul the mask position with numpy : 0.015291452407836914 nb_pixel_total : 225 time to create 1 rle with old method : 0.0002791881561279297 time for calcul the mask position with numpy : 0.015014171600341797 nb_pixel_total : 211 time to create 1 rle with old method : 0.00026345252990722656 time for calcul the mask position with numpy : 0.01504063606262207 nb_pixel_total : 708 time to create 1 rle with old method : 0.0008447170257568359 time for calcul the mask position with numpy : 0.014927387237548828 nb_pixel_total : 321 time to create 1 rle with old method : 0.000385284423828125 time for calcul the mask position with numpy : 0.014969587326049805 nb_pixel_total : 822 time to create 1 rle with old method : 0.0010311603546142578 time for calcul the mask position with numpy : 0.015322685241699219 nb_pixel_total : 446 time to create 1 rle with old method : 0.0005497932434082031 time for calcul the mask position with numpy : 0.015038013458251953 nb_pixel_total : 645 time to create 1 rle with old method : 0.0007746219635009766 time for calcul the mask position with numpy : 0.01500391960144043 nb_pixel_total : 1484 time to create 1 rle with old method : 0.0017333030700683594 time for calcul the mask position with numpy : 0.015063285827636719 nb_pixel_total : 433 time to create 1 rle with old method : 0.0005164146423339844 time for calcul the mask position with numpy : 0.015130281448364258 nb_pixel_total : 401 time to create 1 rle with old method : 0.00047898292541503906 time for calcul the mask position with numpy : 0.015099287033081055 nb_pixel_total : 268 time to create 1 rle with old method : 0.000324249267578125 time for calcul the mask position with numpy : 0.015093326568603516 nb_pixel_total : 825 time to create 1 rle with old method : 0.0009322166442871094 time for calcul the mask position with numpy : 0.01515817642211914 nb_pixel_total : 767 time to create 1 rle with old method : 0.0009174346923828125 time for calcul the mask position with numpy : 0.015050649642944336 nb_pixel_total : 134 time to create 1 rle with old method : 0.0001773834228515625 time for calcul the mask position with numpy : 0.014971733093261719 nb_pixel_total : 217 time to create 1 rle with old method : 0.0002751350402832031 time for calcul the mask position with numpy : 0.014972686767578125 nb_pixel_total : 7 time to create 1 rle with old method : 4.482269287109375e-05 time for calcul the mask position with numpy : 0.014982938766479492 nb_pixel_total : 118 time to create 1 rle with old method : 0.00014925003051757812 time for calcul the mask position with numpy : 0.01498270034790039 nb_pixel_total : 1095 time to create 1 rle with old method : 0.0012836456298828125 time for calcul the mask position with numpy : 0.015028715133666992 nb_pixel_total : 301 time to create 1 rle with old method : 0.0003681182861328125 time for calcul the mask position with numpy : 0.015166282653808594 nb_pixel_total : 126 time to create 1 rle with old method : 0.0001704692840576172 time for calcul the mask position with numpy : 0.015276670455932617 nb_pixel_total : 1347 time to create 1 rle with old method : 0.0016283988952636719 time for calcul the mask position with numpy : 0.015160083770751953 nb_pixel_total : 10 time to create 1 rle with old method : 8.463859558105469e-05 time for calcul the mask position with numpy : 0.015144824981689453 nb_pixel_total : 376 time to create 1 rle with old method : 0.0004820823669433594 time for calcul the mask position with numpy : 0.01590728759765625 nb_pixel_total : 285 time to create 1 rle with old method : 0.0003857612609863281 time for calcul the mask position with numpy : 0.015331506729125977 nb_pixel_total : 1153 time to create 1 rle with old method : 0.0014107227325439453 time for calcul the mask position with numpy : 0.015426397323608398 nb_pixel_total : 856 time to create 1 rle with old method : 0.001046895980834961 time for calcul the mask position with numpy : 0.015377044677734375 nb_pixel_total : 1015 time to create 1 rle with old method : 0.0012013912200927734 time for calcul the mask position with numpy : 0.015370607376098633 nb_pixel_total : 1467 time to create 1 rle with old method : 0.001745462417602539 time for calcul the mask position with numpy : 0.015552043914794922 nb_pixel_total : 408 time to create 1 rle with old method : 0.0005083084106445312 time for calcul the mask position with numpy : 0.01615142822265625 nb_pixel_total : 201 time to create 1 rle with old method : 0.00025534629821777344 time for calcul the mask position with numpy : 0.016376018524169922 nb_pixel_total : 1098 time to create 1 rle with old method : 0.0013759136199951172 time for calcul the mask position with numpy : 0.016212940216064453 nb_pixel_total : 637 time to create 1 rle with old method : 0.0008482933044433594 time for calcul the mask position with numpy : 0.016132354736328125 nb_pixel_total : 3 time to create 1 rle with old method : 3.314018249511719e-05 time for calcul the mask position with numpy : 0.016243696212768555 nb_pixel_total : 15 time to create 1 rle with old method : 7.319450378417969e-05 time for calcul the mask position with numpy : 0.016552448272705078 nb_pixel_total : 541 time to create 1 rle with old method : 0.0008504390716552734 time for calcul the mask position with numpy : 0.01720881462097168 nb_pixel_total : 617 time to create 1 rle with old method : 0.0008606910705566406 time for calcul the mask position with numpy : 0.017403602600097656 nb_pixel_total : 94 time to create 1 rle with old method : 0.0001647472381591797 time for calcul the mask position with numpy : 0.017096996307373047 nb_pixel_total : 403 time to create 1 rle with old method : 0.0006382465362548828 time for calcul the mask position with numpy : 0.017550230026245117 nb_pixel_total : 270 time to create 1 rle with old method : 0.0003561973571777344 time for calcul the mask position with numpy : 0.016587257385253906 nb_pixel_total : 1324 time to create 1 rle with old method : 0.0016446113586425781 time for calcul the mask position with numpy : 0.01651620864868164 nb_pixel_total : 773 time to create 1 rle with old method : 0.001024007797241211 time for calcul the mask position with numpy : 0.015887737274169922 nb_pixel_total : 1051 time to create 1 rle with old method : 0.0013501644134521484 time for calcul the mask position with numpy : 0.0160369873046875 nb_pixel_total : 1926 time to create 1 rle with old method : 0.002374887466430664 time for calcul the mask position with numpy : 0.01599264144897461 nb_pixel_total : 364 time to create 1 rle with old method : 0.00046944618225097656 time for calcul the mask position with numpy : 0.01579737663269043 nb_pixel_total : 1219 time to create 1 rle with old method : 0.0014469623565673828 time for calcul the mask position with numpy : 0.016620397567749023 nb_pixel_total : 22 time to create 1 rle with old method : 0.00013065338134765625 time for calcul the mask position with numpy : 0.01721954345703125 nb_pixel_total : 201 time to create 1 rle with old method : 0.0002593994140625 time for calcul the mask position with numpy : 0.01672673225402832 nb_pixel_total : 623 time to create 1 rle with old method : 0.0007739067077636719 time for calcul the mask position with numpy : 0.016604185104370117 nb_pixel_total : 364 time to create 1 rle with old method : 0.0004830360412597656 time for calcul the mask position with numpy : 0.016382455825805664 nb_pixel_total : 1951 time to create 1 rle with old method : 0.002394437789916992 time for calcul the mask position with numpy : 0.01558232307434082 nb_pixel_total : 427 time to create 1 rle with old method : 0.0004892349243164062 time for calcul the mask position with numpy : 0.015190839767456055 nb_pixel_total : 1330 time to create 1 rle with old method : 0.0015354156494140625 time for calcul the mask position with numpy : 0.015123128890991211 nb_pixel_total : 7 time to create 1 rle with old method : 3.0279159545898438e-05 time for calcul the mask position with numpy : 0.015388965606689453 nb_pixel_total : 384 time to create 1 rle with old method : 0.0005021095275878906 time for calcul the mask position with numpy : 0.015613794326782227 nb_pixel_total : 1054 time to create 1 rle with old method : 0.0012176036834716797 time for calcul the mask position with numpy : 0.015519857406616211 nb_pixel_total : 973 time to create 1 rle with old method : 0.001161813735961914 time for calcul the mask position with numpy : 0.01516103744506836 nb_pixel_total : 92 time to create 1 rle with old method : 0.00012564659118652344 time for calcul the mask position with numpy : 0.01541900634765625 nb_pixel_total : 790 time to create 1 rle with old method : 0.0010068416595458984 time for calcul the mask position with numpy : 0.015562772750854492 nb_pixel_total : 259 time to create 1 rle with old method : 0.00033926963806152344 time for calcul the mask position with numpy : 0.015511512756347656 nb_pixel_total : 72 time to create 1 rle with old method : 0.00011372566223144531 time for calcul the mask position with numpy : 0.01524209976196289 nb_pixel_total : 678 time to create 1 rle with old method : 0.0008051395416259766 time for calcul the mask position with numpy : 0.015594959259033203 nb_pixel_total : 260 time to create 1 rle with old method : 0.00031685829162597656 time for calcul the mask position with numpy : 0.015405654907226562 nb_pixel_total : 1078 time to create 1 rle with old method : 0.001354217529296875 time for calcul the mask position with numpy : 0.015423774719238281 nb_pixel_total : 1438 time to create 1 rle with old method : 0.0017180442810058594 time for calcul the mask position with numpy : 0.01529693603515625 nb_pixel_total : 277 time to create 1 rle with old method : 0.00033783912658691406 time for calcul the mask position with numpy : 0.014712333679199219 nb_pixel_total : 375 time to create 1 rle with old method : 0.00044035911560058594 time for calcul the mask position with numpy : 0.014455318450927734 nb_pixel_total : 107 time to create 1 rle with old method : 0.0001685619354248047 time for calcul the mask position with numpy : 0.014416694641113281 nb_pixel_total : 1012 time to create 1 rle with old method : 0.0012576580047607422 time for calcul the mask position with numpy : 0.014590263366699219 nb_pixel_total : 1754 time to create 1 rle with old method : 0.0019106864929199219 time for calcul the mask position with numpy : 0.014488458633422852 nb_pixel_total : 232 time to create 1 rle with old method : 0.0003323554992675781 time for calcul the mask position with numpy : 0.014625787734985352 nb_pixel_total : 429 time to create 1 rle with old method : 0.0004930496215820312 time for calcul the mask position with numpy : 0.015364885330200195 nb_pixel_total : 226 time to create 1 rle with old method : 0.0002803802490234375 time for calcul the mask position with numpy : 0.014512777328491211 nb_pixel_total : 485 time to create 1 rle with old method : 0.0005943775177001953 time for calcul the mask position with numpy : 0.01477503776550293 nb_pixel_total : 1092 time to create 1 rle with old method : 0.0012218952178955078 time for calcul the mask position with numpy : 0.014658451080322266 nb_pixel_total : 67 time to create 1 rle with old method : 0.0001201629638671875 time for calcul the mask position with numpy : 0.015711069107055664 nb_pixel_total : 887 time to create 1 rle with old method : 0.0010898113250732422 time for calcul the mask position with numpy : 0.014772415161132812 nb_pixel_total : 620 time to create 1 rle with old method : 0.0007147789001464844 time for calcul the mask position with numpy : 0.014624357223510742 nb_pixel_total : 4006 time to create 1 rle with old method : 0.004544496536254883 time for calcul the mask position with numpy : 0.01465749740600586 nb_pixel_total : 947 time to create 1 rle with old method : 0.0012629032135009766 time for calcul the mask position with numpy : 0.014638662338256836 nb_pixel_total : 473 time to create 1 rle with old method : 0.00063323974609375 time for calcul the mask position with numpy : 0.014788627624511719 nb_pixel_total : 1376 time to create 1 rle with old method : 0.001714944839477539 time for calcul the mask position with numpy : 0.014544248580932617 nb_pixel_total : 970 time to create 1 rle with old method : 0.0011429786682128906 time for calcul the mask position with numpy : 0.01570439338684082 nb_pixel_total : 261 time to create 1 rle with old method : 0.00032520294189453125 time for calcul the mask position with numpy : 0.014681339263916016 nb_pixel_total : 251 time to create 1 rle with old method : 0.0003075599670410156 time for calcul the mask position with numpy : 0.01450490951538086 nb_pixel_total : 2163 time to create 1 rle with old method : 0.0023086071014404297 time for calcul the mask position with numpy : 0.014468669891357422 nb_pixel_total : 13 time to create 1 rle with old method : 2.6702880859375e-05 time for calcul the mask position with numpy : 0.014608383178710938 nb_pixel_total : 892 time to create 1 rle with old method : 0.0010924339294433594 time for calcul the mask position with numpy : 0.01526641845703125 nb_pixel_total : 1311 time to create 1 rle with old method : 0.0015451908111572266 time for calcul the mask position with numpy : 0.014928579330444336 nb_pixel_total : 691 time to create 1 rle with old method : 0.0008172988891601562 time for calcul the mask position with numpy : 0.014902353286743164 nb_pixel_total : 1291 time to create 1 rle with old method : 0.0014986991882324219 time for calcul the mask position with numpy : 0.014913797378540039 nb_pixel_total : 1252 time to create 1 rle with old method : 0.0014853477478027344 time for calcul the mask position with numpy : 0.014919281005859375 nb_pixel_total : 265 time to create 1 rle with old method : 0.00031876564025878906 time for calcul the mask position with numpy : 0.015163421630859375 nb_pixel_total : 2539 time to create 1 rle with old method : 0.004108428955078125 time for calcul the mask position with numpy : 0.017245054244995117 nb_pixel_total : 12 time to create 1 rle with old method : 8.344650268554688e-05 time for calcul the mask position with numpy : 0.017156362533569336 nb_pixel_total : 39 time to create 1 rle with old method : 0.0001850128173828125 time for calcul the mask position with numpy : 0.017120361328125 nb_pixel_total : 113 time to create 1 rle with old method : 0.0002396106719970703 time for calcul the mask position with numpy : 0.01723933219909668 nb_pixel_total : 162 time to create 1 rle with old method : 0.0002944469451904297 time for calcul the mask position with numpy : 0.015403032302856445 nb_pixel_total : 229 time to create 1 rle with old method : 0.0006256103515625 time for calcul the mask position with numpy : 0.015069246292114258 nb_pixel_total : 2043 time to create 1 rle with old method : 0.0023729801177978516 time for calcul the mask position with numpy : 0.014998674392700195 nb_pixel_total : 1347 time to create 1 rle with old method : 0.0016512870788574219 time for calcul the mask position with numpy : 0.015006542205810547 nb_pixel_total : 2086 time to create 1 rle with old method : 0.0023064613342285156 time for calcul the mask position with numpy : 0.014398813247680664 nb_pixel_total : 249 time to create 1 rle with old method : 0.0002808570861816406 time for calcul the mask position with numpy : 0.01457667350769043 nb_pixel_total : 38 time to create 1 rle with old method : 7.200241088867188e-05 time for calcul the mask position with numpy : 0.014721393585205078 nb_pixel_total : 674 time to create 1 rle with old method : 0.0008304119110107422 time for calcul the mask position with numpy : 0.014545679092407227 nb_pixel_total : 297 time to create 1 rle with old method : 0.0005254745483398438 time for calcul the mask position with numpy : 0.017475605010986328 nb_pixel_total : 654 time to create 1 rle with old method : 0.0009455680847167969 time for calcul the mask position with numpy : 0.015753984451293945 nb_pixel_total : 227 time to create 1 rle with old method : 0.0002722740173339844 time for calcul the mask position with numpy : 0.014739513397216797 nb_pixel_total : 818 time to create 1 rle with old method : 0.001277923583984375 time for calcul the mask position with numpy : 0.015067100524902344 nb_pixel_total : 370 time to create 1 rle with old method : 0.000453948974609375 time for calcul the mask position with numpy : 0.014870166778564453 nb_pixel_total : 946 time to create 1 rle with old method : 0.001173257827758789 time for calcul the mask position with numpy : 0.014779090881347656 nb_pixel_total : 397 time to create 1 rle with old method : 0.00047850608825683594 time for calcul the mask position with numpy : 0.014631509780883789 nb_pixel_total : 1876 time to create 1 rle with old method : 0.002155303955078125 time for calcul the mask position with numpy : 0.015237569808959961 nb_pixel_total : 312 time to create 1 rle with old method : 0.0003960132598876953 time for calcul the mask position with numpy : 0.014632463455200195 nb_pixel_total : 20 time to create 1 rle with old method : 4.76837158203125e-05 time for calcul the mask position with numpy : 0.015627622604370117 nb_pixel_total : 321 time to create 1 rle with old method : 0.00036978721618652344 time for calcul the mask position with numpy : 0.014957427978515625 nb_pixel_total : 2301 time to create 1 rle with old method : 0.002489328384399414 time for calcul the mask position with numpy : 0.015347957611083984 nb_pixel_total : 245 time to create 1 rle with old method : 0.0003292560577392578 time for calcul the mask position with numpy : 0.016287565231323242 nb_pixel_total : 248 time to create 1 rle with old method : 0.0004773139953613281 time for calcul the mask position with numpy : 0.017309904098510742 nb_pixel_total : 2016 time to create 1 rle with old method : 0.0033555030822753906 time for calcul the mask position with numpy : 0.015466690063476562 nb_pixel_total : 1070 time to create 1 rle with old method : 0.0012326240539550781 time for calcul the mask position with numpy : 0.01534414291381836 nb_pixel_total : 507 time to create 1 rle with old method : 0.0006630420684814453 time for calcul the mask position with numpy : 0.015222311019897461 nb_pixel_total : 517 time to create 1 rle with old method : 0.0006945133209228516 time for calcul the mask position with numpy : 0.015316963195800781 nb_pixel_total : 466 time to create 1 rle with old method : 0.0005755424499511719 time for calcul the mask position with numpy : 0.015109062194824219 nb_pixel_total : 93 time to create 1 rle with old method : 0.0001201629638671875 time for calcul the mask position with numpy : 0.014822006225585938 nb_pixel_total : 1235 time to create 1 rle with old method : 0.001413583755493164 time for calcul the mask position with numpy : 0.014834880828857422 nb_pixel_total : 233 time to create 1 rle with old method : 0.0002994537353515625 time for calcul the mask position with numpy : 0.014729738235473633 nb_pixel_total : 387 time to create 1 rle with old method : 0.0005297660827636719 time for calcul the mask position with numpy : 0.014560699462890625 nb_pixel_total : 877 time to create 1 rle with old method : 0.0010569095611572266 time for calcul the mask position with numpy : 0.015207767486572266 nb_pixel_total : 656 time to create 1 rle with old method : 0.0008306503295898438 time for calcul the mask position with numpy : 0.015381097793579102 nb_pixel_total : 160 time to create 1 rle with old method : 0.00022864341735839844 time for calcul the mask position with numpy : 0.015266656875610352 nb_pixel_total : 798 time to create 1 rle with old method : 0.0009739398956298828 time for calcul the mask position with numpy : 0.015280961990356445 nb_pixel_total : 264 time to create 1 rle with old method : 0.00036597251892089844 time for calcul the mask position with numpy : 0.01932549476623535 nb_pixel_total : 602 time to create 1 rle with old method : 0.0009589195251464844 time for calcul the mask position with numpy : 0.017215728759765625 nb_pixel_total : 535 time to create 1 rle with old method : 0.0008230209350585938 time for calcul the mask position with numpy : 0.01819920539855957 nb_pixel_total : 84 time to create 1 rle with old method : 0.00014853477478027344 time for calcul the mask position with numpy : 0.017200231552124023 nb_pixel_total : 209 time to create 1 rle with old method : 0.0002570152282714844 time for calcul the mask position with numpy : 0.014935493469238281 nb_pixel_total : 170 time to create 1 rle with old method : 0.0002181529998779297 time for calcul the mask position with numpy : 0.014809608459472656 nb_pixel_total : 312 time to create 1 rle with old method : 0.00036787986755371094 time for calcul the mask position with numpy : 0.014811515808105469 nb_pixel_total : 29 time to create 1 rle with old method : 6.222724914550781e-05 time for calcul the mask position with numpy : 0.0149383544921875 nb_pixel_total : 424 time to create 1 rle with old method : 0.0005459785461425781 time for calcul the mask position with numpy : 0.01481318473815918 nb_pixel_total : 340 time to create 1 rle with old method : 0.00047016143798828125 time for calcul the mask position with numpy : 0.015006065368652344 nb_pixel_total : 49 time to create 1 rle with old method : 8.106231689453125e-05 time for calcul the mask position with numpy : 0.014467477798461914 nb_pixel_total : 10 time to create 1 rle with old method : 3.838539123535156e-05 time for calcul the mask position with numpy : 0.014642715454101562 nb_pixel_total : 210 time to create 1 rle with old method : 0.0002701282501220703 time for calcul the mask position with numpy : 0.01444864273071289 nb_pixel_total : 390 time to create 1 rle with old method : 0.0004699230194091797 time for calcul the mask position with numpy : 0.014339447021484375 nb_pixel_total : 1245 time to create 1 rle with old method : 0.0013589859008789062 time for calcul the mask position with numpy : 0.013905763626098633 nb_pixel_total : 31 time to create 1 rle with old method : 7.200241088867188e-05 time for calcul the mask position with numpy : 0.014566659927368164 nb_pixel_total : 376 time to create 1 rle with old method : 0.0004520416259765625 time for calcul the mask position with numpy : 0.014462471008300781 nb_pixel_total : 800 time to create 1 rle with old method : 0.0008955001831054688 time for calcul the mask position with numpy : 0.014327526092529297 nb_pixel_total : 109 time to create 1 rle with old method : 0.0001678466796875 time for calcul the mask position with numpy : 0.01471257209777832 nb_pixel_total : 387 time to create 1 rle with old method : 0.0004608631134033203 time for calcul the mask position with numpy : 0.014738321304321289 nb_pixel_total : 1018 time to create 1 rle with old method : 0.0012693405151367188 time for calcul the mask position with numpy : 0.014653682708740234 nb_pixel_total : 1319 time to create 1 rle with old method : 0.0015647411346435547 time for calcul the mask position with numpy : 0.014887571334838867 nb_pixel_total : 284 time to create 1 rle with old method : 0.0003466606140136719 time for calcul the mask position with numpy : 0.014887094497680664 nb_pixel_total : 240 time to create 1 rle with old method : 0.0002994537353515625 time for calcul the mask position with numpy : 0.014712333679199219 nb_pixel_total : 165 time to create 1 rle with old method : 0.00019359588623046875 time for calcul the mask position with numpy : 0.014274120330810547 nb_pixel_total : 335 time to create 1 rle with old method : 0.00046133995056152344 time for calcul the mask position with numpy : 0.014049291610717773 nb_pixel_total : 673 time to create 1 rle with old method : 0.0007622241973876953 time for calcul the mask position with numpy : 0.014373302459716797 nb_pixel_total : 1852 time to create 1 rle with old method : 0.002086639404296875 time for calcul the mask position with numpy : 0.013927936553955078 nb_pixel_total : 584 time to create 1 rle with old method : 0.0006453990936279297 time for calcul the mask position with numpy : 0.014034271240234375 nb_pixel_total : 263 time to create 1 rle with old method : 0.00032067298889160156 time for calcul the mask position with numpy : 0.01473546028137207 nb_pixel_total : 185 time to create 1 rle with old method : 0.00023365020751953125 time for calcul the mask position with numpy : 0.01448678970336914 nb_pixel_total : 1566 time to create 1 rle with old method : 0.0017061233520507812 time for calcul the mask position with numpy : 0.014528751373291016 nb_pixel_total : 810 time to create 1 rle with old method : 0.0009567737579345703 time for calcul the mask position with numpy : 0.014725685119628906 nb_pixel_total : 184 time to create 1 rle with old method : 0.0002410411834716797 time for calcul the mask position with numpy : 0.01478123664855957 nb_pixel_total : 316 time to create 1 rle with old method : 0.00037384033203125 time for calcul the mask position with numpy : 0.014478683471679688 nb_pixel_total : 3394 time to create 1 rle with old method : 0.0038955211639404297 time for calcul the mask position with numpy : 0.015256166458129883 nb_pixel_total : 1576 time to create 1 rle with old method : 0.0020520687103271484 time for calcul the mask position with numpy : 0.015111684799194336 nb_pixel_total : 25 time to create 1 rle with old method : 7.510185241699219e-05 time for calcul the mask position with numpy : 0.01498270034790039 nb_pixel_total : 3014 time to create 1 rle with old method : 0.003537416458129883 time for calcul the mask position with numpy : 0.01532435417175293 nb_pixel_total : 7703 time to create 1 rle with old method : 0.008910179138183594 time for calcul the mask position with numpy : 0.014903068542480469 nb_pixel_total : 1100 time to create 1 rle with old method : 0.0012235641479492188 time for calcul the mask position with numpy : 0.01501011848449707 nb_pixel_total : 1669 time to create 1 rle with old method : 0.0018610954284667969 time for calcul the mask position with numpy : 0.014808177947998047 nb_pixel_total : 195 time to create 1 rle with old method : 0.00025463104248046875 time for calcul the mask position with numpy : 0.014565467834472656 nb_pixel_total : 1111 time to create 1 rle with old method : 0.001607656478881836 time for calcul the mask position with numpy : 0.017104148864746094 nb_pixel_total : 434 time to create 1 rle with old method : 0.0007445812225341797 time for calcul the mask position with numpy : 0.017033100128173828 nb_pixel_total : 1843 time to create 1 rle with old method : 0.0029942989349365234 time for calcul the mask position with numpy : 0.017113685607910156 nb_pixel_total : 1126 time to create 1 rle with old method : 0.0018630027770996094 time for calcul the mask position with numpy : 0.017076730728149414 nb_pixel_total : 1323 time to create 1 rle with old method : 0.0020766258239746094 time for calcul the mask position with numpy : 0.014658927917480469 nb_pixel_total : 299 time to create 1 rle with old method : 0.0003609657287597656 time for calcul the mask position with numpy : 0.01496744155883789 nb_pixel_total : 566 time to create 1 rle with old method : 0.0006818771362304688 time for calcul the mask position with numpy : 0.015080928802490234 nb_pixel_total : 511 time to create 1 rle with old method : 0.0006206035614013672 time for calcul the mask position with numpy : 0.015168905258178711 nb_pixel_total : 504 time to create 1 rle with old method : 0.0008296966552734375 time for calcul the mask position with numpy : 0.017222166061401367 nb_pixel_total : 2495 time to create 1 rle with old method : 0.004106283187866211 time for calcul the mask position with numpy : 0.017183780670166016 nb_pixel_total : 1586 time to create 1 rle with old method : 0.0026633739471435547 time for calcul the mask position with numpy : 0.017455577850341797 nb_pixel_total : 239 time to create 1 rle with old method : 0.00043702125549316406 time for calcul the mask position with numpy : 0.017258405685424805 nb_pixel_total : 1008 time to create 1 rle with old method : 0.0011920928955078125 time for calcul the mask position with numpy : 0.015121221542358398 nb_pixel_total : 151 time to create 1 rle with old method : 0.00022745132446289062 time for calcul the mask position with numpy : 0.015033721923828125 nb_pixel_total : 712 time to create 1 rle with old method : 0.0008633136749267578 time for calcul the mask position with numpy : 0.015075206756591797 nb_pixel_total : 392 time to create 1 rle with old method : 0.00048160552978515625 time for calcul the mask position with numpy : 0.015038728713989258 nb_pixel_total : 357 time to create 1 rle with old method : 0.0004241466522216797 time for calcul the mask position with numpy : 0.014979124069213867 nb_pixel_total : 1760 time to create 1 rle with old method : 0.0020351409912109375 time for calcul the mask position with numpy : 0.015118837356567383 nb_pixel_total : 1325 time to create 1 rle with old method : 0.0015571117401123047 time for calcul the mask position with numpy : 0.015352249145507812 nb_pixel_total : 292 time to create 1 rle with old method : 0.0003669261932373047 time for calcul the mask position with numpy : 0.015248775482177734 nb_pixel_total : 321 time to create 1 rle with old method : 0.00040650367736816406 time for calcul the mask position with numpy : 0.015369892120361328 nb_pixel_total : 1372 time to create 1 rle with old method : 0.0018754005432128906 time for calcul the mask position with numpy : 0.015676498413085938 nb_pixel_total : 4685 time to create 1 rle with old method : 0.005620002746582031 time for calcul the mask position with numpy : 0.01530146598815918 nb_pixel_total : 1918 time to create 1 rle with old method : 0.002506732940673828 time for calcul the mask position with numpy : 0.015343189239501953 nb_pixel_total : 2 time to create 1 rle with old method : 4.792213439941406e-05 time for calcul the mask position with numpy : 0.015685081481933594 nb_pixel_total : 1381 time to create 1 rle with old method : 0.002001047134399414 time for calcul the mask position with numpy : 0.016053199768066406 nb_pixel_total : 570 time to create 1 rle with old method : 0.0007028579711914062 time for calcul the mask position with numpy : 0.015806913375854492 nb_pixel_total : 58 time to create 1 rle with old method : 0.000125885009765625 time for calcul the mask position with numpy : 0.01566910743713379 nb_pixel_total : 1197 time to create 1 rle with old method : 0.0014717578887939453 time for calcul the mask position with numpy : 0.015462160110473633 nb_pixel_total : 791 time to create 1 rle with old method : 0.0009474754333496094 time for calcul the mask position with numpy : 0.015136241912841797 nb_pixel_total : 585 time to create 1 rle with old method : 0.0006871223449707031 time for calcul the mask position with numpy : 0.01613163948059082 nb_pixel_total : 1003 time to create 1 rle with old method : 0.0012030601501464844 time for calcul the mask position with numpy : 0.01600956916809082 nb_pixel_total : 1651 time to create 1 rle with old method : 0.0019757747650146484 time for calcul the mask position with numpy : 0.016345739364624023 nb_pixel_total : 1076 time to create 1 rle with old method : 0.0013668537139892578 time for calcul the mask position with numpy : 0.016117334365844727 nb_pixel_total : 565 time to create 1 rle with old method : 0.0006930828094482422 time for calcul the mask position with numpy : 0.016933202743530273 nb_pixel_total : 1048 time to create 1 rle with old method : 0.0013489723205566406 time for calcul the mask position with numpy : 0.015798568725585938 nb_pixel_total : 8 time to create 1 rle with old method : 3.695487976074219e-05 time for calcul the mask position with numpy : 0.015208721160888672 nb_pixel_total : 829 time to create 1 rle with old method : 0.000993967056274414 time for calcul the mask position with numpy : 0.016138792037963867 nb_pixel_total : 818 time to create 1 rle with old method : 0.0009789466857910156 time for calcul the mask position with numpy : 0.01527261734008789 nb_pixel_total : 1021 time to create 1 rle with old method : 0.0011718273162841797 time for calcul the mask position with numpy : 0.015037059783935547 nb_pixel_total : 2875 time to create 1 rle with old method : 0.0033059120178222656 time for calcul the mask position with numpy : 0.015023231506347656 nb_pixel_total : 249 time to create 1 rle with old method : 0.0003147125244140625 time for calcul the mask position with numpy : 0.015069723129272461 nb_pixel_total : 468 time to create 1 rle with old method : 0.0006244182586669922 time for calcul the mask position with numpy : 0.015042304992675781 nb_pixel_total : 1262 time to create 1 rle with old method : 0.0014562606811523438 time for calcul the mask position with numpy : 0.0151214599609375 nb_pixel_total : 1262 time to create 1 rle with old method : 0.0014710426330566406 time for calcul the mask position with numpy : 0.015186786651611328 nb_pixel_total : 470 time to create 1 rle with old method : 0.000576019287109375 time for calcul the mask position with numpy : 0.015045404434204102 nb_pixel_total : 1043 time to create 1 rle with old method : 0.0013782978057861328 time for calcul the mask position with numpy : 0.015089273452758789 nb_pixel_total : 930 time to create 1 rle with old method : 0.0012576580047607422 time for calcul the mask position with numpy : 0.01572871208190918 nb_pixel_total : 408 time to create 1 rle with old method : 0.0005376338958740234 time for calcul the mask position with numpy : 0.015187263488769531 nb_pixel_total : 342 time to create 1 rle with old method : 0.00043511390686035156 time for calcul the mask position with numpy : 0.015040159225463867 nb_pixel_total : 249 time to create 1 rle with old method : 0.0003066062927246094 time for calcul the mask position with numpy : 0.014991283416748047 nb_pixel_total : 902 time to create 1 rle with old method : 0.0010647773742675781 time for calcul the mask position with numpy : 0.014999151229858398 nb_pixel_total : 1502 time to create 1 rle with old method : 0.0017552375793457031 time for calcul the mask position with numpy : 0.015015363693237305 nb_pixel_total : 618 time to create 1 rle with old method : 0.0007457733154296875 time for calcul the mask position with numpy : 0.015101909637451172 nb_pixel_total : 400 time to create 1 rle with old method : 0.00046181678771972656 time for calcul the mask position with numpy : 0.015128374099731445 nb_pixel_total : 1188 time to create 1 rle with old method : 0.001367807388305664 time for calcul the mask position with numpy : 0.01493692398071289 nb_pixel_total : 180 time to create 1 rle with old method : 0.0002257823944091797 time for calcul the mask position with numpy : 0.014960289001464844 nb_pixel_total : 276 time to create 1 rle with old method : 0.00036978721618652344 time for calcul the mask position with numpy : 0.014963626861572266 nb_pixel_total : 8 time to create 1 rle with old method : 3.838539123535156e-05 time for calcul the mask position with numpy : 0.01498723030090332 nb_pixel_total : 228 time to create 1 rle with old method : 0.0002925395965576172 time for calcul the mask position with numpy : 0.015099763870239258 nb_pixel_total : 911 time to create 1 rle with old method : 0.0011386871337890625 time for calcul the mask position with numpy : 0.015026092529296875 nb_pixel_total : 798 time to create 1 rle with old method : 0.0009076595306396484 time for calcul the mask position with numpy : 0.015170574188232422 nb_pixel_total : 837 time to create 1 rle with old method : 0.00099945068359375 time for calcul the mask position with numpy : 0.015038728713989258 nb_pixel_total : 1 time to create 1 rle with old method : 1.9788742065429688e-05 time for calcul the mask position with numpy : 0.014997243881225586 nb_pixel_total : 8 time to create 1 rle with old method : 4.696846008300781e-05 time for calcul the mask position with numpy : 0.014989614486694336 nb_pixel_total : 605 time to create 1 rle with old method : 0.0007104873657226562 time for calcul the mask position with numpy : 0.015029668807983398 nb_pixel_total : 491 time to create 1 rle with old method : 0.0005886554718017578 time for calcul the mask position with numpy : 0.015012264251708984 nb_pixel_total : 543 time to create 1 rle with old method : 0.0006268024444580078 time for calcul the mask position with numpy : 0.015165567398071289 nb_pixel_total : 157 time to create 1 rle with old method : 0.0002231597900390625 time for calcul the mask position with numpy : 0.015105724334716797 nb_pixel_total : 110 time to create 1 rle with old method : 0.0001621246337890625 time for calcul the mask position with numpy : 0.015080690383911133 nb_pixel_total : 85 time to create 1 rle with old method : 0.00013875961303710938 time for calcul the mask position with numpy : 0.015398263931274414 nb_pixel_total : 642 time to create 1 rle with old method : 0.0007870197296142578 time for calcul the mask position with numpy : 0.015003681182861328 nb_pixel_total : 249 time to create 1 rle with old method : 0.000324249267578125 time for calcul the mask position with numpy : 0.015178680419921875 nb_pixel_total : 343 time to create 1 rle with old method : 0.0004398822784423828 time for calcul the mask position with numpy : 0.015092134475708008 nb_pixel_total : 352 time to create 1 rle with old method : 0.0004305839538574219 time for calcul the mask position with numpy : 0.015276193618774414 nb_pixel_total : 1657 time to create 1 rle with old method : 0.0019788742065429688 time for calcul the mask position with numpy : 0.015328407287597656 nb_pixel_total : 1252 time to create 1 rle with old method : 0.0014836788177490234 time for calcul the mask position with numpy : 0.015049934387207031 nb_pixel_total : 116 time to create 1 rle with old method : 0.00015687942504882812 time for calcul the mask position with numpy : 0.01506495475769043 nb_pixel_total : 1468 time to create 1 rle with old method : 0.0017247200012207031 time for calcul the mask position with numpy : 0.015304803848266602 nb_pixel_total : 313 time to create 1 rle with old method : 0.000396728515625 time for calcul the mask position with numpy : 0.015362739562988281 nb_pixel_total : 591 time to create 1 rle with old method : 0.0007228851318359375 time for calcul the mask position with numpy : 0.015302896499633789 nb_pixel_total : 6405 time to create 1 rle with old method : 0.007647037506103516 time for calcul the mask position with numpy : 0.015453100204467773 nb_pixel_total : 29885 time to create 1 rle with old method : 0.0346074104309082 time for calcul the mask position with numpy : 0.015289545059204102 nb_pixel_total : 8 time to create 1 rle with old method : 5.841255187988281e-05 time for calcul the mask position with numpy : 0.015312671661376953 nb_pixel_total : 2383 time to create 1 rle with old method : 0.002804994583129883 time for calcul the mask position with numpy : 0.015601873397827148 nb_pixel_total : 933 time to create 1 rle with old method : 0.001251220703125 time for calcul the mask position with numpy : 0.015307426452636719 nb_pixel_total : 163 time to create 1 rle with old method : 0.0002429485321044922 time for calcul the mask position with numpy : 0.015189886093139648 nb_pixel_total : 270 time to create 1 rle with old method : 0.00039315223693847656 time for calcul the mask position with numpy : 0.01501011848449707 nb_pixel_total : 13 time to create 1 rle with old method : 5.8650970458984375e-05 time for calcul the mask position with numpy : 0.01496434211730957 nb_pixel_total : 737 time to create 1 rle with old method : 0.0009717941284179688 time for calcul the mask position with numpy : 0.014991998672485352 nb_pixel_total : 114 time to create 1 rle with old method : 0.00017023086547851562 time for calcul the mask position with numpy : 0.015104055404663086 nb_pixel_total : 15 time to create 1 rle with old method : 5.650520324707031e-05 time for calcul the mask position with numpy : 0.015003204345703125 nb_pixel_total : 330 time to create 1 rle with old method : 0.00044155120849609375 time for calcul the mask position with numpy : 0.014969348907470703 nb_pixel_total : 761 time to create 1 rle with old method : 0.0010170936584472656 time for calcul the mask position with numpy : 0.015030622482299805 nb_pixel_total : 236 time to create 1 rle with old method : 0.0003390312194824219 time for calcul the mask position with numpy : 0.015103578567504883 nb_pixel_total : 278 time to create 1 rle with old method : 0.00036835670471191406 time for calcul the mask position with numpy : 0.015272140502929688 nb_pixel_total : 16 time to create 1 rle with old method : 5.745887756347656e-05 time for calcul the mask position with numpy : 0.01511240005493164 nb_pixel_total : 285 time to create 1 rle with old method : 0.0003676414489746094 time for calcul the mask position with numpy : 0.015287160873413086 nb_pixel_total : 1443 time to create 1 rle with old method : 0.0017292499542236328 time for calcul the mask position with numpy : 0.015058279037475586 nb_pixel_total : 173 time to create 1 rle with old method : 0.00024771690368652344 time for calcul the mask position with numpy : 0.015089035034179688 nb_pixel_total : 880 time to create 1 rle with old method : 0.0010173320770263672 time for calcul the mask position with numpy : 0.015282154083251953 nb_pixel_total : 164 time to create 1 rle with old method : 0.0002925395965576172 time for calcul the mask position with numpy : 0.015098094940185547 nb_pixel_total : 771 time to create 1 rle with old method : 0.0009188652038574219 time for calcul the mask position with numpy : 0.01512289047241211 nb_pixel_total : 235 time to create 1 rle with old method : 0.0003266334533691406 time for calcul the mask position with numpy : 0.015028238296508789 nb_pixel_total : 162 time to create 1 rle with old method : 0.00021004676818847656 time for calcul the mask position with numpy : 0.015108823776245117 nb_pixel_total : 178 time to create 1 rle with old method : 0.00023102760314941406 time for calcul the mask position with numpy : 0.014951705932617188 nb_pixel_total : 226 time to create 1 rle with old method : 0.00027489662170410156 time for calcul the mask position with numpy : 0.014960527420043945 nb_pixel_total : 361 time to create 1 rle with old method : 0.0004379749298095703 time for calcul the mask position with numpy : 0.01499176025390625 nb_pixel_total : 408 time to create 1 rle with old method : 0.0004832744598388672 time for calcul the mask position with numpy : 0.014924764633178711 nb_pixel_total : 273 time to create 1 rle with old method : 0.00032782554626464844 time for calcul the mask position with numpy : 0.014951705932617188 nb_pixel_total : 72 time to create 1 rle with old method : 9.632110595703125e-05 time for calcul the mask position with numpy : 0.014940023422241211 nb_pixel_total : 331 time to create 1 rle with old method : 0.000400543212890625 time for calcul the mask position with numpy : 0.014927864074707031 nb_pixel_total : 389 time to create 1 rle with old method : 0.0004665851593017578 time for calcul the mask position with numpy : 0.014947891235351562 nb_pixel_total : 128 time to create 1 rle with old method : 0.00016570091247558594 time for calcul the mask position with numpy : 0.014954328536987305 nb_pixel_total : 171 time to create 1 rle with old method : 0.00023555755615234375 time for calcul the mask position with numpy : 0.015119314193725586 nb_pixel_total : 97 time to create 1 rle with old method : 0.00012826919555664062 time for calcul the mask position with numpy : 0.014970541000366211 nb_pixel_total : 158 time to create 1 rle with old method : 0.0002028942108154297 time for calcul the mask position with numpy : 0.014577388763427734 nb_pixel_total : 6203 time to create 1 rle with old method : 0.006851673126220703 time for calcul the mask position with numpy : 0.014571189880371094 nb_pixel_total : 2077 time to create 1 rle with old method : 0.002298116683959961 time for calcul the mask position with numpy : 0.01492452621459961 nb_pixel_total : 1379 time to create 1 rle with old method : 0.0016205310821533203 time for calcul the mask position with numpy : 0.014153242111206055 nb_pixel_total : 423 time to create 1 rle with old method : 0.0004622936248779297 time for calcul the mask position with numpy : 0.014329910278320312 nb_pixel_total : 161 time to create 1 rle with old method : 0.00020503997802734375 time for calcul the mask position with numpy : 0.014417648315429688 nb_pixel_total : 204 time to create 1 rle with old method : 0.00024127960205078125 time for calcul the mask position with numpy : 0.014334917068481445 nb_pixel_total : 4 time to create 1 rle with old method : 2.0503997802734375e-05 time for calcul the mask position with numpy : 0.014438867568969727 nb_pixel_total : 282 time to create 1 rle with old method : 0.0003695487976074219 time for calcul the mask position with numpy : 0.014657020568847656 nb_pixel_total : 356 time to create 1 rle with old method : 0.00042629241943359375 time for calcul the mask position with numpy : 0.01483464241027832 nb_pixel_total : 71 time to create 1 rle with old method : 0.00010275840759277344 time for calcul the mask position with numpy : 0.014410018920898438 nb_pixel_total : 135 time to create 1 rle with old method : 0.0001678466796875 time for calcul the mask position with numpy : 0.014936685562133789 nb_pixel_total : 105 time to create 1 rle with old method : 0.00014972686767578125 time for calcul the mask position with numpy : 0.014801740646362305 nb_pixel_total : 357 time to create 1 rle with old method : 0.00042438507080078125 time for calcul the mask position with numpy : 0.014437198638916016 nb_pixel_total : 607 time to create 1 rle with old method : 0.0006787776947021484 create new chi : 7.489551544189453 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.01395106315612793 batch 1 Loaded 363 chid ids of type : 4230 Number RLEs to save : 25953 TO DO : save crop sub photo not yet done ! save time : 1.8381097316741943 map_output_result : {1336717164: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1336717164] Looping around the photos to save general results len do output : 1 /1336717164.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2574893') ('4234', '20430845', '1336717164', None, None, None, None, None, '2574893') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.015622854232788086 save_final save missing photos in datou_result : time spend for datou_step_exec : 11.626618146896362 time spend to save output : 0.016051769256591797 total time spend for step 4 : 11.642669916152954 step5:crop_condition Tue Feb 11 07:21:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 1 ! batch 1 Loaded 363 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 196 About to insert : list_path_to_insert length 196 new photo from crops ! About to upload 196 photos upload in portfolio : 4869462 init cache_photo without model_param we have 196 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739254874_1555482 we have uploaded 196 photos in the portfolio 4869462 time of upload the photos Elapsed time : 47.748358488082886 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 52 About to insert : list_path_to_insert length 52 new photo from crops ! About to upload 52 photos upload in portfolio : 4869462 init cache_photo without model_param we have 52 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739254923_1555482 we have uploaded 52 photos in the portfolio 4869462 time of upload the photos Elapsed time : 15.913615703582764 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739254941_1555482 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.123297929763794 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 6 About to insert : list_path_to_insert length 6 new photo from crops ! About to upload 6 photos upload in portfolio : 4869462 init cache_photo without model_param we have 6 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739254943_1555482 we have uploaded 6 photos in the portfolio 4869462 time of upload the photos Elapsed time : 2.296973705291748 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 4869462 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739254945_1555482 we have uploaded 9 photos in the portfolio 4869462 time of upload the photos Elapsed time : 4.1592772006988525 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1336717164] Looping around the photos to save general results len do output : 265 /1336733627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733629Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733631Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733633Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733635Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733651Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733657Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733667Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733710Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733761Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733767Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336733934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2574893') ('4234', '20430845', '1336717164', None, None, None, None, None, '2574893') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 796 time used for this insertion : 0.15525317192077637 save_final save missing photos in datou_result : time spend for datou_step_exec : 81.25536680221558 time spend to save output : 0.2481825351715088 total time spend for step 5 : 81.50354933738708 step6:thcl Tue Feb 11 07:22:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.017808198928833008 time to convert the images to numpy array : 0.06679821014404297 time to import caffe and check if the image exist : 0.0316619873046875 time to convert the images to numpy array : 0.0838613510131836 time to import caffe and check if the image exist : 0.03854203224182129 time to convert the images to numpy array : 0.0797414779663086 time to import caffe and check if the image exist : 0.034149169921875 time to convert the images to numpy array : 0.08565163612365723 time to import caffe and check if the image exist : 0.036083221435546875 time to convert the images to numpy array : 0.0946192741394043 time to import caffe and check if the image exist : 0.027018308639526367 time to convert the images to numpy array : 0.1035604476928711 time to import caffe and check if the image exist : 0.0267181396484375 time to convert the images to numpy array : 0.1039578914642334 time to import caffe and check if the image exist : 0.03608131408691406 time to convert the images to numpy array : 0.09677553176879883 time to import caffe and check if the image exist : 0.047019243240356445 time to convert the images to numpy array : 0.08675169944763184 time to import caffe and check if the image exist : 0.04155874252319336 time to convert the images to numpy array : 0.09359478950500488 total time to convert the images to numpy array : 0.5153226852416992 list photo_ids error: [] list photo_ids correct : [1336733897, 1336733898, 1336733899, 1336733900, 1336733901, 1336733913, 1336733914, 1336733918, 1336733919, 1336733920, 1336733921, 1336733922, 1336733923, 1336733926, 1336733927, 1336733928, 1336733929, 1336733930, 1336733931, 1336733932, 1336733933, 1336733934, 1336733656, 1336733657, 1336733658, 1336733659, 1336733660, 1336733661, 1336733662, 1336733663, 1336733664, 1336733665, 1336733666, 1336733667, 1336733668, 1336733669, 1336733670, 1336733671, 1336733672, 1336733673, 1336733674, 1336733675, 1336733676, 1336733679, 1336733680, 1336733681, 1336733682, 1336733683, 1336733684, 1336733714, 1336733715, 1336733716, 1336733717, 1336733718, 1336733719, 1336733720, 1336733721, 1336733722, 1336733723, 1336733726, 1336733727, 1336733728, 1336733729, 1336733730, 1336733731, 1336733732, 1336733733, 1336733734, 1336733735, 1336733736, 1336733737, 1336733738, 1336733739, 1336733740, 1336733741, 1336733742, 1336733868, 1336733869, 1336733871, 1336733872, 1336733873, 1336733874, 1336733875, 1336733876, 1336733877, 1336733878, 1336733879, 1336733880, 1336733881, 1336733882, 1336733884, 1336733885, 1336733886, 1336733887, 1336733888, 1336733889, 1336733890, 1336733891, 1336733892, 1336733893, 1336733894, 1336733895, 1336733896, 1336733627, 1336733628, 1336733629, 1336733630, 1336733631, 1336733632, 1336733633, 1336733635, 1336733636, 1336733637, 1336733638, 1336733639, 1336733640, 1336733641, 1336733642, 1336733643, 1336733645, 1336733646, 1336733647, 1336733648, 1336733649, 1336733650, 1336733651, 1336733652, 1336733653, 1336733654, 1336733655, 1336733805, 1336733806, 1336733807, 1336733808, 1336733809, 1336733810, 1336733812, 1336733813, 1336733814, 1336733817, 1336733818, 1336733819, 1336733821, 1336733822, 1336733823, 1336733824, 1336733825, 1336733826, 1336733827, 1336733828, 1336733829, 1336733830, 1336733831, 1336733832, 1336733833, 1336733834, 1336733835, 1336733836, 1336733837, 1336733838, 1336733839, 1336733840, 1336733841, 1336733842, 1336733847, 1336733848, 1336733849, 1336733851, 1336733852, 1336733853, 1336733854, 1336733855, 1336733856, 1336733857, 1336733858, 1336733859, 1336733860, 1336733861, 1336733862, 1336733863, 1336733864, 1336733865, 1336733866, 1336733867, 1336733775, 1336733776, 1336733778, 1336733779, 1336733780, 1336733781, 1336733782, 1336733783, 1336733784, 1336733785, 1336733786, 1336733787, 1336733788, 1336733789, 1336733790, 1336733791, 1336733792, 1336733793, 1336733795, 1336733797, 1336733798, 1336733799, 1336733800, 1336733801, 1336733802, 1336733803, 1336733804, 1336733685, 1336733686, 1336733687, 1336733688, 1336733689, 1336733690, 1336733691, 1336733692, 1336733693, 1336733694, 1336733695, 1336733696, 1336733697, 1336733698, 1336733699, 1336733700, 1336733701, 1336733702, 1336733703, 1336733704, 1336733705, 1336733706, 1336733708, 1336733710, 1336733711, 1336733712, 1336733713, 1336733743, 1336733744, 1336733746, 1336733747, 1336733748, 1336733749, 1336733750, 1336733751, 1336733752, 1336733753, 1336733754, 1336733755, 1336733756, 1336733759, 1336733760, 1336733761, 1336733762, 1336733763, 1336733764, 1336733765, 1336733766, 1336733767, 1336733768, 1336733769, 1336733772, 1336733773, 1336733774] number of photos to traite : 265 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10774 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10555 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 1.3041043281555176 time used to do the prediction : 0.988288164138794 save descriptor for thcl : 3237 time to traite the descriptors : 1.614567518234253 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1336733897 To insert : 1336733898 To insert : 1336733899 To insert : 1336733900 To insert : 1336733901 To insert : 1336733913 To insert : 1336733914 To insert : 1336733918 To insert : 1336733919 To insert : 1336733920 To insert : 1336733921 To insert : 1336733922 To insert : 1336733923 To insert : 1336733926 To insert : 1336733927 To insert : 1336733928 To insert : 1336733929 To insert : 1336733930 To insert : 1336733931 To insert : 1336733932 To insert : 1336733933 To insert : 1336733934 To insert : 1336733656 To insert : 1336733657 To insert : 1336733658 To insert : 1336733659 To insert : 1336733660 To insert : 1336733661 To insert : 1336733662 To insert : 1336733663 To insert : 1336733664 To insert : 1336733665 To insert : 1336733666 To insert : 1336733667 To insert : 1336733668 To insert : 1336733669 To insert : 1336733670 To insert : 1336733671 To insert : 1336733672 To insert : 1336733673 To insert : 1336733674 To insert : 1336733675 To insert : 1336733676 To insert : 1336733679 To insert : 1336733680 To insert : 1336733681 To insert : 1336733682 To insert : 1336733683 To insert : 1336733684 To insert : 1336733714 To insert : 1336733715 To insert : 1336733716 To insert : 1336733717 To insert : 1336733718 To insert : 1336733719 To insert : 1336733720 To insert : 1336733721 To insert : 1336733722 To insert : 1336733723 To insert : 1336733726 To insert : 1336733727 To insert : 1336733728 To insert : 1336733729 To insert : 1336733730 To insert : 1336733731 To insert : 1336733732 To insert : 1336733733 To insert : 1336733734 To insert : 1336733735 To insert : 1336733736 To insert : 1336733737 To insert : 1336733738 To insert : 1336733739 To insert : 1336733740 To insert : 1336733741 To insert : 1336733742 To insert : 1336733868 To insert : 1336733869 To insert : 1336733871 To insert : 1336733872 To insert : 1336733873 To insert : 1336733874 To insert : 1336733875 To insert : 1336733876 To insert : 1336733877 To insert : 1336733878 To insert : 1336733879 To insert : 1336733880 To insert : 1336733881 To insert : 1336733882 To insert : 1336733884 To insert : 1336733885 To insert : 1336733886 To insert : 1336733887 To insert : 1336733888 To insert : 1336733889 To insert : 1336733890 To insert : 1336733891 To insert : 1336733892 To insert : 1336733893 To insert : 1336733894 To insert : 1336733895 To insert : 1336733896 To insert : 1336733627 To insert : 1336733628 To insert : 1336733629 To insert : 1336733630 To insert : 1336733631 To insert : 1336733632 To insert : 1336733633 To insert : 1336733635 To insert : 1336733636 To insert : 1336733637 To insert : 1336733638 To insert : 1336733639 To insert : 1336733640 To insert : 1336733641 To insert : 1336733642 To insert : 1336733643 To insert : 1336733645 To insert : 1336733646 To insert : 1336733647 To insert : 1336733648 To insert : 1336733649 To insert : 1336733650 To insert : 1336733651 To insert : 1336733652 To insert : 1336733653 To insert : 1336733654 To insert : 1336733655 To insert : 1336733805 To insert : 1336733806 To insert : 1336733807 To insert : 1336733808 To insert : 1336733809 To insert : 1336733810 To insert : 1336733812 To insert : 1336733813 To insert : 1336733814 To insert : 1336733817 To insert : 1336733818 To insert : 1336733819 To insert : 1336733821 To insert : 1336733822 To insert : 1336733823 To insert : 1336733824 To insert : 1336733825 To insert : 1336733826 To insert : 1336733827 To insert : 1336733828 To insert : 1336733829 To insert : 1336733830 To insert : 1336733831 To insert : 1336733832 To insert : 1336733833 To insert : 1336733834 To insert : 1336733835 To insert : 1336733836 To insert : 1336733837 To insert : 1336733838 To insert : 1336733839 To insert : 1336733840 To insert : 1336733841 To insert : 1336733842 To insert : 1336733847 To insert : 1336733848 To insert : 1336733849 To insert : 1336733851 To insert : 1336733852 To insert : 1336733853 To insert : 1336733854 To insert : 1336733855 To insert : 1336733856 To insert : 1336733857 To insert : 1336733858 To insert : 1336733859 To insert : 1336733860 To insert : 1336733861 To insert : 1336733862 To insert : 1336733863 To insert : 1336733864 To insert : 1336733865 To insert : 1336733866 To insert : 1336733867 To insert : 1336733775 To insert : 1336733776 To insert : 1336733778 To insert : 1336733779 To insert : 1336733780 To insert : 1336733781 To insert : 1336733782 To insert : 1336733783 To insert : 1336733784 To insert : 1336733785 To insert : 1336733786 To insert : 1336733787 To insert : 1336733788 To insert : 1336733789 To insert : 1336733790 To insert : 1336733791 To insert : 1336733792 To insert : 1336733793 To insert : 1336733795 To insert : 1336733797 To insert : 1336733798 To insert : 1336733799 To insert : 1336733800 To insert : 1336733801 To insert : 1336733802 To insert : 1336733803 To insert : 1336733804 To insert : 1336733685 To insert : 1336733686 To insert : 1336733687 To insert : 1336733688 To insert : 1336733689 To insert : 1336733690 To insert : 1336733691 To insert : 1336733692 To insert : 1336733693 To insert : 1336733694 To insert : 1336733695 To insert : 1336733696 To insert : 1336733697 To insert : 1336733698 To insert : 1336733699 To insert : 1336733700 To insert : 1336733701 To insert : 1336733702 To insert : 1336733703 To insert : 1336733704 To insert : 1336733705 To insert : 1336733706 To insert : 1336733708 To insert : 1336733710 To insert : 1336733711 To insert : 1336733712 To insert : 1336733713 To insert : 1336733743 To insert : 1336733744 To insert : 1336733746 To insert : 1336733747 To insert : 1336733748 To insert : 1336733749 To insert : 1336733750 To insert : 1336733751 To insert : 1336733752 To insert : 1336733753 To insert : 1336733754 To insert : 1336733755 To insert : 1336733756 To insert : 1336733759 To insert : 1336733760 To insert : 1336733761 To insert : 1336733762 To insert : 1336733763 To insert : 1336733764 To insert : 1336733765 To insert : 1336733766 To insert : 1336733767 To insert : 1336733768 To insert : 1336733769 To insert : 1336733772 To insert : 1336733773 To insert : 1336733774 time to insert the descriptors : 51.68316388130188 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 388 time used for this insertion : 0.0795736312866211 save missing photos in datou_result : time spend for datou_step_exec : 60.408021688461304 time spend to save output : 0.13808059692382812 total time spend for step 6 : 60.54610228538513 step7:ventilate_hashtags_in_portfolio Tue Feb 11 07:23:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20430845 get user id for portfolio 20430845 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20430845 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('refus','metal','pet_clair','autre','PET_fonce','pehd','Film_plastique','carton','pet_fonce','PET_clair','Tetrapak','mal_croppe','PEHD','flou','Carton','papier','Papier','environnement')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20430845 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('refus','metal','pet_clair','autre','PET_fonce','pehd','Film_plastique','carton','pet_fonce','PET_clair','Tetrapak','mal_croppe','PEHD','flou','Carton','papier','Papier','environnement')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20430845 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('refus','metal','pet_clair','autre','PET_fonce','pehd','Film_plastique','carton','pet_fonce','PET_clair','Tetrapak','mal_croppe','PEHD','flou','Carton','papier','Papier','environnement')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20430845 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('refus','metal','pet_clair','autre','PET_fonce','pehd','Film_plastique','carton','pet_fonce','PET_clair','Tetrapak','mal_croppe','PEHD','flou','Carton','papier','Papier','environnement')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20431844,20431848,20431865,20431859,20431864,20431868,20431862,20431870,20431866,20431867,20431869,20431872,20431873?tags=refus,metal,pet_clair,autre,pet_fonce,pehd,film_plastique,carton,tetrapak,mal_croppe,flou,papier,environnement&datou_id_consolidate=4235&port_consolidate=20430845 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1336717164] Looping around the photos to save general results len do output : 1 /20430845. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2574893') ('4234', '20430845', '1336717164', None, None, None, None, None, '2574893') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.21727323532104492 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.227605104446411 time spend to save output : 0.2175893783569336 total time spend for step 7 : 4.445194482803345 step8:final Tue Feb 11 07:23:36 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1336717164: ('0.7727293900181432',)} new output for save of step final : {1336717164: ('0.7727293900181432',)} [1336717164] Looping around the photos to save general results len do output : 1 /1336717164.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2574893') ('4234', '20430845', '1336717164', None, None, None, None, None, '2574893') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.013357162475585938 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.3313064575195312 time spend to save output : 0.01358652114868164 total time spend for step 8 : 1.344892978668213 step9:velours_tree Tue Feb 11 07:23:37 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20431844,20431848,20431865,20431859,20431864,20431868,20431862,20431870,20431866,20431867,20431869,20431872,20431873 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20431844 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20431848 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20431865 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20431859 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20431864 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20431868 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20431862 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20431870 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20431866 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20431867 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20431869 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20431872 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20431873 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 265 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [2 2 2 5 2 0 4 2 1 5 2 5 2 2 2 2 0 1 5 0 3 5 2 2 1 0 1 2 2 1 1 2 0 2 0 2 2 5 3 1 0 5 3 1 5 2 0 5 1 1 2 2 2 1 4 1 0 2 1 0 4 2 1 1 2 2 2 0 2 1 2 5 2 3 0 5 4 4 1 1 0 0 0 1 3 0 0 0 3 4 2 2 3 1 0 2 0 0 1 5 0 2 0 5 5 2 0 3 4 2 1 2 0 0 2 0 0 0 5 3 3 0 2 5 5 2 1 0 2 2 2 4 4 4 0 2 2 0 0 0 2 2 2 5 2 2 2 2 2 5 0 2 0 0 1 1 0 1 1 0 1 2 0 1 4 1 2 2 4 2 1 1 5 2 2 0 0 5 0 0 1 0 2 0 0 2 2 5 5 3 1 5 4 2 5 1 1 2 2 0 1 2 1 1 5 5 1 0 0 5 1 1 1 1 1 1 1 1 5 1 3 3 5 0 5 1 4 1 2 1 1 1 5 5 1 1 1 5 1 1 0 1 1 1 1 5 1 4 1 1 0 4 0 0 0 1 5 5 4 5 2 1 2 1 5] Elapsed time: 0.05050468444824219 graph_id used : 77848 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20431844,20431848,20431865,20431859,20431864,20431868,20431862,20431870,20431866,20431867,20431869,20431872,20431873?tags=refus,metal,pet_clair,autre,pet_fonce,pehd,film_plastique,carton,tetrapak,mal_croppe,flou,papier,environnement&datou_id_consolidate=4235&port_consolidate=20430845&tree_id=77848 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1336717164] Looping around the photos to save general results len do output : 1 /20430845Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2574893') ('4234', '20430845', '1336717164', None, None, None, None, None, '2574893') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.011738777160644531 save_final save missing photos in datou_result : time spend for datou_step_exec : 29.989644765853882 time spend to save output : 0.011945724487304688 total time spend for step 9 : 30.001590490341187 step10:send_mail_cod Tue Feb 11 07:24:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20430845_11-02-2025_07_24_07.pdf 20431814 imagette204318141739255047 20431815 change filename to text .change filename to text .imagette204318151739255047 20431823 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette204318231739255047 20431817 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette204318171739255047 20431822 imagette204318221739255049 20431826 imagette204318261739255049 20431820 imagette204318201739255049 20431828 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette204318281739255049 20431824 imagette204318241739255050 20431825 imagette204318251739255050 20431827 imagette204318271739255050 20431830 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette204318301739255050 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20430845 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20431844,20431848,20431865,20431859,20431864,20431868,20431862,20431870,20431866,20431867,20431869,20431872,20431873?tags=refus,metal,pet_clair,autre,pet_fonce,pehd,film_plastique,carton,tetrapak,mal_croppe,flou,papier,environnement&datou_id_consolidate=4235&port_consolidate=20430845&tree_id=77848 your option no_mail is active, we will not send the real mail to your client args[1336717164] : ((1336717164, -8.205989268505697, 492609224), (1336717164, 0.18427272422677046, 2107752395), '0.7727293900181432') apple ((1336717164, -8.205989268505697, 492609224), (1336717164, 0.18427272422677046, 2107752395), '0.7727293900181432') We are sending mail with results at cod@fotonower.com refus_total : 0.7727293900181432 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20430845 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20430845_11-02-2025_07_24_07.pdf results_Qualipapia_P20430845_11-02-2025_07_24_07.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20430845_11-02-2025_07_24_07.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20430845','results_Qualipapia_P20430845_11-02-2025_07_24_07.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20430845_11-02-2025_07_24_07.pdf','pdf','','0.13','0.7727293900181432') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1336717164] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2574893') ('4234', '20430845', '1336717164', None, None, None, None, None, '2574893') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 time used for this insertion : 0.012840747833251953 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.776600360870361 time spend to save output : 0.01300191879272461 total time spend for step 10 : 5.789602279663086 step11:split_time_score Tue Feb 11 07:24:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('20', 1),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 11022025 20430845 Nombre de photos uploadées : 1 / 23040 (0%) 11022025 20430845 Nombre de photos taguées (types de déchets): 0 / 1 (0%) 11022025 20430845 Nombre de photos taguées (volume) : 0 / 1 (0%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 6.198883056640625e-06 ? elapsed_time : fill_and_build_computed_from_old_data 0.00012350082397460938 elapsed_time : insert_dashboard_record_day_entry 0.022875308990478516 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.7363197321183929 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20425505_11-02-2025_03_27_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20425505 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20425505 AND mptpi.`type`=4230 To do Qualite : 0.745515675311924 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20425506_11-02-2025_03_08_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20425506 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20425506 AND mptpi.`type`=4230 To do Qualite : 0.752036522692876 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20426160_11-02-2025_04_18_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20426160 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20426160 AND mptpi.`type`=4230 To do Qualite : 0.7069812432268061 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20426711_11-02-2025_05_07_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20426711 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20426711 AND mptpi.`type`=4230 To do Qualite : 0.7133486600779738 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20428455_11-02-2025_06_08_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20428455 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20428455 AND mptpi.`type`=4230 To do Qualite : 0.7727293900181432 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20430845_11-02-2025_07_24_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20430845 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20430845 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'11022025': {'nb_upload': 1, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1336717164] Looping around the photos to save general results len do output : 1 /20430845Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2574893') ('4234', '20430845', '1336717164', None, None, None, None, None, '2574893') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.011692285537719727 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.534726619720459 time spend to save output : 0.011844873428344727 total time spend for step 11 : 1.5465714931488037 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 40.92user 24.81system 3:50.68elapsed 28%CPU (0avgtext+0avgdata 2482836maxresident)k 1524600inputs+16024outputs (7651major+3852868minor)pagefaults 0swaps