python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3089753 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2640218'] with mtr_portfolio_ids : ['21084544'] and first list_photo_ids : [] new path : /proc/3089753/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.14644837379455566 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Wed Mar 5 22:20:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10372 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-05 22:20:31.795142: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-05 22:20:31.823237: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-05 22:20:31.824732: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f0250000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-05 22:20:31.824785: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-05 22:20:31.827475: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-05 22:20:32.039127: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x140e2ad0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-05 22:20:32.039163: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-05 22:20:32.040095: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-05 22:20:32.040387: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-05 22:20:32.043858: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-05 22:20:32.047816: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-05 22:20:32.048285: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-05 22:20:32.055903: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-05 22:20:32.057390: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-05 22:20:32.065855: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-05 22:20:32.067352: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-05 22:20:32.067448: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-05 22:20:32.068252: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-05 22:20:32.068268: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-05 22:20:32.068278: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-05 22:20:32.069669: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9607 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-05 22:20:32.376548: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-05 22:20:32.376683: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-05 22:20:32.377211: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-05 22:20:32.377233: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-05 22:20:32.377252: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-05 22:20:32.377270: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-05 22:20:32.377287: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-05 22:20:32.377305: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-05 22:20:32.378839: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-05 22:20:32.380386: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-05 22:20:32.380420: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-05 22:20:32.380436: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-05 22:20:32.380449: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-05 22:20:32.380463: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-05 22:20:32.380477: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-05 22:20:32.380491: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-05 22:20:32.380506: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-05 22:20:32.381742: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-05 22:20:32.381786: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-05 22:20:32.381795: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-05 22:20:32.381803: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-05 22:20:32.383117: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9607 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-05 22:20:40.466389: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-05 22:20:40.676409: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 1 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 182.00000 molded_images shape: (1, 640, 640, 3) min: -108.50469 max: 61.38516 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.26250 max: 147.41250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.00011515617370605469 nb_pixel_total : 2762 time to create 1 rle with old method : 0.00491642951965332 length of segment : 64 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 444 time to create 1 rle with old method : 0.0006215572357177734 length of segment : 41 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.79766 max: 150.74844 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 1081 time to create 1 rle with old method : 0.0013637542724609375 length of segment : 30 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 1056 time to create 1 rle with old method : 0.0013432502746582031 length of segment : 39 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 1143 time to create 1 rle with old method : 0.0014443397521972656 length of segment : 43 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 713 time to create 1 rle with old method : 0.0009114742279052734 length of segment : 29 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 2238 time to create 1 rle with old method : 0.0027942657470703125 length of segment : 77 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 1065 time to create 1 rle with old method : 0.001344919204711914 length of segment : 41 time for calcul the mask position with numpy : 0.0002658367156982422 nb_pixel_total : 14051 time to create 1 rle with old method : 0.017264366149902344 length of segment : 117 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.11406 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 27 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 437 time to create 1 rle with old method : 0.0006308555603027344 length of segment : 27 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 231 time to create 1 rle with old method : 0.0003173351287841797 length of segment : 28 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 1113 time to create 1 rle with old method : 0.001495361328125 length of segment : 62 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 1269 time to create 1 rle with old method : 0.0016734600067138672 length of segment : 30 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 368 time to create 1 rle with old method : 0.0005316734313964844 length of segment : 22 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 1337 time to create 1 rle with old method : 0.001672506332397461 length of segment : 47 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 1330 time to create 1 rle with old method : 0.0017118453979492188 length of segment : 32 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 972 time to create 1 rle with old method : 0.0012564659118652344 length of segment : 46 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 2374 time to create 1 rle with old method : 0.003001689910888672 length of segment : 49 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 491 time to create 1 rle with old method : 0.0006716251373291016 length of segment : 31 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 548 time to create 1 rle with old method : 0.0007326602935791016 length of segment : 19 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 664 time to create 1 rle with old method : 0.0008776187896728516 length of segment : 43 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 243 time to create 1 rle with old method : 0.00035452842712402344 length of segment : 25 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 145 time to create 1 rle with old method : 0.0002715587615966797 length of segment : 17 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 899 time to create 1 rle with old method : 0.001088857650756836 length of segment : 34 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 696 time to create 1 rle with old method : 0.0009632110595703125 length of segment : 35 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 1893 time to create 1 rle with old method : 0.002354145050048828 length of segment : 46 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 306 time to create 1 rle with old method : 0.00045800209045410156 length of segment : 22 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 361 time to create 1 rle with old method : 0.0004963874816894531 length of segment : 20 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 1198 time to create 1 rle with old method : 0.0014734268188476562 length of segment : 39 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 199 time to create 1 rle with old method : 0.00031256675720214844 length of segment : 14 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 630 time to create 1 rle with old method : 0.0008838176727294922 length of segment : 24 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 638 time to create 1 rle with old method : 0.0007977485656738281 length of segment : 37 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 344 time to create 1 rle with old method : 0.0004966259002685547 length of segment : 24 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 2284 time to create 1 rle with old method : 0.0026700496673583984 length of segment : 76 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 198 time to create 1 rle with old method : 0.0002894401550292969 length of segment : 15 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 2127 time to create 1 rle with old method : 0.0024433135986328125 length of segment : 74 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.20781 max: 149.42812 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 27 time for calcul the mask position with numpy : 0.00011348724365234375 nb_pixel_total : 3535 time to create 1 rle with old method : 0.0042192935943603516 length of segment : 106 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 677 time to create 1 rle with old method : 0.0009288787841796875 length of segment : 30 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 333 time to create 1 rle with old method : 0.0004642009735107422 length of segment : 28 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 413 time to create 1 rle with old method : 0.0005774497985839844 length of segment : 20 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 802 time to create 1 rle with old method : 0.0010313987731933594 length of segment : 30 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 863 time to create 1 rle with old method : 0.0011153221130371094 length of segment : 41 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 1416 time to create 1 rle with old method : 0.001786947250366211 length of segment : 44 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 243 time to create 1 rle with old method : 0.000347137451171875 length of segment : 22 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 1575 time to create 1 rle with old method : 0.0020537376403808594 length of segment : 46 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 327 time to create 1 rle with old method : 0.0004830360412597656 length of segment : 19 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 223 time to create 1 rle with old method : 0.0003521442413330078 length of segment : 15 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 481 time to create 1 rle with old method : 0.0006966590881347656 length of segment : 27 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 1236 time to create 1 rle with old method : 0.0016489028930664062 length of segment : 29 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 342 time to create 1 rle with old method : 0.0004680156707763672 length of segment : 28 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 1651 time to create 1 rle with old method : 0.002105712890625 length of segment : 38 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 1339 time to create 1 rle with old method : 0.0016658306121826172 length of segment : 55 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 1592 time to create 1 rle with old method : 0.0020046234130859375 length of segment : 41 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 1129 time to create 1 rle with old method : 0.0014562606811523438 length of segment : 39 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 2130 time to create 1 rle with old method : 0.0026247501373291016 length of segment : 44 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 780 time to create 1 rle with old method : 0.0010182857513427734 length of segment : 37 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 277 time to create 1 rle with old method : 0.0004596710205078125 length of segment : 23 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 1639 time to create 1 rle with old method : 0.0021016597747802734 length of segment : 39 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 1536 time to create 1 rle with old method : 0.0021076202392578125 length of segment : 32 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 469 time to create 1 rle with old method : 0.0006775856018066406 length of segment : 19 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 2163 time to create 1 rle with old method : 0.002735614776611328 length of segment : 44 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 215 time to create 1 rle with old method : 0.0003197193145751953 length of segment : 19 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 1240 time to create 1 rle with old method : 0.0016720294952392578 length of segment : 50 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 230.00000 molded_images shape: (1, 640, 640, 3) min: -122.40313 max: 116.39297 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 224 time to create 1 rle with old method : 0.00030732154846191406 length of segment : 30 time for calcul the mask position with numpy : 9.655952453613281e-05 nb_pixel_total : 3264 time to create 1 rle with old method : 0.004015207290649414 length of segment : 145 time for calcul the mask position with numpy : 0.00017833709716796875 nb_pixel_total : 4693 time to create 1 rle with old method : 0.00715327262878418 length of segment : 103 time for calcul the mask position with numpy : 8.0108642578125e-05 nb_pixel_total : 2466 time to create 1 rle with old method : 0.003103017807006836 length of segment : 51 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 152 time to create 1 rle with old method : 0.00022530555725097656 length of segment : 20 time for calcul the mask position with numpy : 0.0001392364501953125 nb_pixel_total : 5443 time to create 1 rle with old method : 0.006666660308837891 length of segment : 68 time for calcul the mask position with numpy : 0.0001544952392578125 nb_pixel_total : 4881 time to create 1 rle with old method : 0.005999565124511719 length of segment : 72 time for calcul the mask position with numpy : 0.00013947486877441406 nb_pixel_total : 4995 time to create 1 rle with old method : 0.006288766860961914 length of segment : 82 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 2514 time to create 1 rle with old method : 0.003073453903198242 length of segment : 52 time for calcul the mask position with numpy : 0.0001227855682373047 nb_pixel_total : 6576 time to create 1 rle with old method : 0.007742881774902344 length of segment : 92 time for calcul the mask position with numpy : 0.00011706352233886719 nb_pixel_total : 5663 time to create 1 rle with old method : 0.006781578063964844 length of segment : 76 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 778 time to create 1 rle with old method : 0.0010561943054199219 length of segment : 33 time for calcul the mask position with numpy : 0.0001430511474609375 nb_pixel_total : 3899 time to create 1 rle with old method : 0.004790306091308594 length of segment : 111 time for calcul the mask position with numpy : 0.0001392364501953125 nb_pixel_total : 2536 time to create 1 rle with old method : 0.004094600677490234 length of segment : 134 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 295 time to create 1 rle with old method : 0.00044846534729003906 length of segment : 33 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 236.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 125.04141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.0001266002655029297 nb_pixel_total : 5453 time to create 1 rle with old method : 0.009166240692138672 length of segment : 162 time for calcul the mask position with numpy : 7.677078247070312e-05 nb_pixel_total : 883 time to create 1 rle with old method : 0.001834869384765625 length of segment : 50 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 220.00000 molded_images shape: (1, 640, 640, 3) min: -122.34063 max: 99.17812 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 621 time to create 1 rle with old method : 0.001336812973022461 length of segment : 29 time for calcul the mask position with numpy : 9.34600830078125e-05 nb_pixel_total : 1920 time to create 1 rle with old method : 0.002743959426879883 length of segment : 81 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.63359 max: 132.59609 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 349 time to create 1 rle with old method : 0.0005245208740234375 length of segment : 21 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 434 time to create 1 rle with old method : 0.0006058216094970703 length of segment : 28 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 394 time to create 1 rle with old method : 0.0005669593811035156 length of segment : 30 time for calcul the mask position with numpy : 0.00012636184692382812 nb_pixel_total : 4833 time to create 1 rle with old method : 0.006376981735229492 length of segment : 90 time for calcul the mask position with numpy : 0.0002758502960205078 nb_pixel_total : 17668 time to create 1 rle with old method : 0.020746231079101562 length of segment : 173 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 1743 time to create 1 rle with old method : 0.0025789737701416016 length of segment : 52 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 98 time to create 1 rle with old method : 0.00024080276489257812 length of segment : 18 time for calcul the mask position with numpy : 0.00030517578125 nb_pixel_total : 17234 time to create 1 rle with old method : 0.02067852020263672 length of segment : 143 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 189 time to create 1 rle with old method : 0.0003116130828857422 length of segment : 50 time for calcul the mask position with numpy : 0.00011348724365234375 nb_pixel_total : 5021 time to create 1 rle with old method : 0.006011486053466797 length of segment : 79 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.71172 max: 149.65078 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 304 time to create 1 rle with old method : 0.000431060791015625 length of segment : 27 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 1011 time to create 1 rle with old method : 0.0013632774353027344 length of segment : 70 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 364 time to create 1 rle with old method : 0.0004799365997314453 length of segment : 40 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 1686 time to create 1 rle with old method : 0.0021822452545166016 length of segment : 41 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 1023 time to create 1 rle with old method : 0.0013158321380615234 length of segment : 60 length of segment : 0 time for calcul the mask position with numpy : 0.00023651123046875 nb_pixel_total : 13775 time to create 1 rle with old method : 0.01590251922607422 length of segment : 106 time for calcul the mask position with numpy : 9.560585021972656e-05 nb_pixel_total : 2868 time to create 1 rle with old method : 0.0062046051025390625 length of segment : 59 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 317 time to create 1 rle with old method : 0.00044465065002441406 length of segment : 22 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 246 time to create 1 rle with old method : 0.00036072731018066406 length of segment : 30 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 115 time to create 1 rle with old method : 0.0001888275146484375 length of segment : 9 time for calcul the mask position with numpy : 0.0001399517059326172 nb_pixel_total : 2616 time to create 1 rle with old method : 0.0033605098724365234 length of segment : 86 time for calcul the mask position with numpy : 0.0007696151733398438 nb_pixel_total : 57781 time to create 1 rle with old method : 0.06458115577697754 length of segment : 410 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 490 time to create 1 rle with old method : 0.0007171630859375 length of segment : 25 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.03984 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 22 time for calcul the mask position with numpy : 8.225440979003906e-05 nb_pixel_total : 1524 time to create 1 rle with old method : 0.002012491226196289 length of segment : 58 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 1278 time to create 1 rle with old method : 0.0017025470733642578 length of segment : 38 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 1318 time to create 1 rle with old method : 0.0017545223236083984 length of segment : 47 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 325 time to create 1 rle with old method : 0.0004885196685791016 length of segment : 23 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 385 time to create 1 rle with old method : 0.0005235671997070312 length of segment : 31 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 268 time to create 1 rle with old method : 0.0004227161407470703 length of segment : 25 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 303 time to create 1 rle with old method : 0.0004863739013671875 length of segment : 14 time for calcul the mask position with numpy : 0.0013551712036132812 nb_pixel_total : 60924 time to create 1 rle with old method : 0.07310652732849121 length of segment : 610 time for calcul the mask position with numpy : 9.775161743164062e-05 nb_pixel_total : 350 time to create 1 rle with old method : 0.00047469139099121094 length of segment : 34 time for calcul the mask position with numpy : 7.987022399902344e-05 nb_pixel_total : 2189 time to create 1 rle with old method : 0.0028030872344970703 length of segment : 71 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 170 time to create 1 rle with old method : 0.00027108192443847656 length of segment : 21 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 826 time to create 1 rle with old method : 0.001085519790649414 length of segment : 27 time for calcul the mask position with numpy : 8.916854858398438e-05 nb_pixel_total : 1357 time to create 1 rle with old method : 0.001852273941040039 length of segment : 50 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 712 time to create 1 rle with old method : 0.0010628700256347656 length of segment : 39 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 1090 time to create 1 rle with old method : 0.0013973712921142578 length of segment : 38 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 536 time to create 1 rle with old method : 0.0007517337799072266 length of segment : 51 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 312 time to create 1 rle with old method : 0.0004456043243408203 length of segment : 24 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 334 time to create 1 rle with old method : 0.0004963874816894531 length of segment : 46 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 266 time to create 1 rle with old method : 0.0004055500030517578 length of segment : 22 time for calcul the mask position with numpy : 9.059906005859375e-05 nb_pixel_total : 3070 time to create 1 rle with old method : 0.0038611888885498047 length of segment : 78 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 418 time to create 1 rle with old method : 0.00054931640625 length of segment : 39 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 935 time to create 1 rle with old method : 0.0012552738189697266 length of segment : 62 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.39922 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 30 time for calcul the mask position with numpy : 8.726119995117188e-05 nb_pixel_total : 1823 time to create 1 rle with old method : 0.002315521240234375 length of segment : 49 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 971 time to create 1 rle with old method : 0.001186370849609375 length of segment : 51 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 559 time to create 1 rle with old method : 0.0007765293121337891 length of segment : 20 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 578 time to create 1 rle with old method : 0.0007770061492919922 length of segment : 28 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 328 time to create 1 rle with old method : 0.0004699230194091797 length of segment : 18 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 276 time to create 1 rle with old method : 0.0003669261932373047 length of segment : 33 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 634 time to create 1 rle with old method : 0.0008661746978759766 length of segment : 42 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 2414 time to create 1 rle with old method : 0.0030531883239746094 length of segment : 57 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 1462 time to create 1 rle with old method : 0.0018999576568603516 length of segment : 42 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 2681 time to create 1 rle with old method : 0.0033025741577148438 length of segment : 87 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 265 time to create 1 rle with old method : 0.0003566741943359375 length of segment : 25 time for calcul the mask position with numpy : 9.894371032714844e-05 nb_pixel_total : 4315 time to create 1 rle with old method : 0.0051801204681396484 length of segment : 64 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 385 time to create 1 rle with old method : 0.0005483627319335938 length of segment : 24 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 1829 time to create 1 rle with old method : 0.0029745101928710938 length of segment : 52 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 832 time to create 1 rle with old method : 0.0011224746704101562 length of segment : 33 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 406 time to create 1 rle with old method : 0.0005743503570556641 length of segment : 25 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 29 time to create 1 rle with old method : 0.00015497207641601562 length of segment : 8 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 778 time to create 1 rle with old method : 0.0010619163513183594 length of segment : 37 time for calcul the mask position with numpy : 8.726119995117188e-05 nb_pixel_total : 2565 time to create 1 rle with old method : 0.003381967544555664 length of segment : 75 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 556 time to create 1 rle with old method : 0.0007166862487792969 length of segment : 31 time for calcul the mask position with numpy : 9.608268737792969e-05 nb_pixel_total : 1710 time to create 1 rle with old method : 0.003258943557739258 length of segment : 39 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 685 time to create 1 rle with old method : 0.0008974075317382812 length of segment : 30 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 98 time to create 1 rle with old method : 0.0001990795135498047 length of segment : 17 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 1798 time to create 1 rle with old method : 0.0022928714752197266 length of segment : 55 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 1984 time to create 1 rle with old method : 0.002468585968017578 length of segment : 41 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 76 time to create 1 rle with old method : 0.0001285076141357422 length of segment : 12 time for calcul the mask position with numpy : 0.0001575946807861328 nb_pixel_total : 9968 time to create 1 rle with old method : 0.01167154312133789 length of segment : 98 time for calcul the mask position with numpy : 0.00018477439880371094 nb_pixel_total : 10714 time to create 1 rle with old method : 0.012521028518676758 length of segment : 110 time for calcul the mask position with numpy : 7.557868957519531e-05 nb_pixel_total : 1813 time to create 1 rle with old method : 0.002276897430419922 length of segment : 55 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 277 time to create 1 rle with old method : 0.0003807544708251953 length of segment : 25 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.21172 max: 141.87344 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 26 time for calcul the mask position with numpy : 8.511543273925781e-05 nb_pixel_total : 1368 time to create 1 rle with old method : 0.001967906951904297 length of segment : 43 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 598 time to create 1 rle with old method : 0.0008156299591064453 length of segment : 36 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 1371 time to create 1 rle with old method : 0.0018732547760009766 length of segment : 53 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 228 time to create 1 rle with old method : 0.00037932395935058594 length of segment : 12 time for calcul the mask position with numpy : 0.0003352165222167969 nb_pixel_total : 17332 time to create 1 rle with old method : 0.023459196090698242 length of segment : 228 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 139 time to create 1 rle with old method : 0.00021386146545410156 length of segment : 19 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 828 time to create 1 rle with old method : 0.0010356903076171875 length of segment : 89 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 553 time to create 1 rle with old method : 0.0006833076477050781 length of segment : 32 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 439 time to create 1 rle with old method : 0.0009052753448486328 length of segment : 33 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 541 time to create 1 rle with old method : 0.0007135868072509766 length of segment : 42 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 443 time to create 1 rle with old method : 0.0006365776062011719 length of segment : 24 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 365 time to create 1 rle with old method : 0.0004916191101074219 length of segment : 21 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 698 time to create 1 rle with old method : 0.0009219646453857422 length of segment : 76 time for calcul the mask position with numpy : 8.893013000488281e-05 nb_pixel_total : 2853 time to create 1 rle with old method : 0.0034646987915039062 length of segment : 79 time for calcul the mask position with numpy : 0.0003800392150878906 nb_pixel_total : 6073 time to create 1 rle with old method : 0.007471799850463867 length of segment : 113 time for calcul the mask position with numpy : 0.0002009868621826172 nb_pixel_total : 1492 time to create 1 rle with old method : 0.0018341541290283203 length of segment : 63 time for calcul the mask position with numpy : 0.0001239776611328125 nb_pixel_total : 735 time to create 1 rle with old method : 0.0014557838439941406 length of segment : 28 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 1654 time to create 1 rle with old method : 0.002197742462158203 length of segment : 33 time for calcul the mask position with numpy : 0.0002014636993408203 nb_pixel_total : 4559 time to create 1 rle with old method : 0.00702977180480957 length of segment : 103 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 231 time to create 1 rle with old method : 0.0003247261047363281 length of segment : 16 time for calcul the mask position with numpy : 0.00023102760314941406 nb_pixel_total : 3376 time to create 1 rle with old method : 0.004182100296020508 length of segment : 113 time for calcul the mask position with numpy : 0.0001304149627685547 nb_pixel_total : 1311 time to create 1 rle with old method : 0.0020728111267089844 length of segment : 57 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 286 time to create 1 rle with old method : 0.0004639625549316406 length of segment : 33 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 1132 time to create 1 rle with old method : 0.0018219947814941406 length of segment : 68 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.00039839744567871094 length of segment : 34 time for calcul the mask position with numpy : 0.0001342296600341797 nb_pixel_total : 3108 time to create 1 rle with old method : 0.0048792362213134766 length of segment : 91 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 137.22891 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 0.0001811981201171875 nb_pixel_total : 9501 time to create 1 rle with old method : 0.01276540756225586 length of segment : 157 time for calcul the mask position with numpy : 0.00011777877807617188 nb_pixel_total : 5156 time to create 1 rle with old method : 0.006957292556762695 length of segment : 104 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 308 time to create 1 rle with old method : 0.0004916191101074219 length of segment : 17 time for calcul the mask position with numpy : 9.512901306152344e-05 nb_pixel_total : 3820 time to create 1 rle with old method : 0.005242347717285156 length of segment : 138 time for calcul the mask position with numpy : 8.368492126464844e-05 nb_pixel_total : 464 time to create 1 rle with old method : 0.0007555484771728516 length of segment : 42 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 338 time to create 1 rle with old method : 0.0004591941833496094 length of segment : 30 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 1266 time to create 1 rle with old method : 0.0017499923706054688 length of segment : 55 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 306 time to create 1 rle with old method : 0.0004508495330810547 length of segment : 31 time for calcul the mask position with numpy : 9.131431579589844e-05 nb_pixel_total : 3284 time to create 1 rle with old method : 0.004502534866333008 length of segment : 125 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.60625 max: 137.04141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 0.00014352798461914062 nb_pixel_total : 1080 time to create 1 rle with old method : 0.002521514892578125 length of segment : 51 time for calcul the mask position with numpy : 0.00011658668518066406 nb_pixel_total : 3575 time to create 1 rle with old method : 0.004458189010620117 length of segment : 79 time for calcul the mask position with numpy : 0.0001423358917236328 nb_pixel_total : 4699 time to create 1 rle with old method : 0.0064487457275390625 length of segment : 93 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 347 time to create 1 rle with old method : 0.0005102157592773438 length of segment : 21 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 337 time to create 1 rle with old method : 0.00045108795166015625 length of segment : 28 time for calcul the mask position with numpy : 0.0003933906555175781 nb_pixel_total : 19725 time to create 1 rle with old method : 0.02302098274230957 length of segment : 313 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 1199 time to create 1 rle with old method : 0.0014719963073730469 length of segment : 40 time for calcul the mask position with numpy : 9.965896606445312e-05 nb_pixel_total : 3607 time to create 1 rle with old method : 0.00441431999206543 length of segment : 78 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 698 time to create 1 rle with old method : 0.0008540153503417969 length of segment : 55 time for calcul the mask position with numpy : 0.0001327991485595703 nb_pixel_total : 1004 time to create 1 rle with old method : 0.0015382766723632812 length of segment : 79 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.14922 max: 150.86562 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 0.00010776519775390625 nb_pixel_total : 2927 time to create 1 rle with old method : 0.0036025047302246094 length of segment : 106 time for calcul the mask position with numpy : 0.0004162788391113281 nb_pixel_total : 30635 time to create 1 rle with old method : 0.03540802001953125 length of segment : 203 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 60 time to create 1 rle with old method : 0.00014519691467285156 length of segment : 20 time for calcul the mask position with numpy : 8.821487426757812e-05 nb_pixel_total : 1482 time to create 1 rle with old method : 0.0020787715911865234 length of segment : 57 time for calcul the mask position with numpy : 0.00016736984252929688 nb_pixel_total : 9226 time to create 1 rle with old method : 0.010900497436523438 length of segment : 157 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 532 time to create 1 rle with old method : 0.0006985664367675781 length of segment : 57 time for calcul the mask position with numpy : 0.00010395050048828125 nb_pixel_total : 3294 time to create 1 rle with old method : 0.004253387451171875 length of segment : 149 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 310 time to create 1 rle with old method : 0.0005018711090087891 length of segment : 33 time for calcul the mask position with numpy : 0.0002655982971191406 nb_pixel_total : 20213 time to create 1 rle with old method : 0.02354288101196289 length of segment : 242 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.02813 max: 151.06484 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 1335 time to create 1 rle with old method : 0.0017108917236328125 length of segment : 37 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 2155 time to create 1 rle with old method : 0.0027446746826171875 length of segment : 54 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.00031566619873046875 length of segment : 23 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 1466 time to create 1 rle with old method : 0.0019283294677734375 length of segment : 38 time for calcul the mask position with numpy : 0.0010526180267333984 nb_pixel_total : 106842 time to create 1 rle with old method : 0.1260061264038086 length of segment : 526 time for calcul the mask position with numpy : 8.058547973632812e-05 nb_pixel_total : 1459 time to create 1 rle with old method : 0.0017864704132080078 length of segment : 82 Processing 1 images image shape: (400, 400, 3) min: 57.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -60.54766 max: 150.01797 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 371 time to create 1 rle with old method : 0.0006353855133056641 length of segment : 30 time for calcul the mask position with numpy : 0.0002415180206298828 nb_pixel_total : 4628 time to create 1 rle with old method : 0.005850553512573242 length of segment : 274 time for calcul the mask position with numpy : 0.0003535747528076172 nb_pixel_total : 15078 time to create 1 rle with old method : 0.018528223037719727 length of segment : 270 time for calcul the mask position with numpy : 0.00013947486877441406 nb_pixel_total : 3244 time to create 1 rle with old method : 0.004351615905761719 length of segment : 56 time for calcul the mask position with numpy : 0.0007350444793701172 nb_pixel_total : 40015 time to create 1 rle with old method : 0.051085472106933594 length of segment : 388 Processing 1 images image shape: (400, 400, 3) min: 16.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -101.73516 max: 150.00625 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 8.0108642578125e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.00038123130798339844 length of segment : 14 time for calcul the mask position with numpy : 0.0002079010009765625 nb_pixel_total : 5144 time to create 1 rle with old method : 0.008151531219482422 length of segment : 57 time for calcul the mask position with numpy : 8.7738037109375e-05 nb_pixel_total : 310 time to create 1 rle with old method : 0.0005192756652832031 length of segment : 30 time for calcul the mask position with numpy : 8.702278137207031e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.0002484321594238281 length of segment : 32 time for calcul the mask position with numpy : 0.00011086463928222656 nb_pixel_total : 1911 time to create 1 rle with old method : 0.0027534961700439453 length of segment : 49 time for calcul the mask position with numpy : 0.0013070106506347656 nb_pixel_total : 94017 time to create 1 rle with old method : 0.11030960083007812 length of segment : 525 time for calcul the mask position with numpy : 0.00013899803161621094 nb_pixel_total : 867 time to create 1 rle with old method : 0.0013310909271240234 length of segment : 61 time for calcul the mask position with numpy : 0.0001163482666015625 nb_pixel_total : 1827 time to create 1 rle with old method : 0.002443552017211914 length of segment : 127 time for calcul the mask position with numpy : 0.00010037422180175781 nb_pixel_total : 1849 time to create 1 rle with old method : 0.0026547908782958984 length of segment : 51 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 772 time to create 1 rle with old method : 0.0010700225830078125 length of segment : 43 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.23516 max: 134.76641 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 343 time to create 1 rle with old method : 0.0007069110870361328 length of segment : 22 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 1362 time to create 1 rle with old method : 0.0023550987243652344 length of segment : 61 time for calcul the mask position with numpy : 0.0011534690856933594 nb_pixel_total : 67170 time to create 1 rle with old method : 0.09331035614013672 length of segment : 436 time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 633 time to create 1 rle with old method : 0.0008480548858642578 length of segment : 53 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 225 time to create 1 rle with old method : 0.00034356117248535156 length of segment : 16 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 1140 time to create 1 rle with old method : 0.0015799999237060547 length of segment : 62 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 1450 time to create 1 rle with old method : 0.0017571449279785156 length of segment : 70 time for calcul the mask position with numpy : 0.00015425682067871094 nb_pixel_total : 3355 time to create 1 rle with old method : 0.004061460494995117 length of segment : 78 time for calcul the mask position with numpy : 9.655952453613281e-05 nb_pixel_total : 3273 time to create 1 rle with old method : 0.003889322280883789 length of segment : 78 time for calcul the mask position with numpy : 7.462501525878906e-05 nb_pixel_total : 1614 time to create 1 rle with old method : 0.0026454925537109375 length of segment : 58 time for calcul the mask position with numpy : 8.606910705566406e-05 nb_pixel_total : 1632 time to create 1 rle with old method : 0.0021288394927978516 length of segment : 57 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 233 time to create 1 rle with old method : 0.0003821849822998047 length of segment : 49 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 365 time to create 1 rle with old method : 0.0004782676696777344 length of segment : 49 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 225.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 100.80938 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 419 time to create 1 rle with old method : 0.0007984638214111328 length of segment : 26 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 709 time to create 1 rle with old method : 0.0012998580932617188 length of segment : 35 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.0004100799560546875 length of segment : 22 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 589 time to create 1 rle with old method : 0.0011131763458251953 length of segment : 38 Processing 1 images image shape: (240, 400, 3) min: 24.00000 max: 216.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 104.44766 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.0003948211669921875 length of segment : 29 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 178 time to create 1 rle with old method : 0.0002675056457519531 length of segment : 19 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 55 time to create 1 rle with old method : 0.00010323524475097656 length of segment : 14 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 1592 time to create 1 rle with old method : 0.0020117759704589844 length of segment : 65 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 1516 time to create 1 rle with old method : 0.001905679702758789 length of segment : 61 Processing 1 images image shape: (240, 400, 3) min: 4.00000 max: 254.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.93203 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 418 time to create 1 rle with old method : 0.0008835792541503906 length of segment : 30 time for calcul the mask position with numpy : 7.987022399902344e-05 nb_pixel_total : 1865 time to create 1 rle with old method : 0.0033783912658691406 length of segment : 38 time for calcul the mask position with numpy : 9.918212890625e-05 nb_pixel_total : 2584 time to create 1 rle with old method : 0.004499197006225586 length of segment : 67 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.00034737586975097656 length of segment : 20 Processing 1 images image shape: (240, 400, 3) min: 39.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.88906 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.00018262863159179688 nb_pixel_total : 9648 time to create 1 rle with old method : 0.012104988098144531 length of segment : 160 time for calcul the mask position with numpy : 0.00011014938354492188 nb_pixel_total : 4091 time to create 1 rle with old method : 0.005382537841796875 length of segment : 74 time for calcul the mask position with numpy : 0.0002562999725341797 nb_pixel_total : 11889 time to create 1 rle with old method : 0.01686716079711914 length of segment : 106 time for calcul the mask position with numpy : 0.0004761219024658203 nb_pixel_total : 30664 time to create 1 rle with old method : 0.036063194274902344 length of segment : 239 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 1622 time to create 1 rle with old method : 0.0020914077758789062 length of segment : 39 time for calcul the mask position with numpy : 0.0003643035888671875 nb_pixel_total : 28435 time to create 1 rle with old method : 0.03298377990722656 length of segment : 218 time for calcul the mask position with numpy : 0.0004677772521972656 nb_pixel_total : 31952 time to create 1 rle with old method : 0.03691244125366211 length of segment : 244 Processing 1 images image shape: (240, 400, 3) min: 160.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0004742145538330078 nb_pixel_total : 45842 time to create 1 rle with old method : 0.05217123031616211 length of segment : 373 Processing 1 images image shape: (240, 400, 3) min: 67.00000 max: 240.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 131.57656 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 810 time to create 1 rle with old method : 0.0010864734649658203 length of segment : 28 time for calcul the mask position with numpy : 8.106231689453125e-05 nb_pixel_total : 2548 time to create 1 rle with old method : 0.0032188892364501953 length of segment : 89 time for calcul the mask position with numpy : 0.0005071163177490234 nb_pixel_total : 42024 time to create 1 rle with old method : 0.05897068977355957 length of segment : 446 time for calcul the mask position with numpy : 0.00010967254638671875 nb_pixel_total : 1512 time to create 1 rle with old method : 0.002007007598876953 length of segment : 58 time for calcul the mask position with numpy : 0.0003752708435058594 nb_pixel_total : 24596 time to create 1 rle with old method : 0.030889034271240234 length of segment : 203 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 203.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 97.97109 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.0004496574401855469 nb_pixel_total : 30454 time to create 1 rle with old method : 0.05021238327026367 length of segment : 242 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 49 time to create 1 rle with old method : 0.0001251697540283203 length of segment : 5 Processing 1 images image shape: (240, 160, 3) min: 25.00000 max: 149.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 39.07359 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 963 time to create 1 rle with old method : 0.0015115737915039062 length of segment : 46 Detection mask done ! Trying to reset tf kernel 3090243 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4505 tf kernel not reseted sub process len(results) : 275 len(list_Values) 275 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 275 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9794 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 319 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 19197 save missing photos in datou_result : time spend for datou_step_exec : 26.245736598968506 time spend to save output : 1.594839334487915 total time spend for step 1 : 27.84057593345642 step2:brightness Wed Mar 5 22:20:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 1 time used for this insertion : 0.007975578308105469 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 1 time used for this insertion : 0.10256409645080566 save missing photos in datou_result : time spend for datou_step_exec : 0.025490760803222656 time spend to save output : 0.11447787284851074 total time spend for step 2 : 0.1399686336517334 step3:blur_detection Wed Mar 5 22:20:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 1 time used for this insertion : 0.009598255157470703 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 1 time used for this insertion : 0.00794076919555664 save missing photos in datou_result : time spend for datou_step_exec : 0.0247499942779541 time spend to save output : 0.022746801376342773 total time spend for step 3 : 0.047496795654296875 step4:rle_unique_nms_with_priority Wed Mar 5 22:20:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 319 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 316 nb_hashtags : 6 time to prepare the origin masks : 13.826965808868408 time for calcul the mask position with numpy : 0.09174919128417969 nb_pixel_total : 2613211 time to create 1 rle with new method : 0.4834153652191162 time for calcul the mask position with numpy : 0.014649629592895508 nb_pixel_total : 2238 time to create 1 rle with old method : 0.0025725364685058594 time for calcul the mask position with numpy : 0.014605998992919922 nb_pixel_total : 12 time to create 1 rle with old method : 5.6743621826171875e-05 time for calcul the mask position with numpy : 0.014672279357910156 nb_pixel_total : 199 time to create 1 rle with old method : 0.00023126602172851562 time for calcul the mask position with numpy : 0.014888286590576172 nb_pixel_total : 277 time to create 1 rle with old method : 0.00034236907958984375 time for calcul the mask position with numpy : 0.014895915985107422 nb_pixel_total : 215 time to create 1 rle with old method : 0.00026106834411621094 time for calcul the mask position with numpy : 0.014442205429077148 nb_pixel_total : 342 time to create 1 rle with old method : 0.00038504600524902344 time for calcul the mask position with numpy : 0.014249086380004883 nb_pixel_total : 4693 time to create 1 rle with old method : 0.004851579666137695 time for calcul the mask position with numpy : 0.013942718505859375 nb_pixel_total : 145 time to create 1 rle with old method : 0.00018787384033203125 time for calcul the mask position with numpy : 0.014228105545043945 nb_pixel_total : 713 time to create 1 rle with old method : 0.0008275508880615234 time for calcul the mask position with numpy : 0.014089822769165039 nb_pixel_total : 696 time to create 1 rle with old method : 0.0007977485656738281 time for calcul the mask position with numpy : 0.014098644256591797 nb_pixel_total : 4881 time to create 1 rle with old method : 0.005542755126953125 time for calcul the mask position with numpy : 0.014897346496582031 nb_pixel_total : 638 time to create 1 rle with old method : 0.0007305145263671875 time for calcul the mask position with numpy : 0.014832019805908203 nb_pixel_total : 223 time to create 1 rle with old method : 0.0002655982971191406 time for calcul the mask position with numpy : 0.015041828155517578 nb_pixel_total : 3535 time to create 1 rle with old method : 0.003903627395629883 time for calcul the mask position with numpy : 0.014542579650878906 nb_pixel_total : 949 time to create 1 rle with old method : 0.001222372055053711 time for calcul the mask position with numpy : 0.014508247375488281 nb_pixel_total : 863 time to create 1 rle with old method : 0.0009357929229736328 time for calcul the mask position with numpy : 0.013872146606445312 nb_pixel_total : 4995 time to create 1 rle with old method : 0.005330324172973633 time for calcul the mask position with numpy : 0.01387929916381836 nb_pixel_total : 6576 time to create 1 rle with old method : 0.0070819854736328125 time for calcul the mask position with numpy : 0.014624357223510742 nb_pixel_total : 52 time to create 1 rle with old method : 0.00014066696166992188 time for calcul the mask position with numpy : 0.014534473419189453 nb_pixel_total : 1236 time to create 1 rle with old method : 0.0013320446014404297 time for calcul the mask position with numpy : 0.014113903045654297 nb_pixel_total : 491 time to create 1 rle with old method : 0.000568389892578125 time for calcul the mask position with numpy : 0.014026165008544922 nb_pixel_total : 19 time to create 1 rle with old method : 4.0531158447265625e-05 time for calcul the mask position with numpy : 0.014057397842407227 nb_pixel_total : 224 time to create 1 rle with old method : 0.0002639293670654297 time for calcul the mask position with numpy : 0.014549732208251953 nb_pixel_total : 1337 time to create 1 rle with old method : 0.0015652179718017578 time for calcul the mask position with numpy : 0.014654397964477539 nb_pixel_total : 444 time to create 1 rle with old method : 0.0005171298980712891 time for calcul the mask position with numpy : 0.015038490295410156 nb_pixel_total : 243 time to create 1 rle with old method : 0.00028514862060546875 time for calcul the mask position with numpy : 0.014843225479125977 nb_pixel_total : 437 time to create 1 rle with old method : 0.0005450248718261719 time for calcul the mask position with numpy : 0.014569997787475586 nb_pixel_total : 1536 time to create 1 rle with old method : 0.001743316650390625 time for calcul the mask position with numpy : 0.013973474502563477 nb_pixel_total : 72 time to create 1 rle with old method : 0.0001342296600341797 time for calcul the mask position with numpy : 0.013907909393310547 nb_pixel_total : 2466 time to create 1 rle with old method : 0.0025742053985595703 time for calcul the mask position with numpy : 0.014876127243041992 nb_pixel_total : 102 time to create 1 rle with old method : 0.00015282630920410156 time for calcul the mask position with numpy : 0.015034914016723633 nb_pixel_total : 780 time to create 1 rle with old method : 0.0008990764617919922 time for calcul the mask position with numpy : 0.01525735855102539 nb_pixel_total : 630 time to create 1 rle with old method : 0.0007686614990234375 time for calcul the mask position with numpy : 0.015420675277709961 nb_pixel_total : 1129 time to create 1 rle with old method : 0.001317739486694336 time for calcul the mask position with numpy : 0.015226125717163086 nb_pixel_total : 306 time to create 1 rle with old method : 0.00041294097900390625 time for calcul the mask position with numpy : 0.01519775390625 nb_pixel_total : 802 time to create 1 rle with old method : 0.0009398460388183594 time for calcul the mask position with numpy : 0.015245199203491211 nb_pixel_total : 5386 time to create 1 rle with old method : 0.006160736083984375 time for calcul the mask position with numpy : 0.015061378479003906 nb_pixel_total : 972 time to create 1 rle with old method : 0.0011665821075439453 time for calcul the mask position with numpy : 0.015049219131469727 nb_pixel_total : 118 time to create 1 rle with old method : 0.00027632713317871094 time for calcul the mask position with numpy : 0.015360116958618164 nb_pixel_total : 229 time to create 1 rle with old method : 0.0003032684326171875 time for calcul the mask position with numpy : 0.015471220016479492 nb_pixel_total : 1897 time to create 1 rle with old method : 0.002248048782348633 time for calcul the mask position with numpy : 0.015125751495361328 nb_pixel_total : 1416 time to create 1 rle with old method : 0.0018334388732910156 time for calcul the mask position with numpy : 0.015282869338989258 nb_pixel_total : 18 time to create 1 rle with old method : 9.703636169433594e-05 time for calcul the mask position with numpy : 0.015228271484375 nb_pixel_total : 52 time to create 1 rle with old method : 0.00013756752014160156 time for calcul the mask position with numpy : 0.015516519546508789 nb_pixel_total : 1143 time to create 1 rle with old method : 0.001336812973022461 time for calcul the mask position with numpy : 0.015438556671142578 nb_pixel_total : 254 time to create 1 rle with old method : 0.00039696693420410156 time for calcul the mask position with numpy : 0.014574289321899414 nb_pixel_total : 3000 time to create 1 rle with old method : 0.0032727718353271484 time for calcul the mask position with numpy : 0.014782190322875977 nb_pixel_total : 5453 time to create 1 rle with old method : 0.005850315093994141 time for calcul the mask position with numpy : 0.014858484268188477 nb_pixel_total : 361 time to create 1 rle with old method : 0.0004432201385498047 time for calcul the mask position with numpy : 0.015418767929077148 nb_pixel_total : 2130 time to create 1 rle with old method : 0.002481698989868164 time for calcul the mask position with numpy : 0.015319108963012695 nb_pixel_total : 21 time to create 1 rle with old method : 0.00011944770812988281 time for calcul the mask position with numpy : 0.015201807022094727 nb_pixel_total : 64 time to create 1 rle with old method : 0.00017499923706054688 time for calcul the mask position with numpy : 0.01529550552368164 nb_pixel_total : 26 time to create 1 rle with old method : 0.00013375282287597656 time for calcul the mask position with numpy : 0.015529632568359375 nb_pixel_total : 1651 time to create 1 rle with old method : 0.001954317092895508 time for calcul the mask position with numpy : 0.015471220016479492 nb_pixel_total : 899 time to create 1 rle with old method : 0.001071929931640625 time for calcul the mask position with numpy : 0.01580214500427246 nb_pixel_total : 327 time to create 1 rle with old method : 0.0004248619079589844 time for calcul the mask position with numpy : 0.015474796295166016 nb_pixel_total : 481 time to create 1 rle with old method : 0.00060272216796875 time for calcul the mask position with numpy : 0.015660762786865234 nb_pixel_total : 1113 time to create 1 rle with old method : 0.0013430118560791016 time for calcul the mask position with numpy : 0.01651930809020996 nb_pixel_total : 3243 time to create 1 rle with old method : 0.005650043487548828 time for calcul the mask position with numpy : 0.016976594924926758 nb_pixel_total : 1034 time to create 1 rle with old method : 0.0013146400451660156 time for calcul the mask position with numpy : 0.015817880630493164 nb_pixel_total : 1081 time to create 1 rle with old method : 0.001260519027709961 time for calcul the mask position with numpy : 0.015659332275390625 nb_pixel_total : 11 time to create 1 rle with old method : 4.863739013671875e-05 time for calcul the mask position with numpy : 0.015605688095092773 nb_pixel_total : 169 time to create 1 rle with old method : 0.00026154518127441406 time for calcul the mask position with numpy : 0.015984296798706055 nb_pixel_total : 14051 time to create 1 rle with old method : 0.01601386070251465 time for calcul the mask position with numpy : 0.015563488006591797 nb_pixel_total : 368 time to create 1 rle with old method : 0.0004630088806152344 time for calcul the mask position with numpy : 0.01545095443725586 nb_pixel_total : 16 time to create 1 rle with old method : 0.0002110004425048828 time for calcul the mask position with numpy : 0.015151500701904297 nb_pixel_total : 344 time to create 1 rle with old method : 0.00047516822814941406 time for calcul the mask position with numpy : 0.015264272689819336 nb_pixel_total : 1339 time to create 1 rle with old method : 0.0017726421356201172 time for calcul the mask position with numpy : 0.01622796058654785 nb_pixel_total : 1330 time to create 1 rle with old method : 0.0015859603881835938 time for calcul the mask position with numpy : 0.01535797119140625 nb_pixel_total : 333 time to create 1 rle with old method : 0.0004410743713378906 time for calcul the mask position with numpy : 0.015306949615478516 nb_pixel_total : 1056 time to create 1 rle with old method : 0.0012450218200683594 time for calcul the mask position with numpy : 0.015131950378417969 nb_pixel_total : 275 time to create 1 rle with old method : 0.00037550926208496094 time for calcul the mask position with numpy : 0.01584625244140625 nb_pixel_total : 24 time to create 1 rle with old method : 8.96453857421875e-05 time for calcul the mask position with numpy : 0.01553034782409668 nb_pixel_total : 2374 time to create 1 rle with old method : 0.0027856826782226562 time for calcul the mask position with numpy : 0.01578378677368164 nb_pixel_total : 548 time to create 1 rle with old method : 0.0006735324859619141 time for calcul the mask position with numpy : 0.015848636627197266 nb_pixel_total : 5 time to create 1 rle with old method : 6.937980651855469e-05 time for calcul the mask position with numpy : 0.015971660614013672 nb_pixel_total : 2284 time to create 1 rle with old method : 0.002680063247680664 time for calcul the mask position with numpy : 0.015592575073242188 nb_pixel_total : 180 time to create 1 rle with old method : 0.00025343894958496094 time for calcul the mask position with numpy : 0.015660524368286133 nb_pixel_total : 308 time to create 1 rle with old method : 0.0004813671112060547 time for calcul the mask position with numpy : 0.015318155288696289 nb_pixel_total : 4224 time to create 1 rle with old method : 0.004762172698974609 time for calcul the mask position with numpy : 0.014941215515136719 nb_pixel_total : 1269 time to create 1 rle with old method : 0.0015201568603515625 time for calcul the mask position with numpy : 0.01506662368774414 nb_pixel_total : 2762 time to create 1 rle with old method : 0.0030460357666015625 time for calcul the mask position with numpy : 0.015002965927124023 nb_pixel_total : 231 time to create 1 rle with old method : 0.00031113624572753906 time for calcul the mask position with numpy : 0.014699459075927734 nb_pixel_total : 677 time to create 1 rle with old method : 0.0009012222290039062 time for calcul the mask position with numpy : 0.015130758285522461 nb_pixel_total : 1592 time to create 1 rle with old method : 0.001695394515991211 time for calcul the mask position with numpy : 0.01526498794555664 nb_pixel_total : 883 time to create 1 rle with old method : 0.001010894775390625 time for calcul the mask position with numpy : 0.015262365341186523 nb_pixel_total : 664 time to create 1 rle with old method : 0.0008859634399414062 time for calcul the mask position with numpy : 0.015284538269042969 nb_pixel_total : 1198 time to create 1 rle with old method : 0.0014348030090332031 time for calcul the mask position with numpy : 0.014667272567749023 nb_pixel_total : 1240 time to create 1 rle with old method : 0.0014595985412597656 time for calcul the mask position with numpy : 0.015070199966430664 nb_pixel_total : 413 time to create 1 rle with old method : 0.0005083084106445312 time for calcul the mask position with numpy : 0.018314361572265625 nb_pixel_total : 64 time to create 1 rle with old method : 0.00014925003051757812 time for calcul the mask position with numpy : 0.015635251998901367 nb_pixel_total : 752 time to create 1 rle with old method : 0.0008697509765625 time for calcul the mask position with numpy : 0.014751434326171875 nb_pixel_total : 437 time to create 1 rle with old method : 0.0004763603210449219 time for calcul the mask position with numpy : 0.014970779418945312 nb_pixel_total : 243 time to create 1 rle with old method : 0.00029850006103515625 time for calcul the mask position with numpy : 0.01496124267578125 nb_pixel_total : 157 time to create 1 rle with old method : 0.00018167495727539062 time for calcul the mask position with numpy : 0.01502084732055664 nb_pixel_total : 213 time to create 1 rle with old method : 0.0002567768096923828 time for calcul the mask position with numpy : 0.015039920806884766 nb_pixel_total : 304 time to create 1 rle with old method : 0.00044274330139160156 time for calcul the mask position with numpy : 0.01508021354675293 nb_pixel_total : 170 time to create 1 rle with old method : 0.00022792816162109375 time for calcul the mask position with numpy : 0.014966487884521484 nb_pixel_total : 385 time to create 1 rle with old method : 0.0004611015319824219 time for calcul the mask position with numpy : 0.015065431594848633 nb_pixel_total : 304 time to create 1 rle with old method : 0.00037789344787597656 time for calcul the mask position with numpy : 0.01493525505065918 nb_pixel_total : 29 time to create 1 rle with old method : 6.961822509765625e-05 time for calcul the mask position with numpy : 0.01449728012084961 nb_pixel_total : 1368 time to create 1 rle with old method : 0.0015833377838134766 time for calcul the mask position with numpy : 0.015200376510620117 nb_pixel_total : 98 time to create 1 rle with old method : 0.00017714500427246094 time for calcul the mask position with numpy : 0.015546798706054688 nb_pixel_total : 149 time to create 1 rle with old method : 0.0003323554992675781 time for calcul the mask position with numpy : 0.015545845031738281 nb_pixel_total : 3376 time to create 1 rle with old method : 0.0039021968841552734 time for calcul the mask position with numpy : 0.015374422073364258 nb_pixel_total : 286 time to create 1 rle with old method : 0.0003764629364013672 time for calcul the mask position with numpy : 0.01614546775817871 nb_pixel_total : 10 time to create 1 rle with old method : 8.940696716308594e-05 time for calcul the mask position with numpy : 0.0158538818359375 nb_pixel_total : 325 time to create 1 rle with old method : 0.00042748451232910156 time for calcul the mask position with numpy : 0.015674829483032227 nb_pixel_total : 559 time to create 1 rle with old method : 0.0006988048553466797 time for calcul the mask position with numpy : 0.015498161315917969 nb_pixel_total : 76 time to create 1 rle with old method : 0.00013756752014160156 time for calcul the mask position with numpy : 0.015541315078735352 nb_pixel_total : 312 time to create 1 rle with old method : 0.0004088878631591797 time for calcul the mask position with numpy : 0.01751708984375 nb_pixel_total : 266 time to create 1 rle with old method : 0.0003688335418701172 time for calcul the mask position with numpy : 0.016964435577392578 nb_pixel_total : 60893 time to create 1 rle with old method : 0.06791019439697266 time for calcul the mask position with numpy : 0.01608419418334961 nb_pixel_total : 364 time to create 1 rle with old method : 0.0004794597625732422 time for calcul the mask position with numpy : 0.015602588653564453 nb_pixel_total : 2552 time to create 1 rle with old method : 0.004200935363769531 time for calcul the mask position with numpy : 0.016602754592895508 nb_pixel_total : 350 time to create 1 rle with old method : 0.0006458759307861328 time for calcul the mask position with numpy : 0.016404151916503906 nb_pixel_total : 55919 time to create 1 rle with old method : 0.06885790824890137 time for calcul the mask position with numpy : 0.015357255935668945 nb_pixel_total : 207 time to create 1 rle with old method : 0.0005354881286621094 time for calcul the mask position with numpy : 0.014781713485717773 nb_pixel_total : 1371 time to create 1 rle with old method : 0.0015115737915039062 time for calcul the mask position with numpy : 0.014983892440795898 nb_pixel_total : 228 time to create 1 rle with old method : 0.0002779960632324219 time for calcul the mask position with numpy : 0.015420198440551758 nb_pixel_total : 189 time to create 1 rle with old method : 0.00025534629821777344 time for calcul the mask position with numpy : 0.01531362533569336 nb_pixel_total : 1710 time to create 1 rle with old method : 0.0019450187683105469 time for calcul the mask position with numpy : 0.01627182960510254 nb_pixel_total : 536 time to create 1 rle with old method : 0.001798868179321289 time for calcul the mask position with numpy : 0.017471790313720703 nb_pixel_total : 2853 time to create 1 rle with old method : 0.004571437835693359 time for calcul the mask position with numpy : 0.01733088493347168 nb_pixel_total : 329 time to create 1 rle with old method : 0.0005905628204345703 time for calcul the mask position with numpy : 0.01724553108215332 nb_pixel_total : 1278 time to create 1 rle with old method : 0.0022025108337402344 time for calcul the mask position with numpy : 0.01687908172607422 nb_pixel_total : 21 time to create 1 rle with old method : 7.414817810058594e-05 time for calcul the mask position with numpy : 0.015221834182739258 nb_pixel_total : 21 time to create 1 rle with old method : 6.747245788574219e-05 time for calcul the mask position with numpy : 0.015259504318237305 nb_pixel_total : 341 time to create 1 rle with old method : 0.0004322528839111328 time for calcul the mask position with numpy : 0.015193939208984375 nb_pixel_total : 406 time to create 1 rle with old method : 0.0005514621734619141 time for calcul the mask position with numpy : 0.01535344123840332 nb_pixel_total : 832 time to create 1 rle with old method : 0.0010035037994384766 time for calcul the mask position with numpy : 0.015710830688476562 nb_pixel_total : 303 time to create 1 rle with old method : 0.00038242340087890625 time for calcul the mask position with numpy : 0.015218734741210938 nb_pixel_total : 1823 time to create 1 rle with old method : 0.0021080970764160156 time for calcul the mask position with numpy : 0.01523137092590332 nb_pixel_total : 1266 time to create 1 rle with old method : 0.0014462471008300781 time for calcul the mask position with numpy : 0.015180349349975586 nb_pixel_total : 553 time to create 1 rle with old method : 0.0006694793701171875 time for calcul the mask position with numpy : 0.015467166900634766 nb_pixel_total : 277 time to create 1 rle with old method : 0.0003387928009033203 time for calcul the mask position with numpy : 0.015624284744262695 nb_pixel_total : 698 time to create 1 rle with old method : 0.0008783340454101562 time for calcul the mask position with numpy : 0.015466690063476562 nb_pixel_total : 578 time to create 1 rle with old method : 0.0006933212280273438 time for calcul the mask position with numpy : 0.015563726425170898 nb_pixel_total : 439 time to create 1 rle with old method : 0.0005328655242919922 time for calcul the mask position with numpy : 0.015093564987182617 nb_pixel_total : 509 time to create 1 rle with old method : 0.0006291866302490234 time for calcul the mask position with numpy : 0.015096426010131836 nb_pixel_total : 268 time to create 1 rle with old method : 0.0003304481506347656 time for calcul the mask position with numpy : 0.015154838562011719 nb_pixel_total : 385 time to create 1 rle with old method : 0.000461578369140625 time for calcul the mask position with numpy : 0.015075445175170898 nb_pixel_total : 1318 time to create 1 rle with old method : 0.0015377998352050781 time for calcul the mask position with numpy : 0.015267372131347656 nb_pixel_total : 18757 time to create 1 rle with old method : 0.021257638931274414 time for calcul the mask position with numpy : 0.015582084655761719 nb_pixel_total : 816 time to create 1 rle with old method : 0.0010788440704345703 time for calcul the mask position with numpy : 0.015287399291992188 nb_pixel_total : 9956 time to create 1 rle with old method : 0.01112508773803711 time for calcul the mask position with numpy : 0.015295982360839844 nb_pixel_total : 4559 time to create 1 rle with old method : 0.005154848098754883 time for calcul the mask position with numpy : 0.017053842544555664 nb_pixel_total : 448 time to create 1 rle with old method : 0.000827789306640625 time for calcul the mask position with numpy : 0.016043663024902344 nb_pixel_total : 634 time to create 1 rle with old method : 0.0007777214050292969 time for calcul the mask position with numpy : 0.015162944793701172 nb_pixel_total : 265 time to create 1 rle with old method : 0.0003159046173095703 time for calcul the mask position with numpy : 0.015165328979492188 nb_pixel_total : 1524 time to create 1 rle with old method : 0.0017673969268798828 time for calcul the mask position with numpy : 0.015513896942138672 nb_pixel_total : 1829 time to create 1 rle with old method : 0.002204418182373047 time for calcul the mask position with numpy : 0.0155181884765625 nb_pixel_total : 629 time to create 1 rle with old method : 0.0007843971252441406 time for calcul the mask position with numpy : 0.015598535537719727 nb_pixel_total : 20 time to create 1 rle with old method : 7.367134094238281e-05 time for calcul the mask position with numpy : 0.015761137008666992 nb_pixel_total : 598 time to create 1 rle with old method : 0.0007333755493164062 time for calcul the mask position with numpy : 0.01577138900756836 nb_pixel_total : 328 time to create 1 rle with old method : 0.0004086494445800781 time for calcul the mask position with numpy : 0.01625204086303711 nb_pixel_total : 1795 time to create 1 rle with old method : 0.002981424331665039 time for calcul the mask position with numpy : 0.017649412155151367 nb_pixel_total : 2666 time to create 1 rle with old method : 0.004330635070800781 time for calcul the mask position with numpy : 0.017575979232788086 nb_pixel_total : 11 time to create 1 rle with old method : 7.224082946777344e-05 time for calcul the mask position with numpy : 0.017528772354125977 nb_pixel_total : 434 time to create 1 rle with old method : 0.0007500648498535156 time for calcul the mask position with numpy : 0.01709437370300293 nb_pixel_total : 1654 time to create 1 rle with old method : 0.0019037723541259766 time for calcul the mask position with numpy : 0.014992237091064453 nb_pixel_total : 556 time to create 1 rle with old method : 0.0006492137908935547 time for calcul the mask position with numpy : 0.014884710311889648 nb_pixel_total : 5156 time to create 1 rle with old method : 0.005914449691772461 time for calcul the mask position with numpy : 0.014873981475830078 nb_pixel_total : 139 time to create 1 rle with old method : 0.0001685619354248047 time for calcul the mask position with numpy : 0.016445636749267578 nb_pixel_total : 1984 time to create 1 rle with old method : 0.0023467540740966797 time for calcul the mask position with numpy : 0.015166282653808594 nb_pixel_total : 26 time to create 1 rle with old method : 7.104873657226562e-05 time for calcul the mask position with numpy : 0.014697074890136719 nb_pixel_total : 338 time to create 1 rle with old method : 0.0003955364227294922 time for calcul the mask position with numpy : 0.014764547348022461 nb_pixel_total : 1492 time to create 1 rle with old method : 0.0016820430755615234 time for calcul the mask position with numpy : 0.014893770217895508 nb_pixel_total : 98 time to create 1 rle with old method : 0.0001418590545654297 time for calcul the mask position with numpy : 0.015349388122558594 nb_pixel_total : 397 time to create 1 rle with old method : 0.0005464553833007812 time for calcul the mask position with numpy : 0.014976739883422852 nb_pixel_total : 455 time to create 1 rle with old method : 0.0005710124969482422 time for calcul the mask position with numpy : 0.015163660049438477 nb_pixel_total : 1686 time to create 1 rle with old method : 0.0019919872283935547 time for calcul the mask position with numpy : 0.015395879745483398 nb_pixel_total : 365 time to create 1 rle with old method : 0.00048828125 time for calcul the mask position with numpy : 0.0157620906829834 nb_pixel_total : 9600 time to create 1 rle with old method : 0.010682821273803711 time for calcul the mask position with numpy : 0.01566934585571289 nb_pixel_total : 443 time to create 1 rle with old method : 0.0005443096160888672 time for calcul the mask position with numpy : 0.015341520309448242 nb_pixel_total : 89 time to create 1 rle with old method : 0.000213623046875 time for calcul the mask position with numpy : 0.015385866165161133 nb_pixel_total : 1011 time to create 1 rle with old method : 0.0012173652648925781 time for calcul the mask position with numpy : 0.015327930450439453 nb_pixel_total : 64 time to create 1 rle with old method : 9.846687316894531e-05 time for calcul the mask position with numpy : 0.015469551086425781 nb_pixel_total : 44 time to create 1 rle with old method : 0.00016927719116210938 time for calcul the mask position with numpy : 0.015677928924560547 nb_pixel_total : 1764 time to create 1 rle with old method : 0.0020477771759033203 time for calcul the mask position with numpy : 0.01580810546875 nb_pixel_total : 4315 time to create 1 rle with old method : 0.0048809051513671875 time for calcul the mask position with numpy : 0.015898942947387695 nb_pixel_total : 399 time to create 1 rle with old method : 0.0006248950958251953 time for calcul the mask position with numpy : 0.015346050262451172 nb_pixel_total : 2565 time to create 1 rle with old method : 0.003106355667114258 time for calcul the mask position with numpy : 0.015268325805664062 nb_pixel_total : 4833 time to create 1 rle with old method : 0.0056493282318115234 time for calcul the mask position with numpy : 0.01526784896850586 nb_pixel_total : 2616 time to create 1 rle with old method : 0.00360107421875 time for calcul the mask position with numpy : 0.016112089157104492 nb_pixel_total : 44 time to create 1 rle with old method : 0.000141143798828125 time for calcul the mask position with numpy : 0.015828847885131836 nb_pixel_total : 31 time to create 1 rle with old method : 0.00015687942504882812 time for calcul the mask position with numpy : 0.016314983367919922 nb_pixel_total : 1798 time to create 1 rle with old method : 0.0021317005157470703 time for calcul the mask position with numpy : 0.01590561866760254 nb_pixel_total : 62 time to create 1 rle with old method : 0.00017642974853515625 time for calcul the mask position with numpy : 0.015332937240600586 nb_pixel_total : 17332 time to create 1 rle with old method : 0.025178909301757812 time for calcul the mask position with numpy : 0.01717853546142578 nb_pixel_total : 541 time to create 1 rle with old method : 0.0006868839263916016 time for calcul the mask position with numpy : 0.015625 nb_pixel_total : 464 time to create 1 rle with old method : 0.0005903244018554688 time for calcul the mask position with numpy : 0.015547513961791992 nb_pixel_total : 6047 time to create 1 rle with old method : 0.006836891174316406 time for calcul the mask position with numpy : 0.015024423599243164 nb_pixel_total : 653 time to create 1 rle with old method : 0.0009419918060302734 time for calcul the mask position with numpy : 0.015403270721435547 nb_pixel_total : 17668 time to create 1 rle with old method : 0.020977497100830078 time for calcul the mask position with numpy : 0.015095710754394531 nb_pixel_total : 143 time to create 1 rle with old method : 0.0003414154052734375 time for calcul the mask position with numpy : 0.014778375625610352 nb_pixel_total : 2414 time to create 1 rle with old method : 0.00273895263671875 time for calcul the mask position with numpy : 0.014668464660644531 nb_pixel_total : 778 time to create 1 rle with old method : 0.0009355545043945312 time for calcul the mask position with numpy : 0.014546632766723633 nb_pixel_total : 62 time to create 1 rle with old method : 0.0002334117889404297 time for calcul the mask position with numpy : 0.014496088027954102 nb_pixel_total : 1462 time to create 1 rle with old method : 0.0016553401947021484 time for calcul the mask position with numpy : 0.014775514602661133 nb_pixel_total : 828 time to create 1 rle with old method : 0.0009267330169677734 time for calcul the mask position with numpy : 0.014812231063842773 nb_pixel_total : 17 time to create 1 rle with old method : 5.221366882324219e-05 time for calcul the mask position with numpy : 0.014777183532714844 nb_pixel_total : 13775 time to create 1 rle with old method : 0.015556097030639648 time for calcul the mask position with numpy : 0.015105247497558594 nb_pixel_total : 3 time to create 1 rle with old method : 4.363059997558594e-05 time for calcul the mask position with numpy : 0.014864921569824219 nb_pixel_total : 246 time to create 1 rle with old method : 0.0003070831298828125 time for calcul the mask position with numpy : 0.014892578125 nb_pixel_total : 94 time to create 1 rle with old method : 0.0002410411834716797 time for calcul the mask position with numpy : 0.014774560928344727 nb_pixel_total : 1969 time to create 1 rle with old method : 0.002201080322265625 time for calcul the mask position with numpy : 0.014662027359008789 nb_pixel_total : 394 time to create 1 rle with old method : 0.0007877349853515625 time for calcul the mask position with numpy : 0.014370918273925781 nb_pixel_total : 19 time to create 1 rle with old method : 4.839897155761719e-05 time for calcul the mask position with numpy : 0.014834165573120117 nb_pixel_total : 1767 time to create 1 rle with old method : 0.0020809173583984375 time for calcul the mask position with numpy : 0.015817880630493164 nb_pixel_total : 3796 time to create 1 rle with old method : 0.006112098693847656 time for calcul the mask position with numpy : 0.017545461654663086 nb_pixel_total : 310 time to create 1 rle with old method : 0.0006215572357177734 time for calcul the mask position with numpy : 0.017529726028442383 nb_pixel_total : 971 time to create 1 rle with old method : 0.0015904903411865234 time for calcul the mask position with numpy : 0.017829179763793945 nb_pixel_total : 1357 time to create 1 rle with old method : 0.0022726058959960938 time for calcul the mask position with numpy : 0.01812458038330078 nb_pixel_total : 317 time to create 1 rle with old method : 0.0005500316619873047 time for calcul the mask position with numpy : 0.020040273666381836 nb_pixel_total : 1023 time to create 1 rle with old method : 0.0016641616821289062 time for calcul the mask position with numpy : 0.022954940795898438 nb_pixel_total : 265 time to create 1 rle with old method : 0.000362396240234375 time for calcul the mask position with numpy : 0.01528310775756836 nb_pixel_total : 1311 time to create 1 rle with old method : 0.0015301704406738281 time for calcul the mask position with numpy : 0.015107393264770508 nb_pixel_total : 490 time to create 1 rle with old method : 0.0011451244354248047 time for calcul the mask position with numpy : 0.015188932418823242 nb_pixel_total : 712 time to create 1 rle with old method : 0.00083160400390625 time for calcul the mask position with numpy : 0.015285253524780273 nb_pixel_total : 703 time to create 1 rle with old method : 0.0008633136749267578 time for calcul the mask position with numpy : 0.015421390533447266 nb_pixel_total : 1090 time to create 1 rle with old method : 0.0016965866088867188 time for calcul the mask position with numpy : 0.015272140502929688 nb_pixel_total : 605 time to create 1 rle with old method : 0.0007188320159912109 time for calcul the mask position with numpy : 0.016475677490234375 nb_pixel_total : 735 time to create 1 rle with old method : 0.0013022422790527344 time for calcul the mask position with numpy : 0.018241167068481445 nb_pixel_total : 32 time to create 1 rle with old method : 0.00012636184692382812 time for calcul the mask position with numpy : 0.01562666893005371 nb_pixel_total : 308 time to create 1 rle with old method : 0.0004057884216308594 time for calcul the mask position with numpy : 0.01526188850402832 nb_pixel_total : 115 time to create 1 rle with old method : 0.00017642974853515625 time for calcul the mask position with numpy : 0.015587568283081055 nb_pixel_total : 233 time to create 1 rle with old method : 0.00031685829162597656 time for calcul the mask position with numpy : 0.015412092208862305 nb_pixel_total : 225 time to create 1 rle with old method : 0.0002911090850830078 time for calcul the mask position with numpy : 0.017653226852416992 nb_pixel_total : 67170 time to create 1 rle with old method : 0.08080434799194336 time for calcul the mask position with numpy : 0.014925241470336914 nb_pixel_total : 1482 time to create 1 rle with old method : 0.0017719268798828125 time for calcul the mask position with numpy : 0.015117883682250977 nb_pixel_total : 4612 time to create 1 rle with old method : 0.00532221794128418 time for calcul the mask position with numpy : 0.015517234802246094 nb_pixel_total : 633 time to create 1 rle with old method : 0.0007603168487548828 time for calcul the mask position with numpy : 0.015091896057128906 nb_pixel_total : 807 time to create 1 rle with old method : 0.001008749008178711 time for calcul the mask position with numpy : 0.01602792739868164 nb_pixel_total : 88097 time to create 1 rle with old method : 0.09656500816345215 time for calcul the mask position with numpy : 0.01502680778503418 nb_pixel_total : 3355 time to create 1 rle with old method : 0.0036907196044921875 time for calcul the mask position with numpy : 0.014856100082397461 nb_pixel_total : 59 time to create 1 rle with old method : 0.0001354217529296875 time for calcul the mask position with numpy : 0.015008211135864258 nb_pixel_total : 19352 time to create 1 rle with old method : 0.022449016571044922 time for calcul the mask position with numpy : 0.01442575454711914 nb_pixel_total : 371 time to create 1 rle with old method : 0.0004391670227050781 time for calcul the mask position with numpy : 0.014669656753540039 nb_pixel_total : 60 time to create 1 rle with old method : 9.298324584960938e-05 time for calcul the mask position with numpy : 0.014784097671508789 nb_pixel_total : 113 time to create 1 rle with old method : 0.000141143798828125 time for calcul the mask position with numpy : 0.01620650291442871 nb_pixel_total : 105563 time to create 1 rle with old method : 0.14331293106079102 time for calcul the mask position with numpy : 0.01461029052734375 nb_pixel_total : 635 time to create 1 rle with old method : 0.0008995532989501953 time for calcul the mask position with numpy : 0.014934539794921875 nb_pixel_total : 1335 time to create 1 rle with old method : 0.0015578269958496094 time for calcul the mask position with numpy : 0.015121221542358398 nb_pixel_total : 1112 time to create 1 rle with old method : 0.0012912750244140625 time for calcul the mask position with numpy : 0.01465606689453125 nb_pixel_total : 429 time to create 1 rle with old method : 0.00054168701171875 time for calcul the mask position with numpy : 0.014790058135986328 nb_pixel_total : 1827 time to create 1 rle with old method : 0.0021877288818359375 time for calcul the mask position with numpy : 0.014954090118408203 nb_pixel_total : 4 time to create 1 rle with old method : 3.409385681152344e-05 time for calcul the mask position with numpy : 0.014814138412475586 nb_pixel_total : 146 time to create 1 rle with old method : 0.00020885467529296875 time for calcul the mask position with numpy : 0.015321731567382812 nb_pixel_total : 1593 time to create 1 rle with old method : 0.001850128173828125 time for calcul the mask position with numpy : 0.015483379364013672 nb_pixel_total : 15078 time to create 1 rle with old method : 0.017017126083374023 time for calcul the mask position with numpy : 0.015246152877807617 nb_pixel_total : 1463 time to create 1 rle with old method : 0.0017440319061279297 time for calcul the mask position with numpy : 0.014927387237548828 nb_pixel_total : 19 time to create 1 rle with old method : 5.435943603515625e-05 time for calcul the mask position with numpy : 0.014961957931518555 nb_pixel_total : 118 time to create 1 rle with old method : 0.00016951560974121094 time for calcul the mask position with numpy : 0.01484370231628418 nb_pixel_total : 2155 time to create 1 rle with old method : 0.0025069713592529297 time for calcul the mask position with numpy : 0.014911413192749023 nb_pixel_total : 1911 time to create 1 rle with old method : 0.0021321773529052734 time for calcul the mask position with numpy : 0.014841079711914062 nb_pixel_total : 78 time to create 1 rle with old method : 0.0001366138458251953 time for calcul the mask position with numpy : 0.015138864517211914 nb_pixel_total : 532 time to create 1 rle with old method : 0.00063323974609375 time for calcul the mask position with numpy : 0.015125513076782227 nb_pixel_total : 3244 time to create 1 rle with old method : 0.0036776065826416016 time for calcul the mask position with numpy : 0.01513218879699707 nb_pixel_total : 5144 time to create 1 rle with old method : 0.00583338737487793 time for calcul the mask position with numpy : 0.015404701232910156 nb_pixel_total : 310 time to create 1 rle with old method : 0.0004382133483886719 time for calcul the mask position with numpy : 0.015135049819946289 nb_pixel_total : 1140 time to create 1 rle with old method : 0.0013515949249267578 time for calcul the mask position with numpy : 0.015265464782714844 nb_pixel_total : 40004 time to create 1 rle with old method : 0.0449070930480957 time for calcul the mask position with numpy : 0.014862537384033203 nb_pixel_total : 350 time to create 1 rle with old method : 0.0006542205810546875 time for calcul the mask position with numpy : 0.014886856079101562 nb_pixel_total : 310 time to create 1 rle with old method : 0.0003933906555175781 time for calcul the mask position with numpy : 0.014981746673583984 nb_pixel_total : 9138 time to create 1 rle with old method : 0.010730743408203125 time for calcul the mask position with numpy : 0.015157461166381836 nb_pixel_total : 419 time to create 1 rle with old method : 0.0004885196685791016 time for calcul the mask position with numpy : 0.015295743942260742 nb_pixel_total : 347 time to create 1 rle with old method : 0.00042176246643066406 time for calcul the mask position with numpy : 0.015320777893066406 nb_pixel_total : 30635 time to create 1 rle with old method : 0.03367185592651367 time for calcul the mask position with numpy : 0.015340566635131836 nb_pixel_total : 134 time to create 1 rle with old method : 0.00026154518127441406 time for calcul the mask position with numpy : 0.015037298202514648 nb_pixel_total : 3575 time to create 1 rle with old method : 0.003902435302734375 time for calcul the mask position with numpy : 0.014815092086791992 nb_pixel_total : 232 time to create 1 rle with old method : 0.0003859996795654297 time for calcul the mask position with numpy : 0.014539003372192383 nb_pixel_total : 4699 time to create 1 rle with old method : 0.005282163619995117 time for calcul the mask position with numpy : 0.014870643615722656 nb_pixel_total : 719 time to create 1 rle with old method : 0.0009126663208007812 time for calcul the mask position with numpy : 0.014163494110107422 nb_pixel_total : 2927 time to create 1 rle with old method : 0.0036325454711914062 time for calcul the mask position with numpy : 0.014652013778686523 nb_pixel_total : 1004 time to create 1 rle with old method : 0.0011403560638427734 time for calcul the mask position with numpy : 0.01490330696105957 nb_pixel_total : 343 time to create 1 rle with old method : 0.00041604042053222656 time for calcul the mask position with numpy : 0.014580488204956055 nb_pixel_total : 589 time to create 1 rle with old method : 0.0006320476531982422 time for calcul the mask position with numpy : 0.014737844467163086 nb_pixel_total : 454 time to create 1 rle with old method : 0.0005292892456054688 time for calcul the mask position with numpy : 0.014916658401489258 nb_pixel_total : 4 time to create 1 rle with old method : 3.409385681152344e-05 time for calcul the mask position with numpy : 0.014887809753417969 nb_pixel_total : 204 time to create 1 rle with old method : 0.00025177001953125 time for calcul the mask position with numpy : 0.015039205551147461 nb_pixel_total : 658 time to create 1 rle with old method : 0.0007712841033935547 time for calcul the mask position with numpy : 0.014867544174194336 nb_pixel_total : 337 time to create 1 rle with old method : 0.0003581047058105469 time for calcul the mask position with numpy : 0.014538288116455078 nb_pixel_total : 1 time to create 1 rle with old method : 1.2159347534179688e-05 time for calcul the mask position with numpy : 0.014740467071533203 nb_pixel_total : 1362 time to create 1 rle with old method : 0.0015382766723632812 time for calcul the mask position with numpy : 0.014701366424560547 nb_pixel_total : 709 time to create 1 rle with old method : 0.0008127689361572266 time for calcul the mask position with numpy : 0.014676809310913086 nb_pixel_total : 1080 time to create 1 rle with old method : 0.0012390613555908203 time for calcul the mask position with numpy : 0.015503168106079102 nb_pixel_total : 1199 time to create 1 rle with old method : 0.0014383792877197266 time for calcul the mask position with numpy : 0.01517796516418457 nb_pixel_total : 963 time to create 1 rle with old method : 0.0011119842529296875 time for calcul the mask position with numpy : 0.015134572982788086 nb_pixel_total : 283 time to create 1 rle with old method : 0.00034618377685546875 time for calcul the mask position with numpy : 0.015077829360961914 nb_pixel_total : 178 time to create 1 rle with old method : 0.0002315044403076172 time for calcul the mask position with numpy : 0.015166282653808594 nb_pixel_total : 13881 time to create 1 rle with old method : 0.015560150146484375 time for calcul the mask position with numpy : 0.01558995246887207 nb_pixel_total : 30454 time to create 1 rle with old method : 0.03495669364929199 time for calcul the mask position with numpy : 0.014779329299926758 nb_pixel_total : 11889 time to create 1 rle with old method : 0.013091087341308594 time for calcul the mask position with numpy : 0.014965057373046875 nb_pixel_total : 1592 time to create 1 rle with old method : 0.0017223358154296875 time for calcul the mask position with numpy : 0.014986515045166016 nb_pixel_total : 55 time to create 1 rle with old method : 9.1552734375e-05 time for calcul the mask position with numpy : 0.014558792114257812 nb_pixel_total : 1295 time to create 1 rle with old method : 0.0015530586242675781 time for calcul the mask position with numpy : 0.014930963516235352 nb_pixel_total : 131 time to create 1 rle with old method : 0.0003452301025390625 time for calcul the mask position with numpy : 0.014898061752319336 nb_pixel_total : 98 time to create 1 rle with old method : 0.00016546249389648438 time for calcul the mask position with numpy : 0.01525425910949707 nb_pixel_total : 46100 time to create 1 rle with old method : 0.05057644844055176 time for calcul the mask position with numpy : 0.015470504760742188 nb_pixel_total : 41990 time to create 1 rle with old method : 0.046662092208862305 time for calcul the mask position with numpy : 0.015297651290893555 nb_pixel_total : 30664 time to create 1 rle with old method : 0.03444409370422363 time for calcul the mask position with numpy : 0.015597820281982422 nb_pixel_total : 234 time to create 1 rle with old method : 0.0006396770477294922 time for calcul the mask position with numpy : 0.015259265899658203 nb_pixel_total : 193 time to create 1 rle with old method : 0.0004169940948486328 time for calcul the mask position with numpy : 0.01593780517578125 nb_pixel_total : 49 time to create 1 rle with old method : 0.00017070770263671875 time for calcul the mask position with numpy : 0.01637864112854004 nb_pixel_total : 2584 time to create 1 rle with old method : 0.0029616355895996094 time for calcul the mask position with numpy : 0.015291929244995117 nb_pixel_total : 9648 time to create 1 rle with old method : 0.010738134384155273 time for calcul the mask position with numpy : 0.015001535415649414 nb_pixel_total : 324 time to create 1 rle with old method : 0.0005011558532714844 time for calcul the mask position with numpy : 0.014923095703125 nb_pixel_total : 162 time to create 1 rle with old method : 0.00019669532775878906 time for calcul the mask position with numpy : 0.014919042587280273 nb_pixel_total : 2548 time to create 1 rle with old method : 0.0028836727142333984 time for calcul the mask position with numpy : 0.014926671981811523 nb_pixel_total : 4091 time to create 1 rle with old method : 0.00460505485534668 time for calcul the mask position with numpy : 0.015040874481201172 nb_pixel_total : 1388 time to create 1 rle with old method : 0.0016300678253173828 time for calcul the mask position with numpy : 0.015440225601196289 nb_pixel_total : 1622 time to create 1 rle with old method : 0.002667665481567383 time for calcul the mask position with numpy : 0.017270326614379883 nb_pixel_total : 418 time to create 1 rle with old method : 0.0007088184356689453 time for calcul the mask position with numpy : 0.017231225967407227 nb_pixel_total : 1865 time to create 1 rle with old method : 0.003034353256225586 time for calcul the mask position with numpy : 0.017657756805419922 nb_pixel_total : 810 time to create 1 rle with old method : 0.0013358592987060547 create new chi : 6.742316484451294 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0197293758392334 batch 1 Loaded 349 chid ids of type : 4230 Number RLEs to save : 37898 TO DO : save crop sub photo not yet done ! save time : 2.9022881984710693 map_output_result : {1341058473: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1341058473] Looping around the photos to save general results len do output : 1 /1341058473.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2640218') ('4234', '21084544', '1341058473', None, None, None, None, None, '2640218') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.012324094772338867 save_final save missing photos in datou_result : time spend for datou_step_exec : 24.23635745048523 time spend to save output : 0.012816429138183594 total time spend for step 4 : 24.249173879623413 step5:crop_condition Wed Mar 5 22:21:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 1 ! batch 1 Loaded 349 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 184 About to insert : list_path_to_insert length 184 new photo from crops ! About to upload 184 photos upload in portfolio : 4869462 init cache_photo without model_param we have 184 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741209687_3089753 we have uploaded 184 photos in the portfolio 4869462 time of upload the photos Elapsed time : 66.00304627418518 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 50 About to insert : list_path_to_insert length 50 new photo from crops ! About to upload 50 photos upload in portfolio : 4869462 init cache_photo without model_param we have 50 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741209755_3089753 we have uploaded 50 photos in the portfolio 4869462 time of upload the photos Elapsed time : 12.258711576461792 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741209767_3089753 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.5149247646331787 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 13 About to insert : list_path_to_insert length 13 new photo from crops ! About to upload 13 photos upload in portfolio : 4869462 init cache_photo without model_param we have 13 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741209769_3089753 we have uploaded 13 photos in the portfolio 4869462 time of upload the photos Elapsed time : 3.230055570602417 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 4869462 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741209772_3089753 we have uploaded 8 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.857041358947754 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1341058473] Looping around the photos to save general results len do output : 256 /1341108242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108477Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108527Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108528Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108542Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108583Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108584Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108585Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108586Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108587Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108597Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108600Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108601Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341108604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2640218') ('4234', '21084544', '1341058473', None, None, None, None, None, '2640218') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 769 time used for this insertion : 0.04571413993835449 save_final save missing photos in datou_result : time spend for datou_step_exec : 93.61356711387634 time spend to save output : 0.08960652351379395 total time spend for step 5 : 93.70317363739014 step6:thcl Wed Mar 5 22:22:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.01022028923034668 time to convert the images to numpy array : 0.08249163627624512 time to import caffe and check if the image exist : 0.019992351531982422 time to convert the images to numpy array : 0.07102823257446289 time to import caffe and check if the image exist : 0.01734185218811035 time to convert the images to numpy array : 0.07583403587341309 time to import caffe and check if the image exist : 0.026686429977416992 time to convert the images to numpy array : 0.06719303131103516 time to import caffe and check if the image exist : 0.017749547958374023 time to convert the images to numpy array : 0.07605195045471191 time to import caffe and check if the image exist : 0.015040159225463867 time to convert the images to numpy array : 0.07856202125549316 time to import caffe and check if the image exist : 0.024888038635253906 time to convert the images to numpy array : 0.0764462947845459 time to import caffe and check if the image exist : 0.027279138565063477 time to convert the images to numpy array : 0.07715106010437012 time to import caffe and check if the image exist : 0.02373671531677246 time to convert the images to numpy array : 0.08929753303527832 time to import caffe and check if the image exist : 0.025962114334106445 time to convert the images to numpy array : 0.08887863159179688 total time to convert the images to numpy array : 0.5476360321044922 list photo_ids error: [] list photo_ids correct : [1341108242, 1341108243, 1341108244, 1341108245, 1341108246, 1341108247, 1341108248, 1341108249, 1341108250, 1341108251, 1341108252, 1341108253, 1341108254, 1341108255, 1341108256, 1341108257, 1341108258, 1341108259, 1341108260, 1341108261, 1341108263, 1341108264, 1341108265, 1341108267, 1341108268, 1341108269, 1341108517, 1341108518, 1341108520, 1341108521, 1341108523, 1341108524, 1341108525, 1341108527, 1341108528, 1341108529, 1341108530, 1341108531, 1341108532, 1341108533, 1341108534, 1341108536, 1341108537, 1341108538, 1341108539, 1341108540, 1341108541, 1341108542, 1341108543, 1341108545, 1341108546, 1341108547, 1341108548, 1341108576, 1341108578, 1341108579, 1341108580, 1341108581, 1341108582, 1341108583, 1341108584, 1341108585, 1341108586, 1341108587, 1341108588, 1341108589, 1341108597, 1341108598, 1341108599, 1341108600, 1341108601, 1341108602, 1341108603, 1341108604, 1341108324, 1341108325, 1341108326, 1341108327, 1341108328, 1341108329, 1341108330, 1341108331, 1341108332, 1341108333, 1341108334, 1341108335, 1341108336, 1341108337, 1341108339, 1341108340, 1341108341, 1341108342, 1341108343, 1341108344, 1341108345, 1341108346, 1341108348, 1341108350, 1341108351, 1341108352, 1341108476, 1341108477, 1341108493, 1341108494, 1341108495, 1341108496, 1341108497, 1341108498, 1341108499, 1341108500, 1341108501, 1341108502, 1341108503, 1341108504, 1341108505, 1341108506, 1341108507, 1341108508, 1341108509, 1341108510, 1341108511, 1341108512, 1341108513, 1341108514, 1341108515, 1341108516, 1341108442, 1341108443, 1341108444, 1341108445, 1341108446, 1341108448, 1341108449, 1341108450, 1341108451, 1341108452, 1341108453, 1341108454, 1341108455, 1341108456, 1341108457, 1341108458, 1341108459, 1341108460, 1341108461, 1341108462, 1341108463, 1341108466, 1341108468, 1341108471, 1341108473, 1341108474, 1341108353, 1341108354, 1341108355, 1341108356, 1341108357, 1341108358, 1341108359, 1341108360, 1341108361, 1341108362, 1341108365, 1341108366, 1341108367, 1341108368, 1341108370, 1341108371, 1341108372, 1341108373, 1341108374, 1341108375, 1341108377, 1341108378, 1341108379, 1341108381, 1341108384, 1341108386, 1341108388, 1341108390, 1341108392, 1341108395, 1341108397, 1341108399, 1341108403, 1341108405, 1341108406, 1341108408, 1341108410, 1341108412, 1341108415, 1341108417, 1341108419, 1341108424, 1341108428, 1341108431, 1341108432, 1341108433, 1341108434, 1341108435, 1341108438, 1341108439, 1341108440, 1341108441, 1341108297, 1341108298, 1341108299, 1341108300, 1341108301, 1341108302, 1341108303, 1341108304, 1341108305, 1341108306, 1341108307, 1341108308, 1341108309, 1341108311, 1341108312, 1341108313, 1341108314, 1341108315, 1341108316, 1341108317, 1341108318, 1341108319, 1341108320, 1341108321, 1341108322, 1341108323, 1341108270, 1341108271, 1341108272, 1341108273, 1341108274, 1341108275, 1341108276, 1341108277, 1341108278, 1341108279, 1341108280, 1341108281, 1341108282, 1341108283, 1341108284, 1341108285, 1341108286, 1341108287, 1341108288, 1341108289, 1341108290, 1341108291, 1341108293, 1341108294, 1341108295, 1341108296] number of photos to traite : 256 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10372 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10153 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 1.3597538471221924 time used to do the prediction : 1.1688473224639893 save descriptor for thcl : 3237 time to traite the descriptors : 1.4585940837860107 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1341108242 To insert : 1341108243 To insert : 1341108244 To insert : 1341108245 To insert : 1341108246 To insert : 1341108247 To insert : 1341108248 To insert : 1341108249 To insert : 1341108250 To insert : 1341108251 To insert : 1341108252 To insert : 1341108253 To insert : 1341108254 To insert : 1341108255 To insert : 1341108256 To insert : 1341108257 To insert : 1341108258 To insert : 1341108259 To insert : 1341108260 To insert : 1341108261 To insert : 1341108263 To insert : 1341108264 To insert : 1341108265 To insert : 1341108267 To insert : 1341108268 To insert : 1341108269 To insert : 1341108517 To insert : 1341108518 To insert : 1341108520 To insert : 1341108521 To insert : 1341108523 To insert : 1341108524 To insert : 1341108525 To insert : 1341108527 To insert : 1341108528 To insert : 1341108529 To insert : 1341108530 To insert : 1341108531 To insert : 1341108532 To insert : 1341108533 To insert : 1341108534 To insert : 1341108536 To insert : 1341108537 To insert : 1341108538 To insert : 1341108539 To insert : 1341108540 To insert : 1341108541 To insert : 1341108542 To insert : 1341108543 To insert : 1341108545 To insert : 1341108546 To insert : 1341108547 To insert : 1341108548 To insert : 1341108576 To insert : 1341108578 To insert : 1341108579 To insert : 1341108580 To insert : 1341108581 To insert : 1341108582 To insert : 1341108583 To insert : 1341108584 To insert : 1341108585 To insert : 1341108586 To insert : 1341108587 To insert : 1341108588 To insert : 1341108589 To insert : 1341108597 To insert : 1341108598 To insert : 1341108599 To insert : 1341108600 To insert : 1341108601 To insert : 1341108602 To insert : 1341108603 To insert : 1341108604 To insert : 1341108324 To insert : 1341108325 To insert : 1341108326 To insert : 1341108327 To insert : 1341108328 To insert : 1341108329 To insert : 1341108330 To insert : 1341108331 To insert : 1341108332 To insert : 1341108333 To insert : 1341108334 To insert : 1341108335 To insert : 1341108336 To insert : 1341108337 To insert : 1341108339 To insert : 1341108340 To insert : 1341108341 To insert : 1341108342 To insert : 1341108343 To insert : 1341108344 To insert : 1341108345 To insert : 1341108346 To insert : 1341108348 To insert : 1341108350 To insert : 1341108351 To insert : 1341108352 To insert : 1341108476 To insert : 1341108477 To insert : 1341108493 To insert : 1341108494 To insert : 1341108495 To insert : 1341108496 To insert : 1341108497 To insert : 1341108498 To insert : 1341108499 To insert : 1341108500 To insert : 1341108501 To insert : 1341108502 To insert : 1341108503 To insert : 1341108504 To insert : 1341108505 To insert : 1341108506 To insert : 1341108507 To insert : 1341108508 To insert : 1341108509 To insert : 1341108510 To insert : 1341108511 To insert : 1341108512 To insert : 1341108513 To insert : 1341108514 To insert : 1341108515 To insert : 1341108516 To insert : 1341108442 To insert : 1341108443 To insert : 1341108444 To insert : 1341108445 To insert : 1341108446 To insert : 1341108448 To insert : 1341108449 To insert : 1341108450 To insert : 1341108451 To insert : 1341108452 To insert : 1341108453 To insert : 1341108454 To insert : 1341108455 To insert : 1341108456 To insert : 1341108457 To insert : 1341108458 To insert : 1341108459 To insert : 1341108460 To insert : 1341108461 To insert : 1341108462 To insert : 1341108463 To insert : 1341108466 To insert : 1341108468 To insert : 1341108471 To insert : 1341108473 To insert : 1341108474 To insert : 1341108353 To insert : 1341108354 To insert : 1341108355 To insert : 1341108356 To insert : 1341108357 To insert : 1341108358 To insert : 1341108359 To insert : 1341108360 To insert : 1341108361 To insert : 1341108362 To insert : 1341108365 To insert : 1341108366 To insert : 1341108367 To insert : 1341108368 To insert : 1341108370 To insert : 1341108371 To insert : 1341108372 To insert : 1341108373 To insert : 1341108374 To insert : 1341108375 To insert : 1341108377 To insert : 1341108378 To insert : 1341108379 To insert : 1341108381 To insert : 1341108384 To insert : 1341108386 To insert : 1341108388 To insert : 1341108390 To insert : 1341108392 To insert : 1341108395 To insert : 1341108397 To insert : 1341108399 To insert : 1341108403 To insert : 1341108405 To insert : 1341108406 To insert : 1341108408 To insert : 1341108410 To insert : 1341108412 To insert : 1341108415 To insert : 1341108417 To insert : 1341108419 To insert : 1341108424 To insert : 1341108428 To insert : 1341108431 To insert : 1341108432 To insert : 1341108433 To insert : 1341108434 To insert : 1341108435 To insert : 1341108438 To insert : 1341108439 To insert : 1341108440 To insert : 1341108441 To insert : 1341108297 To insert : 1341108298 To insert : 1341108299 To insert : 1341108300 To insert : 1341108301 To insert : 1341108302 To insert : 1341108303 To insert : 1341108304 To insert : 1341108305 To insert : 1341108306 To insert : 1341108307 To insert : 1341108308 To insert : 1341108309 To insert : 1341108311 To insert : 1341108312 To insert : 1341108313 To insert : 1341108314 To insert : 1341108315 To insert : 1341108316 To insert : 1341108317 To insert : 1341108318 To insert : 1341108319 To insert : 1341108320 To insert : 1341108321 To insert : 1341108322 To insert : 1341108323 To insert : 1341108270 To insert : 1341108271 To insert : 1341108272 To insert : 1341108273 To insert : 1341108274 To insert : 1341108275 To insert : 1341108276 To insert : 1341108277 To insert : 1341108278 To insert : 1341108279 To insert : 1341108280 To insert : 1341108281 To insert : 1341108282 To insert : 1341108283 To insert : 1341108284 To insert : 1341108285 To insert : 1341108286 To insert : 1341108287 To insert : 1341108288 To insert : 1341108289 To insert : 1341108290 To insert : 1341108291 To insert : 1341108293 To insert : 1341108294 To insert : 1341108295 To insert : 1341108296 time to insert the descriptors : 43.71751117706299 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 388 time used for this insertion : 0.033991336822509766 save missing photos in datou_result : time spend for datou_step_exec : 52.611348390579224 time spend to save output : 0.08632373809814453 total time spend for step 6 : 52.69767212867737 step7:ventilate_hashtags_in_portfolio Wed Mar 5 22:23:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 21084544 get user id for portfolio 21084544 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21084544 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','PET_clair','metal','Carton','pehd','environnement','Tetrapak','flou','PEHD','Papier','pet_fonce','mal_croppe','autre','carton','Film_plastique','pet_clair','PET_fonce','refus')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21084544 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','PET_clair','metal','Carton','pehd','environnement','Tetrapak','flou','PEHD','Papier','pet_fonce','mal_croppe','autre','carton','Film_plastique','pet_clair','PET_fonce','refus')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21084544 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','PET_clair','metal','Carton','pehd','environnement','Tetrapak','flou','PEHD','Papier','pet_fonce','mal_croppe','autre','carton','Film_plastique','pet_clair','PET_fonce','refus')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21084544 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','PET_clair','metal','Carton','pehd','environnement','Tetrapak','flou','PEHD','Papier','pet_fonce','mal_croppe','autre','carton','Film_plastique','pet_clair','PET_fonce','refus')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/21085419,21085425,21085412,21085423,21085418,21085415,21085416,21085417,21085426,21085421,21085422,21085424,21085427?tags=papier,pet_clair,metal,carton,pehd,environnement,tetrapak,flou,pet_fonce,mal_croppe,autre,film_plastique,refus&datou_id_consolidate=4235&port_consolidate=21084544 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1341058473] Looping around the photos to save general results len do output : 1 /21084544. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2640218') ('4234', '21084544', '1341058473', None, None, None, None, None, '2640218') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.012969970703125 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.5031111240386963 time spend to save output : 0.013256072998046875 total time spend for step 7 : 2.516367197036743 step8:final Wed Mar 5 22:23:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1341058473: ('0.4659738191290256',)} new output for save of step final : {1341058473: ('0.4659738191290256',)} [1341058473] Looping around the photos to save general results len do output : 1 /1341058473.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2640218') ('4234', '21084544', '1341058473', None, None, None, None, None, '2640218') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.013181447982788086 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12234234809875488 time spend to save output : 0.013500690460205078 total time spend for step 8 : 0.13584303855895996 step9:velours_tree Wed Mar 5 22:23:49 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 21085419,21085425,21085412,21085423,21085418,21085415,21085416,21085417,21085426,21085421,21085422,21085424,21085427 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21085419 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21085425 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21085412 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21085423 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21085418 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21085415 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21085416 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21085417 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21085426 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21085421 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21085422 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21085424 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21085427 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 256 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [4 4 4 4 0 0 3 1 3 3 2 3 5 0 4 1 4 4 4 4 3 0 4 2 1 1 0 1 2 4 1 0 0 2 0 0 4 1 2 4 2 4 1 3 3 0 1 0 0 5 5 1 0 3 0 0 4 3 0 0 4 0 4 1 0 0 0 0 1 3 0 5 2 2 1 0 4 2 0 0 4 0 0 3 2 0 5 3 0 0 3 5 4 0 4 1 2 4 4 4 4 4 4 4 5 3 1 1 1 2 4 0 0 4 0 2 4 3 5 2 0 3 4 0 4 2 2 4 4 4 4 3 0 4 4 0 0 3 3 4 0 4 4 1 4 2 0 0 0 3 1 1 4 4 3 0 3 4 0 0 4 1 3 0 0 1 4 1 3 3 4 0 2 2 4 2 4 1 0 3 4 4 4 4 3 4 1 1 0 4 4 2 4 2 4 2 4 4 3 4 3 3 5 4 0 4 4 4 4 3 2 0 4 0 4 0 4 1 0 1 1 3 4 4 1 4 4 2 4 4 5 3 1 3 2 5 0 0 0 0 0 1 5 5 3 0 0 1 1 1 4 3 4 0 3 1] Elapsed time: 0.04652285575866699 graph_id used : 81649 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/21085419,21085425,21085412,21085423,21085418,21085415,21085416,21085417,21085426,21085421,21085422,21085424,21085427?tags=papier,pet_clair,metal,carton,pehd,environnement,tetrapak,flou,pet_fonce,mal_croppe,autre,film_plastique,refus&datou_id_consolidate=4235&port_consolidate=21084544&tree_id=81649 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1341058473] Looping around the photos to save general results len do output : 1 /21084544Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2640218') ('4234', '21084544', '1341058473', None, None, None, None, None, '2640218') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.012700319290161133 save_final save missing photos in datou_result : time spend for datou_step_exec : 15.283886194229126 time spend to save output : 0.013058900833129883 total time spend for step 9 : 15.296945095062256 step10:send_mail_cod Wed Mar 5 22:24:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P21084544_05-03-2025_22_24_05.pdf 21085401 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette210854011741209845 21085407 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette210854071741209846 21085394 change filename to text .imagette210853941741209846 21085405 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette210854051741209846 21085400 imagette210854001741209847 21085398 imagette210853981741209847 21085399 imagette210853991741209847 21085408 imagette210854081741209847 21085403 imagette210854031741209847 21085404 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette210854041741209847 21085406 imagette210854061741209848 21085409 imagette210854091741209848 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=21084544 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/21085419,21085425,21085412,21085423,21085418,21085415,21085416,21085417,21085426,21085421,21085422,21085424,21085427?tags=papier,pet_clair,metal,carton,pehd,environnement,tetrapak,flou,pet_fonce,mal_croppe,autre,film_plastique,refus&datou_id_consolidate=4235&port_consolidate=21084544&tree_id=81649 your option no_mail is active, we will not send the real mail to your client args[1341058473] : ((1341058473, -6.324776911401073, 492609224), (1341058473, 0.004743730413884303, 2107752395), '0.4659738191290256') We are sending mail with results at cod@fotonower.com refus_total : 0.4659738191290256 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21084544 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21084544_05-03-2025_22_24_05.pdf results_Qualipapia_P21084544_05-03-2025_22_24_05.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21084544_05-03-2025_22_24_05.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','21084544','results_Qualipapia_P21084544_05-03-2025_22_24_05.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21084544_05-03-2025_22_24_05.pdf','pdf','','0.13','0.4659738191290256') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1341058473] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2640218') ('4234', '21084544', '1341058473', None, None, None, None, None, '2640218') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 time used for this insertion : 0.014309406280517578 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.069439172744751 time spend to save output : 0.014470815658569336 total time spend for step 10 : 4.08390998840332 step11:split_time_score Wed Mar 5 22:24:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('20', 1),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 05032025 21084544 Nombre de photos uploadées : 1 / 23040 (0%) 05032025 21084544 Nombre de photos taguées (types de déchets): 0 / 1 (0%) 05032025 21084544 Nombre de photos taguées (volume) : 0 / 1 (0%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ? elapsed_time : fill_and_build_computed_from_old_data 0.00013184547424316406 elapsed_time : insert_dashboard_record_day_entry 0.029544591903686523 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21084512 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21084514 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21084516 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21084518 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21084520 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21084522 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21084524 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21084526 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21084528 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21084530 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21084532 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21084534 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21084536 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21084538 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21084540 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21084542 order by id desc limit 1 Qualite : 0.4659738191290256 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21084544_05-03-2025_22_24_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21084544 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21084544 AND mptpi.`type`=4230 To do Qualite : 0.4989465775403058 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21084562 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21084562 AND mptpi.`type`=4230 To do Qualite : 0.550997955859275 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21084563_05-03-2025_22_02_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21084563 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21084563 AND mptpi.`type`=4230 To do Qualite : 0.601010052759507 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21084564_05-03-2025_22_09_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21084564 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21084564 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'05032025': {'nb_upload': 1, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1341058473] Looping around the photos to save general results len do output : 1 /21084544Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2640218') ('4234', '21084544', '1341058473', None, None, None, None, None, '2640218') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.012660026550292969 save_final save missing photos in datou_result : time spend for datou_step_exec : 13.894163846969604 time spend to save output : 0.012930154800415039 total time spend for step 11 : 13.90709400177002 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 54.25user 30.31system 3:57.64elapsed 35%CPU (0avgtext+0avgdata 2486228maxresident)k 920144inputs+24192outputs (3004major+3995146minor)pagefaults 0swaps