python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3074870 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2648334'] with mtr_portfolio_ids : ['21141655'] and first list_photo_ids : [] new path : /proc/3074870/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 2 ; length of list_pids : 2 ; length of list_args : 2 time to download the photos : 0.21800732612609863 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Fri Mar 7 14:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10372 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-07 14:20:31.977215: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-07 14:20:32.003117: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-07 14:20:32.004852: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fb338000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-07 14:20:32.004914: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-07 14:20:32.008058: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-07 14:20:32.279121: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xb69ddf0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-07 14:20:32.279183: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-07 14:20:32.280450: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-07 14:20:32.280963: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-07 14:20:32.284982: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-07 14:20:32.288544: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-07 14:20:32.289138: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-07 14:20:32.292613: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-07 14:20:32.294446: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-07 14:20:32.299569: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-07 14:20:32.301173: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-07 14:20:32.301254: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-07 14:20:32.302044: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-07 14:20:32.302064: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-07 14:20:32.302077: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-07 14:20:32.303520: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9607 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-07 14:20:32.591257: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-07 14:20:32.591355: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-07 14:20:32.591379: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-07 14:20:32.591401: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-07 14:20:32.591421: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-07 14:20:32.591441: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-07 14:20:32.591461: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-07 14:20:32.591482: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-07 14:20:32.592874: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-07 14:20:32.594294: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-07 14:20:32.594344: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-07 14:20:32.594361: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-07 14:20:32.594375: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-07 14:20:32.594389: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-07 14:20:32.594403: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-07 14:20:32.594417: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-07 14:20:32.594432: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-07 14:20:32.595710: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-07 14:20:32.595747: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-07 14:20:32.595756: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-07 14:20:32.595764: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-07 14:20:32.597126: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9607 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-07 14:20:41.542152: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-07 14:20:41.772275: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 2 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.53203 max: 148.85781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 0.0001533031463623047 nb_pixel_total : 381 time to create 1 rle with old method : 0.0010199546813964844 length of segment : 34 time for calcul the mask position with numpy : 9.965896606445312e-05 nb_pixel_total : 554 time to create 1 rle with old method : 0.0016353130340576172 length of segment : 56 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 290 time to create 1 rle with old method : 0.0007953643798828125 length of segment : 46 time for calcul the mask position with numpy : 8.511543273925781e-05 nb_pixel_total : 186 time to create 1 rle with old method : 0.000438690185546875 length of segment : 24 time for calcul the mask position with numpy : 0.00011396408081054688 nb_pixel_total : 1078 time to create 1 rle with old method : 0.002426624298095703 length of segment : 57 time for calcul the mask position with numpy : 9.655952453613281e-05 nb_pixel_total : 895 time to create 1 rle with old method : 0.0020182132720947266 length of segment : 56 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 16 time to create 1 rle with old method : 9.393692016601562e-05 length of segment : 14 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 13 time to create 1 rle with old method : 5.984306335449219e-05 length of segment : 5 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 14 time to create 1 rle with old method : 6.461143493652344e-05 length of segment : 8 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 98 time to create 1 rle with old method : 0.00022482872009277344 length of segment : 24 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.39922 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 1059 time to create 1 rle with old method : 0.0014142990112304688 length of segment : 74 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 437 time to create 1 rle with old method : 0.0006694793701171875 length of segment : 45 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 175 time to create 1 rle with old method : 0.00028586387634277344 length of segment : 34 time for calcul the mask position with numpy : 8.487701416015625e-05 nb_pixel_total : 2446 time to create 1 rle with old method : 0.0033867359161376953 length of segment : 47 time for calcul the mask position with numpy : 8.177757263183594e-05 nb_pixel_total : 659 time to create 1 rle with old method : 0.0010073184967041016 length of segment : 43 Processing 1 images image shape: (400, 400, 3) min: 13.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -98.59453 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 655 time to create 1 rle with old method : 0.0010700225830078125 length of segment : 24 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 1648 time to create 1 rle with old method : 0.002705097198486328 length of segment : 26 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.31328 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 351 time to create 1 rle with old method : 0.0005207061767578125 length of segment : 24 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 466 time to create 1 rle with old method : 0.0006923675537109375 length of segment : 24 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 793 time to create 1 rle with old method : 0.0010800361633300781 length of segment : 34 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 150 time to create 1 rle with old method : 0.0002770423889160156 length of segment : 19 time for calcul the mask position with numpy : 0.00010752677917480469 nb_pixel_total : 2317 time to create 1 rle with old method : 0.006299734115600586 length of segment : 116 time for calcul the mask position with numpy : 0.00010251998901367188 nb_pixel_total : 1653 time to create 1 rle with old method : 0.0020971298217773438 length of segment : 93 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.04141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 523 time to create 1 rle with old method : 0.0008358955383300781 length of segment : 16 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 139 time to create 1 rle with old method : 0.00025272369384765625 length of segment : 22 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 1034 time to create 1 rle with old method : 0.0015649795532226562 length of segment : 50 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 968 time to create 1 rle with old method : 0.0014786720275878906 length of segment : 66 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 431 time to create 1 rle with old method : 0.0007317066192626953 length of segment : 24 time for calcul the mask position with numpy : 0.0007421970367431641 nb_pixel_total : 46995 time to create 1 rle with old method : 0.08039283752441406 length of segment : 264 Processing 1 images image shape: (400, 400, 3) min: 16.00000 max: 242.00000 molded_images shape: (1, 640, 640, 3) min: -94.14531 max: 110.70937 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -107.04375 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.0006270408630371094 length of segment : 19 time for calcul the mask position with numpy : 8.296966552734375e-05 nb_pixel_total : 241 time to create 1 rle with old method : 0.0004291534423828125 length of segment : 19 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 648 time to create 1 rle with old method : 0.0009732246398925781 length of segment : 31 Processing 1 images image shape: (400, 400, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -103.99922 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 0.0002071857452392578 nb_pixel_total : 4496 time to create 1 rle with old method : 0.007298946380615234 length of segment : 56 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 411 time to create 1 rle with old method : 0.0006940364837646484 length of segment : 18 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 48 time to create 1 rle with old method : 0.00015425682067871094 length of segment : 6 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 318 time to create 1 rle with old method : 0.0005204677581787109 length of segment : 14 time for calcul the mask position with numpy : 8.225440979003906e-05 nb_pixel_total : 664 time to create 1 rle with old method : 0.0011324882507324219 length of segment : 31 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 414 time to create 1 rle with old method : 0.0007369518280029297 length of segment : 30 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 674 time to create 1 rle with old method : 0.0009829998016357422 length of segment : 35 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 359 time to create 1 rle with old method : 0.0006241798400878906 length of segment : 24 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 453 time to create 1 rle with old method : 0.0007755756378173828 length of segment : 15 time for calcul the mask position with numpy : 0.00017547607421875 nb_pixel_total : 3729 time to create 1 rle with old method : 0.005614280700683594 length of segment : 96 time for calcul the mask position with numpy : 0.00010013580322265625 nb_pixel_total : 737 time to create 1 rle with old method : 0.0014107227325439453 length of segment : 40 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.00038504600524902344 length of segment : 13 time for calcul the mask position with numpy : 0.00020313262939453125 nb_pixel_total : 5707 time to create 1 rle with old method : 0.009702920913696289 length of segment : 205 time for calcul the mask position with numpy : 8.106231689453125e-05 nb_pixel_total : 656 time to create 1 rle with old method : 0.0012202262878417969 length of segment : 29 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.56719 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 236 time to create 1 rle with old method : 0.0004062652587890625 length of segment : 13 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 301 time to create 1 rle with old method : 0.0004646778106689453 length of segment : 19 time for calcul the mask position with numpy : 8.893013000488281e-05 nb_pixel_total : 1845 time to create 1 rle with old method : 0.002363443374633789 length of segment : 114 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 1979 time to create 1 rle with old method : 0.002609729766845703 length of segment : 47 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 354 time to create 1 rle with old method : 0.0005230903625488281 length of segment : 21 time for calcul the mask position with numpy : 0.00010561943054199219 nb_pixel_total : 1713 time to create 1 rle with old method : 0.002106189727783203 length of segment : 110 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.0003654956817626953 length of segment : 16 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 371 time to create 1 rle with old method : 0.0005872249603271484 length of segment : 21 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 773 time to create 1 rle with old method : 0.0010569095611572266 length of segment : 29 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 1132 time to create 1 rle with old method : 0.0015676021575927734 length of segment : 37 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 345 time to create 1 rle with old method : 0.0006299018859863281 length of segment : 16 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 245.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 128.17031 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 0.00010848045349121094 nb_pixel_total : 676 time to create 1 rle with old method : 0.0015439987182617188 length of segment : 71 time for calcul the mask position with numpy : 0.00020313262939453125 nb_pixel_total : 3673 time to create 1 rle with old method : 0.00513911247253418 length of segment : 142 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 498 time to create 1 rle with old method : 0.0009717941284179688 length of segment : 31 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 599 time to create 1 rle with old method : 0.0008511543273925781 length of segment : 38 time for calcul the mask position with numpy : 0.00012111663818359375 nb_pixel_total : 3603 time to create 1 rle with old method : 0.0065152645111083984 length of segment : 126 time for calcul the mask position with numpy : 0.00012135505676269531 nb_pixel_total : 3613 time to create 1 rle with old method : 0.004805803298950195 length of segment : 128 time for calcul the mask position with numpy : 8.034706115722656e-05 nb_pixel_total : 1275 time to create 1 rle with old method : 0.0017502307891845703 length of segment : 63 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 617 time to create 1 rle with old method : 0.0010547637939453125 length of segment : 44 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 610 time to create 1 rle with old method : 0.0008068084716796875 length of segment : 43 time for calcul the mask position with numpy : 0.0002720355987548828 nb_pixel_total : 4341 time to create 1 rle with old method : 0.005697488784790039 length of segment : 216 time for calcul the mask position with numpy : 0.00011944770812988281 nb_pixel_total : 1490 time to create 1 rle with old method : 0.002291440963745117 length of segment : 69 Processing 1 images image shape: (280, 400, 3) min: 11.00000 max: 215.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 92.25625 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.001088857650756836 nb_pixel_total : 105321 time to create 1 rle with old method : 0.13105154037475586 length of segment : 284 time for calcul the mask position with numpy : 8.368492126464844e-05 nb_pixel_total : 664 time to create 1 rle with old method : 0.0009632110595703125 length of segment : 71 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 233 time to create 1 rle with old method : 0.00041222572326660156 length of segment : 14 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 615 time to create 1 rle with old method : 0.0008823871612548828 length of segment : 39 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 1023 time to create 1 rle with old method : 0.0014111995697021484 length of segment : 44 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 922 time to create 1 rle with old method : 0.001325368881225586 length of segment : 62 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 578 time to create 1 rle with old method : 0.0009562969207763672 length of segment : 27 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 219 time to create 1 rle with old method : 0.0003235340118408203 length of segment : 18 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 486 time to create 1 rle with old method : 0.0007276535034179688 length of segment : 24 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 966 time to create 1 rle with old method : 0.0014564990997314453 length of segment : 36 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.00032782554626464844 length of segment : 18 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 312 time to create 1 rle with old method : 0.0004825592041015625 length of segment : 23 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 229 time to create 1 rle with old method : 0.00035190582275390625 length of segment : 20 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 285 time to create 1 rle with old method : 0.00047779083251953125 length of segment : 22 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 28 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 466 time to create 1 rle with old method : 0.0007660388946533203 length of segment : 22 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 271 time to create 1 rle with old method : 0.00042819976806640625 length of segment : 20 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 849 time to create 1 rle with old method : 0.001165151596069336 length of segment : 41 time for calcul the mask position with numpy : 8.225440979003906e-05 nb_pixel_total : 1412 time to create 1 rle with old method : 0.0018780231475830078 length of segment : 60 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 232 time to create 1 rle with old method : 0.0003337860107421875 length of segment : 25 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 789 time to create 1 rle with old method : 0.0012269020080566406 length of segment : 24 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 375 time to create 1 rle with old method : 0.0005323886871337891 length of segment : 36 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 285 time to create 1 rle with old method : 0.00044918060302734375 length of segment : 21 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 98 time to create 1 rle with old method : 0.00018548965454101562 length of segment : 7 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 931 time to create 1 rle with old method : 0.0013074874877929688 length of segment : 38 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 365 time to create 1 rle with old method : 0.0006277561187744141 length of segment : 45 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 927 time to create 1 rle with old method : 0.001443624496459961 length of segment : 56 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 576 time to create 1 rle with old method : 0.0008485317230224609 length of segment : 24 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.000507354736328125 length of segment : 14 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 908 time to create 1 rle with old method : 0.0013377666473388672 length of segment : 36 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 786 time to create 1 rle with old method : 0.0011415481567382812 length of segment : 51 time for calcul the mask position with numpy : 8.106231689453125e-05 nb_pixel_total : 1070 time to create 1 rle with old method : 0.0014920234680175781 length of segment : 50 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.0004258155822753906 length of segment : 18 time for calcul the mask position with numpy : 8.320808410644531e-05 nb_pixel_total : 1716 time to create 1 rle with old method : 0.0024557113647460938 length of segment : 49 time for calcul the mask position with numpy : 8.678436279296875e-05 nb_pixel_total : 540 time to create 1 rle with old method : 0.0007982254028320312 length of segment : 24 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 1384 time to create 1 rle with old method : 0.0022041797637939453 length of segment : 37 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 1038 time to create 1 rle with old method : 0.0014386177062988281 length of segment : 48 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 181 time to create 1 rle with old method : 0.0002913475036621094 length of segment : 14 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 935 time to create 1 rle with old method : 0.0013089179992675781 length of segment : 38 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 430 time to create 1 rle with old method : 0.0006735324859619141 length of segment : 39 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 237 time to create 1 rle with old method : 0.0004057884216308594 length of segment : 17 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 905 time to create 1 rle with old method : 0.0012841224670410156 length of segment : 38 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 1083 time to create 1 rle with old method : 0.0014541149139404297 length of segment : 43 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.82266 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 21 time for calcul the mask position with numpy : 9.274482727050781e-05 nb_pixel_total : 1278 time to create 1 rle with old method : 0.0017750263214111328 length of segment : 79 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 72 time to create 1 rle with old method : 0.00016355514526367188 length of segment : 9 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 529 time to create 1 rle with old method : 0.0007238388061523438 length of segment : 33 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 244 time to create 1 rle with old method : 0.0004668235778808594 length of segment : 42 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 147 time to create 1 rle with old method : 0.0002818107604980469 length of segment : 15 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 400 time to create 1 rle with old method : 0.0006108283996582031 length of segment : 20 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 130 time to create 1 rle with old method : 0.0002384185791015625 length of segment : 11 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 501 time to create 1 rle with old method : 0.0006978511810302734 length of segment : 35 time for calcul the mask position with numpy : 8.034706115722656e-05 nb_pixel_total : 1296 time to create 1 rle with old method : 0.0017504692077636719 length of segment : 58 time for calcul the mask position with numpy : 0.00010442733764648438 nb_pixel_total : 1663 time to create 1 rle with old method : 0.0022745132446289062 length of segment : 60 time for calcul the mask position with numpy : 7.867813110351562e-05 nb_pixel_total : 2448 time to create 1 rle with old method : 0.0032606124877929688 length of segment : 53 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 242 time to create 1 rle with old method : 0.00039768218994140625 length of segment : 27 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 1669 time to create 1 rle with old method : 0.0023581981658935547 length of segment : 23 length of segment : 0 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 221 time to create 1 rle with old method : 0.0003616809844970703 length of segment : 26 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.0004115104675292969 length of segment : 26 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.0003578662872314453 length of segment : 25 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 2642 time to create 1 rle with old method : 0.0032999515533447266 length of segment : 61 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 1189 time to create 1 rle with old method : 0.0016605854034423828 length of segment : 44 time for calcul the mask position with numpy : 8.416175842285156e-05 nb_pixel_total : 1005 time to create 1 rle with old method : 0.0013530254364013672 length of segment : 55 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 1172 time to create 1 rle with old method : 0.0016033649444580078 length of segment : 39 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 133.60000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 297 time to create 1 rle with old method : 0.00047087669372558594 length of segment : 32 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 592 time to create 1 rle with old method : 0.0009284019470214844 length of segment : 24 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 83 time to create 1 rle with old method : 0.00015735626220703125 length of segment : 11 time for calcul the mask position with numpy : 7.796287536621094e-05 nb_pixel_total : 17 time to create 1 rle with old method : 0.00021839141845703125 length of segment : 13 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.0002675056457519531 length of segment : 38 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.30156 max: 145.29922 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 385 time to create 1 rle with old method : 0.0005590915679931641 length of segment : 33 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 629 time to create 1 rle with old method : 0.0010602474212646484 length of segment : 56 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 129 time to create 1 rle with old method : 0.00023221969604492188 length of segment : 38 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 569 time to create 1 rle with old method : 0.0008709430694580078 length of segment : 62 time for calcul the mask position with numpy : 7.414817810058594e-05 nb_pixel_total : 1043 time to create 1 rle with old method : 0.0016324520111083984 length of segment : 81 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 570 time to create 1 rle with old method : 0.0008766651153564453 length of segment : 61 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 584 time to create 1 rle with old method : 0.0009129047393798828 length of segment : 49 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 692 time to create 1 rle with old method : 0.0010361671447753906 length of segment : 56 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.17266 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 1104 time to create 1 rle with old method : 0.001421213150024414 length of segment : 31 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 400 time to create 1 rle with old method : 0.0005488395690917969 length of segment : 41 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 838 time to create 1 rle with old method : 0.0011861324310302734 length of segment : 37 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 805 time to create 1 rle with old method : 0.001150369644165039 length of segment : 58 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 745 time to create 1 rle with old method : 0.001096487045288086 length of segment : 46 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 2529 time to create 1 rle with old method : 0.003470897674560547 length of segment : 49 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 181 time to create 1 rle with old method : 0.0003001689910888672 length of segment : 41 time for calcul the mask position with numpy : 8.344650268554688e-05 nb_pixel_total : 2805 time to create 1 rle with old method : 0.003743410110473633 length of segment : 51 Processing 1 images image shape: (400, 400, 3) min: 4.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.33672 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 1192 time to create 1 rle with old method : 0.0016748905181884766 length of segment : 28 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 93 time to create 1 rle with old method : 0.00041985511779785156 length of segment : 12 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 1015 time to create 1 rle with old method : 0.0014545917510986328 length of segment : 27 time for calcul the mask position with numpy : 9.894371032714844e-05 nb_pixel_total : 1685 time to create 1 rle with old method : 0.0024907588958740234 length of segment : 48 time for calcul the mask position with numpy : 0.0001804828643798828 nb_pixel_total : 3424 time to create 1 rle with old method : 0.0047016143798828125 length of segment : 159 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.68047 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 403 time to create 1 rle with old method : 0.0006101131439208984 length of segment : 25 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 748 time to create 1 rle with old method : 0.0010306835174560547 length of segment : 35 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 131 time to create 1 rle with old method : 0.0002644062042236328 length of segment : 16 time for calcul the mask position with numpy : 0.0001494884490966797 nb_pixel_total : 5522 time to create 1 rle with old method : 0.0070040225982666016 length of segment : 123 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.0003552436828613281 length of segment : 22 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 498 time to create 1 rle with old method : 0.0010371208190917969 length of segment : 16 time for calcul the mask position with numpy : 9.72747802734375e-05 nb_pixel_total : 1540 time to create 1 rle with old method : 0.002762317657470703 length of segment : 85 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 424 time to create 1 rle with old method : 0.0008733272552490234 length of segment : 27 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 605 time to create 1 rle with old method : 0.001081228256225586 length of segment : 60 time for calcul the mask position with numpy : 0.0007424354553222656 nb_pixel_total : 54297 time to create 1 rle with old method : 0.07351899147033691 length of segment : 371 Processing 1 images image shape: (400, 400, 3) min: 20.00000 max: 236.00000 molded_images shape: (1, 640, 640, 3) min: -96.58281 max: 104.93594 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -109.05938 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.00038909912109375 length of segment : 19 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 690 time to create 1 rle with old method : 0.0009367465972900391 length of segment : 33 time for calcul the mask position with numpy : 0.0003197193145751953 nb_pixel_total : 10220 time to create 1 rle with old method : 0.012284040451049805 length of segment : 149 time for calcul the mask position with numpy : 0.00010895729064941406 nb_pixel_total : 326 time to create 1 rle with old method : 0.00051116943359375 length of segment : 18 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 1219 time to create 1 rle with old method : 0.0017049312591552734 length of segment : 31 Processing 1 images image shape: (400, 400, 3) min: 14.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -101.96563 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 396 time to create 1 rle with old method : 0.0006113052368164062 length of segment : 17 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 338 time to create 1 rle with old method : 0.0005180835723876953 length of segment : 17 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 43 time to create 1 rle with old method : 0.00010442733764648438 length of segment : 5 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 641 time to create 1 rle with old method : 0.0009210109710693359 length of segment : 35 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 600 time to create 1 rle with old method : 0.000957489013671875 length of segment : 33 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 629 time to create 1 rle with old method : 0.0009391307830810547 length of segment : 32 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 315 time to create 1 rle with old method : 0.0005123615264892578 length of segment : 29 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 73 time to create 1 rle with old method : 0.00014209747314453125 length of segment : 8 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 454 time to create 1 rle with old method : 0.0006651878356933594 length of segment : 25 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 606 time to create 1 rle with old method : 0.0008566379547119141 length of segment : 53 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 181 time to create 1 rle with old method : 0.0003113746643066406 length of segment : 13 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 708 time to create 1 rle with old method : 0.00099945068359375 length of segment : 31 time for calcul the mask position with numpy : 0.00022339820861816406 nb_pixel_total : 5609 time to create 1 rle with old method : 0.007342338562011719 length of segment : 116 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 262 time to create 1 rle with old method : 0.00041604042053222656 length of segment : 18 time for calcul the mask position with numpy : 0.0001780986785888672 nb_pixel_total : 4434 time to create 1 rle with old method : 0.00811457633972168 length of segment : 109 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 499 time to create 1 rle with old method : 0.0006852149963378906 length of segment : 18 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.05547 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.00012183189392089844 nb_pixel_total : 1900 time to create 1 rle with old method : 0.003213167190551758 length of segment : 118 time for calcul the mask position with numpy : 0.00012826919555664062 nb_pixel_total : 2137 time to create 1 rle with old method : 0.0029892921447753906 length of segment : 200 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 137 time to create 1 rle with old method : 0.00026416778564453125 length of segment : 9 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 322 time to create 1 rle with old method : 0.0005650520324707031 length of segment : 14 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.0005769729614257812 length of segment : 21 time for calcul the mask position with numpy : 0.0001647472381591797 nb_pixel_total : 9555 time to create 1 rle with old method : 0.01203012466430664 length of segment : 81 time for calcul the mask position with numpy : 0.00025177001953125 nb_pixel_total : 10225 time to create 1 rle with old method : 0.013143062591552734 length of segment : 88 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 249.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 122.35391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 8.893013000488281e-05 nb_pixel_total : 2947 time to create 1 rle with old method : 0.003948688507080078 length of segment : 144 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 618 time to create 1 rle with old method : 0.0008990764617919922 length of segment : 45 time for calcul the mask position with numpy : 8.130073547363281e-05 nb_pixel_total : 713 time to create 1 rle with old method : 0.0009987354278564453 length of segment : 74 time for calcul the mask position with numpy : 0.0001163482666015625 nb_pixel_total : 3152 time to create 1 rle with old method : 0.004094362258911133 length of segment : 167 time for calcul the mask position with numpy : 0.00011277198791503906 nb_pixel_total : 1514 time to create 1 rle with old method : 0.0019350051879882812 length of segment : 75 time for calcul the mask position with numpy : 0.00022792816162109375 nb_pixel_total : 3569 time to create 1 rle with old method : 0.004741191864013672 length of segment : 179 time for calcul the mask position with numpy : 0.0002644062042236328 nb_pixel_total : 4410 time to create 1 rle with old method : 0.006327152252197266 length of segment : 215 Processing 1 images image shape: (280, 400, 3) min: 12.00000 max: 213.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 93.10781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0012905597686767578 nb_pixel_total : 105894 time to create 1 rle with old method : 0.14673423767089844 length of segment : 282 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 0.0001010894775390625 nb_pixel_total : 1046 time to create 1 rle with old method : 0.002100229263305664 length of segment : 63 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 551 time to create 1 rle with old method : 0.0011205673217773438 length of segment : 38 time for calcul the mask position with numpy : 0.0001239776611328125 nb_pixel_total : 2992 time to create 1 rle with old method : 0.005605459213256836 length of segment : 77 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 609 time to create 1 rle with old method : 0.0008604526519775391 length of segment : 30 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 251 time to create 1 rle with old method : 0.0003876686096191406 length of segment : 14 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 242 time to create 1 rle with old method : 0.0003807544708251953 length of segment : 14 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 513 time to create 1 rle with old method : 0.0007512569427490234 length of segment : 24 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 905 time to create 1 rle with old method : 0.0013341903686523438 length of segment : 28 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 1212 time to create 1 rle with old method : 0.0016520023345947266 length of segment : 49 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 321 time to create 1 rle with old method : 0.00048422813415527344 length of segment : 20 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 1142 time to create 1 rle with old method : 0.0014865398406982422 length of segment : 50 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 720 time to create 1 rle with old method : 0.0010547637939453125 length of segment : 57 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 2488 time to create 1 rle with old method : 0.003278970718383789 length of segment : 93 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.00044417381286621094 length of segment : 19 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 48 time for calcul the mask position with numpy : 8.654594421386719e-05 nb_pixel_total : 468 time to create 1 rle with old method : 0.0007367134094238281 length of segment : 21 time for calcul the mask position with numpy : 8.034706115722656e-05 nb_pixel_total : 1066 time to create 1 rle with old method : 0.0014812946319580078 length of segment : 54 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 949 time to create 1 rle with old method : 0.0014498233795166016 length of segment : 27 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 234 time to create 1 rle with old method : 0.00038814544677734375 length of segment : 23 time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 1243 time to create 1 rle with old method : 0.0018341541290283203 length of segment : 34 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 806 time to create 1 rle with old method : 0.0012288093566894531 length of segment : 22 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 972 time to create 1 rle with old method : 0.0013217926025390625 length of segment : 45 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 290 time to create 1 rle with old method : 0.000431060791015625 length of segment : 20 time for calcul the mask position with numpy : 8.440017700195312e-05 nb_pixel_total : 2411 time to create 1 rle with old method : 0.00331878662109375 length of segment : 40 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.0005311965942382812 length of segment : 22 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 315 time to create 1 rle with old method : 0.00047898292541503906 length of segment : 26 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 1153 time to create 1 rle with old method : 0.0015740394592285156 length of segment : 34 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 1168 time to create 1 rle with old method : 0.0016074180603027344 length of segment : 41 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 843 time to create 1 rle with old method : 0.0011570453643798828 length of segment : 37 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 505 time to create 1 rle with old method : 0.0007274150848388672 length of segment : 26 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 310 time to create 1 rle with old method : 0.00047016143798828125 length of segment : 41 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 208 time to create 1 rle with old method : 0.000324249267578125 length of segment : 22 time for calcul the mask position with numpy : 9.036064147949219e-05 nb_pixel_total : 430 time to create 1 rle with old method : 0.0008740425109863281 length of segment : 44 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 462 time to create 1 rle with old method : 0.0006504058837890625 length of segment : 32 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 320 time to create 1 rle with old method : 0.00047659873962402344 length of segment : 22 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 566 time to create 1 rle with old method : 0.0008237361907958984 length of segment : 24 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003829002380371094 length of segment : 18 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 143 time to create 1 rle with old method : 0.00025844573974609375 length of segment : 13 time for calcul the mask position with numpy : 8.511543273925781e-05 nb_pixel_total : 1187 time to create 1 rle with old method : 0.0016727447509765625 length of segment : 50 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 689 time to create 1 rle with old method : 0.0009753704071044922 length of segment : 52 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 973 time to create 1 rle with old method : 0.0012929439544677734 length of segment : 39 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 266 time to create 1 rle with old method : 0.0004115104675292969 length of segment : 21 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 868 time to create 1 rle with old method : 0.0012674331665039062 length of segment : 29 time for calcul the mask position with numpy : 9.989738464355469e-05 nb_pixel_total : 1137 time to create 1 rle with old method : 0.001966714859008789 length of segment : 69 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 1200 time to create 1 rle with old method : 0.0015950202941894531 length of segment : 69 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 1522 time to create 1 rle with old method : 0.0021066665649414062 length of segment : 40 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 303 time to create 1 rle with old method : 0.0004837512969970703 length of segment : 19 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 177 time to create 1 rle with old method : 0.00029277801513671875 length of segment : 13 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 387 time to create 1 rle with old method : 0.0005445480346679688 length of segment : 20 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 18 time to create 1 rle with old method : 7.104873657226562e-05 length of segment : 10 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 831 time to create 1 rle with old method : 0.0011148452758789062 length of segment : 32 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 413 time to create 1 rle with old method : 0.0006475448608398438 length of segment : 22 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 766 time to create 1 rle with old method : 0.001108407974243164 length of segment : 31 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 258 time to create 1 rle with old method : 0.00041961669921875 length of segment : 19 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 207 time to create 1 rle with old method : 0.00034117698669433594 length of segment : 21 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 1061 time to create 1 rle with old method : 0.0013966560363769531 length of segment : 35 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 798 time to create 1 rle with old method : 0.0011734962463378906 length of segment : 46 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 186 time to create 1 rle with old method : 0.00032067298889160156 length of segment : 12 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 438 time to create 1 rle with old method : 0.0006458759307861328 length of segment : 24 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 132 time to create 1 rle with old method : 0.00023412704467773438 length of segment : 9 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 381 time to create 1 rle with old method : 0.0005345344543457031 length of segment : 45 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 929 time to create 1 rle with old method : 0.001249074935913086 length of segment : 37 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.00040531158447265625 length of segment : 18 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.92812 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 24 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 133 time to create 1 rle with old method : 0.0002319812774658203 length of segment : 15 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 523 time to create 1 rle with old method : 0.0007476806640625 length of segment : 33 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 335 time to create 1 rle with old method : 0.0005056858062744141 length of segment : 28 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 85 time to create 1 rle with old method : 0.00017309188842773438 length of segment : 10 time for calcul the mask position with numpy : 8.916854858398438e-05 nb_pixel_total : 1332 time to create 1 rle with old method : 0.0017900466918945312 length of segment : 67 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 1027 time to create 1 rle with old method : 0.0017592906951904297 length of segment : 64 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 370 time to create 1 rle with old method : 0.0005137920379638672 length of segment : 47 time for calcul the mask position with numpy : 7.367134094238281e-05 nb_pixel_total : 343 time to create 1 rle with old method : 0.0006508827209472656 length of segment : 32 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 368 time to create 1 rle with old method : 0.0005414485931396484 length of segment : 44 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 814 time to create 1 rle with old method : 0.0010709762573242188 length of segment : 75 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.0004627704620361328 length of segment : 36 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 844 time to create 1 rle with old method : 0.0011975765228271484 length of segment : 32 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 1638 time to create 1 rle with old method : 0.0021784305572509766 length of segment : 77 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 1429 time to create 1 rle with old method : 0.001983165740966797 length of segment : 56 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 1108 time to create 1 rle with old method : 0.0014462471008300781 length of segment : 43 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.0004107952117919922 length of segment : 28 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 544 time to create 1 rle with old method : 0.0007381439208984375 length of segment : 32 time for calcul the mask position with numpy : 8.368492126464844e-05 nb_pixel_total : 2668 time to create 1 rle with old method : 0.0032808780670166016 length of segment : 59 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 322 time to create 1 rle with old method : 0.00044655799865722656 length of segment : 33 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 942 time to create 1 rle with old method : 0.0012447834014892578 length of segment : 32 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 493 time to create 1 rle with old method : 0.0006723403930664062 length of segment : 25 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 496 time to create 1 rle with old method : 0.0007100105285644531 length of segment : 25 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.00032019615173339844 length of segment : 26 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 95 time to create 1 rle with old method : 0.0001659393310546875 length of segment : 12 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 135.03750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 323 time to create 1 rle with old method : 0.0004754066467285156 length of segment : 39 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 635 time to create 1 rle with old method : 0.0009958744049072266 length of segment : 25 time for calcul the mask position with numpy : 9.799003601074219e-05 nb_pixel_total : 15 time to create 1 rle with old method : 7.939338684082031e-05 length of segment : 10 time for calcul the mask position with numpy : 0.00010442733764648438 nb_pixel_total : 70 time to create 1 rle with old method : 0.00020313262939453125 length of segment : 11 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 244 time to create 1 rle with old method : 0.0004763603210449219 length of segment : 31 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 618 time to create 1 rle with old method : 0.0008969306945800781 length of segment : 25 Detection mask done ! Trying to reset tf kernel 3075578 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 641 tf kernel not reseted sub process len(results) : 295 len(list_Values) 295 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 295 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5714 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 295 chid ids of type : 4228 Number RLEs to save : 13443 save missing photos in datou_result : time spend for datou_step_exec : 25.710843324661255 time spend to save output : 0.9258952140808105 total time spend for step 1 : 26.636738538742065 step2:brightness Fri Mar 7 14:20:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1741353628_3074870_1341464000_3ebd8d0107720ab0b41fd88a1315c67a.jpg treat image : temp/1741353628_3074870_1341463952_b7f82eb33362740baf6b5b15bd57114d.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.01056218147277832 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.010917425155639648 save missing photos in datou_result : time spend for datou_step_exec : 0.7277278900146484 time spend to save output : 0.026394367218017578 total time spend for step 2 : 0.754122257232666 step3:blur_detection Fri Mar 7 14:20:56 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1741353628_3074870_1341464000_3ebd8d0107720ab0b41fd88a1315c67a.jpg resize: (1080, 1920) 1341464000 -7.8008035160160825 treat image : temp/1741353628_3074870_1341463952_b7f82eb33362740baf6b5b15bd57114d.jpg resize: (1080, 1920) 1341463952 -7.855991277478289 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.013782978057861328 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.010888099670410156 save missing photos in datou_result : time spend for datou_step_exec : 2.0481371879577637 time spend to save output : 0.029668807983398438 total time spend for step 3 : 2.077805995941162 step4:rle_unique_nms_with_priority Fri Mar 7 14:20:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 295 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 135 nb_hashtags : 8 time to prepare the origin masks : 1.2324016094207764 time for calcul the mask position with numpy : 0.062418460845947266 nb_pixel_total : 1825486 time to create 1 rle with new method : 0.31867098808288574 time for calcul the mask position with numpy : 0.008588075637817383 nb_pixel_total : 367 time to create 1 rle with old method : 0.00048828125 time for calcul the mask position with numpy : 0.008508443832397461 nb_pixel_total : 554 time to create 1 rle with old method : 0.0006787776947021484 time for calcul the mask position with numpy : 0.00840449333190918 nb_pixel_total : 381 time to create 1 rle with old method : 0.0004513263702392578 time for calcul the mask position with numpy : 0.008392095565795898 nb_pixel_total : 68 time to create 1 rle with old method : 0.0001010894775390625 time for calcul the mask position with numpy : 0.008355379104614258 nb_pixel_total : 175 time to create 1 rle with old method : 0.00022077560424804688 time for calcul the mask position with numpy : 0.00841212272644043 nb_pixel_total : 98 time to create 1 rle with old method : 0.00015020370483398438 time for calcul the mask position with numpy : 0.008469820022583008 nb_pixel_total : 1078 time to create 1 rle with old method : 0.0012180805206298828 time for calcul the mask position with numpy : 0.008179426193237305 nb_pixel_total : 16 time to create 1 rle with old method : 2.7894973754882812e-05 time for calcul the mask position with numpy : 0.008318185806274414 nb_pixel_total : 431 time to create 1 rle with old method : 0.0004954338073730469 time for calcul the mask position with numpy : 0.00835275650024414 nb_pixel_total : 13 time to create 1 rle with old method : 2.9087066650390625e-05 time for calcul the mask position with numpy : 0.008351564407348633 nb_pixel_total : 14 time to create 1 rle with old method : 3.337860107421875e-05 time for calcul the mask position with numpy : 0.008720159530639648 nb_pixel_total : 45985 time to create 1 rle with old method : 0.04966402053833008 time for calcul the mask position with numpy : 0.00857090950012207 nb_pixel_total : 2446 time to create 1 rle with old method : 0.002735614776611328 time for calcul the mask position with numpy : 0.008746862411499023 nb_pixel_total : 2 time to create 1 rle with old method : 1.2636184692382812e-05 time for calcul the mask position with numpy : 0.009244918823242188 nb_pixel_total : 1059 time to create 1 rle with old method : 0.0014369487762451172 time for calcul the mask position with numpy : 0.009098529815673828 nb_pixel_total : 1653 time to create 1 rle with old method : 0.0023381710052490234 time for calcul the mask position with numpy : 0.009288549423217773 nb_pixel_total : 150 time to create 1 rle with old method : 0.00020432472229003906 time for calcul the mask position with numpy : 0.008390188217163086 nb_pixel_total : 437 time to create 1 rle with old method : 0.0004990100860595703 time for calcul the mask position with numpy : 0.008580446243286133 nb_pixel_total : 2317 time to create 1 rle with old method : 0.002817869186401367 time for calcul the mask position with numpy : 0.008536338806152344 nb_pixel_total : 659 time to create 1 rle with old method : 0.0007596015930175781 time for calcul the mask position with numpy : 0.008406639099121094 nb_pixel_total : 968 time to create 1 rle with old method : 0.0011475086212158203 time for calcul the mask position with numpy : 0.008428335189819336 nb_pixel_total : 793 time to create 1 rle with old method : 0.0008883476257324219 time for calcul the mask position with numpy : 0.008695125579833984 nb_pixel_total : 655 time to create 1 rle with old method : 0.0007793903350830078 time for calcul the mask position with numpy : 0.008688211441040039 nb_pixel_total : 351 time to create 1 rle with old method : 0.0004391670227050781 time for calcul the mask position with numpy : 0.00909113883972168 nb_pixel_total : 1648 time to create 1 rle with old method : 0.0028274059295654297 time for calcul the mask position with numpy : 0.009260177612304688 nb_pixel_total : 1034 time to create 1 rle with old method : 0.0011644363403320312 time for calcul the mask position with numpy : 0.009997367858886719 nb_pixel_total : 466 time to create 1 rle with old method : 0.0005676746368408203 time for calcul the mask position with numpy : 0.008249759674072266 nb_pixel_total : 139 time to create 1 rle with old method : 0.0001621246337890625 time for calcul the mask position with numpy : 0.008397817611694336 nb_pixel_total : 523 time to create 1 rle with old method : 0.0006234645843505859 time for calcul the mask position with numpy : 0.008455991744995117 nb_pixel_total : 656 time to create 1 rle with old method : 0.0007905960083007812 time for calcul the mask position with numpy : 0.00835418701171875 nb_pixel_total : 3729 time to create 1 rle with old method : 0.004286289215087891 time for calcul the mask position with numpy : 0.008584737777709961 nb_pixel_total : 213 time to create 1 rle with old method : 0.00026917457580566406 time for calcul the mask position with numpy : 0.008302450180053711 nb_pixel_total : 1713 time to create 1 rle with old method : 0.001982450485229492 time for calcul the mask position with numpy : 0.008452653884887695 nb_pixel_total : 4496 time to create 1 rle with old method : 0.005297422409057617 time for calcul the mask position with numpy : 0.008407354354858398 nb_pixel_total : 354 time to create 1 rle with old method : 0.00042629241943359375 time for calcul the mask position with numpy : 0.00853729248046875 nb_pixel_total : 1979 time to create 1 rle with old method : 0.002257108688354492 time for calcul the mask position with numpy : 0.008507966995239258 nb_pixel_total : 241 time to create 1 rle with old method : 0.00028777122497558594 time for calcul the mask position with numpy : 0.008736848831176758 nb_pixel_total : 371 time to create 1 rle with old method : 0.0004506111145019531 time for calcul the mask position with numpy : 0.008417129516601562 nb_pixel_total : 51 time to create 1 rle with old method : 8.487701416015625e-05 time for calcul the mask position with numpy : 0.008430957794189453 nb_pixel_total : 1 time to create 1 rle with old method : 1.5974044799804688e-05 time for calcul the mask position with numpy : 0.008730173110961914 nb_pixel_total : 599 time to create 1 rle with old method : 0.0007450580596923828 time for calcul the mask position with numpy : 0.00911712646484375 nb_pixel_total : 1132 time to create 1 rle with old method : 0.0013675689697265625 time for calcul the mask position with numpy : 0.009063482284545898 nb_pixel_total : 301 time to create 1 rle with old method : 0.0005128383636474609 time for calcul the mask position with numpy : 0.009462118148803711 nb_pixel_total : 5707 time to create 1 rle with old method : 0.00693202018737793 time for calcul the mask position with numpy : 0.009372711181640625 nb_pixel_total : 109 time to create 1 rle with old method : 0.0001850128173828125 time for calcul the mask position with numpy : 0.008945226669311523 nb_pixel_total : 337 time to create 1 rle with old method : 0.00046253204345703125 time for calcul the mask position with numpy : 0.008656978607177734 nb_pixel_total : 773 time to create 1 rle with old method : 0.0009257793426513672 time for calcul the mask position with numpy : 0.008488178253173828 nb_pixel_total : 3673 time to create 1 rle with old method : 0.004250764846801758 time for calcul the mask position with numpy : 0.008249521255493164 nb_pixel_total : 498 time to create 1 rle with old method : 0.0005850791931152344 time for calcul the mask position with numpy : 0.008252620697021484 nb_pixel_total : 4341 time to create 1 rle with old method : 0.005046367645263672 time for calcul the mask position with numpy : 0.008370161056518555 nb_pixel_total : 676 time to create 1 rle with old method : 0.0010149478912353516 time for calcul the mask position with numpy : 0.008181095123291016 nb_pixel_total : 1845 time to create 1 rle with old method : 0.002193450927734375 time for calcul the mask position with numpy : 0.008336067199707031 nb_pixel_total : 316 time to create 1 rle with old method : 0.00037789344787597656 time for calcul the mask position with numpy : 0.008452653884887695 nb_pixel_total : 648 time to create 1 rle with old method : 0.0008149147033691406 time for calcul the mask position with numpy : 0.00850367546081543 nb_pixel_total : 453 time to create 1 rle with old method : 0.0005490779876708984 time for calcul the mask position with numpy : 0.00844430923461914 nb_pixel_total : 345 time to create 1 rle with old method : 0.0004687309265136719 time for calcul the mask position with numpy : 0.008333921432495117 nb_pixel_total : 167 time to create 1 rle with old method : 0.0002129077911376953 time for calcul the mask position with numpy : 0.008367538452148438 nb_pixel_total : 236 time to create 1 rle with old method : 0.00029969215393066406 time for calcul the mask position with numpy : 0.008287668228149414 nb_pixel_total : 235 time to create 1 rle with old method : 0.00033926963806152344 time for calcul the mask position with numpy : 0.008388757705688477 nb_pixel_total : 1275 time to create 1 rle with old method : 0.0014293193817138672 time for calcul the mask position with numpy : 0.008306264877319336 nb_pixel_total : 674 time to create 1 rle with old method : 0.0007753372192382812 time for calcul the mask position with numpy : 0.008190155029296875 nb_pixel_total : 737 time to create 1 rle with old method : 0.0008442401885986328 time for calcul the mask position with numpy : 0.008573532104492188 nb_pixel_total : 359 time to create 1 rle with old method : 0.00047087669372558594 time for calcul the mask position with numpy : 0.008506298065185547 nb_pixel_total : 318 time to create 1 rle with old method : 0.000400543212890625 time for calcul the mask position with numpy : 0.008621692657470703 nb_pixel_total : 414 time to create 1 rle with old method : 0.0005457401275634766 time for calcul the mask position with numpy : 0.008603811264038086 nb_pixel_total : 664 time to create 1 rle with old method : 0.0008180141448974609 time for calcul the mask position with numpy : 0.008518457412719727 nb_pixel_total : 411 time to create 1 rle with old method : 0.00047397613525390625 time for calcul the mask position with numpy : 0.008516550064086914 nb_pixel_total : 48 time to create 1 rle with old method : 6.866455078125e-05 time for calcul the mask position with numpy : 0.008949756622314453 nb_pixel_total : 105321 time to create 1 rle with old method : 0.11665678024291992 time for calcul the mask position with numpy : 0.00856637954711914 nb_pixel_total : 98 time to create 1 rle with old method : 0.0001385211944580078 time for calcul the mask position with numpy : 0.008417844772338867 nb_pixel_total : 931 time to create 1 rle with old method : 0.0010824203491210938 time for calcul the mask position with numpy : 0.008554220199584961 nb_pixel_total : 130 time to create 1 rle with old method : 0.0001785755157470703 time for calcul the mask position with numpy : 0.009131193161010742 nb_pixel_total : 365 time to create 1 rle with old method : 0.0005807876586914062 time for calcul the mask position with numpy : 0.009530067443847656 nb_pixel_total : 181 time to create 1 rle with old method : 0.00022125244140625 time for calcul the mask position with numpy : 0.008527278900146484 nb_pixel_total : 285 time to create 1 rle with old method : 0.0003490447998046875 time for calcul the mask position with numpy : 0.008487224578857422 nb_pixel_total : 17 time to create 1 rle with old method : 5.841255187988281e-05 time for calcul the mask position with numpy : 0.008424758911132812 nb_pixel_total : 375 time to create 1 rle with old method : 0.00045037269592285156 time for calcul the mask position with numpy : 0.009196281433105469 nb_pixel_total : 229 time to create 1 rle with old method : 0.0004603862762451172 time for calcul the mask position with numpy : 0.011667728424072266 nb_pixel_total : 966 time to create 1 rle with old method : 0.0017349720001220703 time for calcul the mask position with numpy : 0.011599302291870117 nb_pixel_total : 466 time to create 1 rle with old method : 0.0009479522705078125 time for calcul the mask position with numpy : 0.011950016021728516 nb_pixel_total : 83 time to create 1 rle with old method : 0.00018930435180664062 time for calcul the mask position with numpy : 0.01175379753112793 nb_pixel_total : 786 time to create 1 rle with old method : 0.0018465518951416016 time for calcul the mask position with numpy : 0.012556076049804688 nb_pixel_total : 437 time to create 1 rle with old method : 0.0008847713470458984 time for calcul the mask position with numpy : 0.011755704879760742 nb_pixel_total : 232 time to create 1 rle with old method : 0.0004730224609375 time for calcul the mask position with numpy : 0.012417078018188477 nb_pixel_total : 297 time to create 1 rle with old method : 0.0006086826324462891 time for calcul the mask position with numpy : 0.011718273162841797 nb_pixel_total : 789 time to create 1 rle with old method : 0.0015294551849365234 time for calcul the mask position with numpy : 0.012148618698120117 nb_pixel_total : 2448 time to create 1 rle with old method : 0.004309415817260742 time for calcul the mask position with numpy : 0.01160740852355957 nb_pixel_total : 1716 time to create 1 rle with old method : 0.0031604766845703125 time for calcul the mask position with numpy : 0.010669708251953125 nb_pixel_total : 271 time to create 1 rle with old method : 0.0003504753112792969 time for calcul the mask position with numpy : 0.008841514587402344 nb_pixel_total : 314 time to create 1 rle with old method : 0.00039386749267578125 time for calcul the mask position with numpy : 0.008769989013671875 nb_pixel_total : 128 time to create 1 rle with old method : 0.0001723766326904297 time for calcul the mask position with numpy : 0.008708477020263672 nb_pixel_total : 89 time to create 1 rle with old method : 0.00013685226440429688 time for calcul the mask position with numpy : 0.008789777755737305 nb_pixel_total : 922 time to create 1 rle with old method : 0.001068115234375 time for calcul the mask position with numpy : 0.008534431457519531 nb_pixel_total : 615 time to create 1 rle with old method : 0.0007333755493164062 time for calcul the mask position with numpy : 0.008734464645385742 nb_pixel_total : 244 time to create 1 rle with old method : 0.0003314018249511719 time for calcul the mask position with numpy : 0.008471488952636719 nb_pixel_total : 219 time to create 1 rle with old method : 0.0002548694610595703 time for calcul the mask position with numpy : 0.008573055267333984 nb_pixel_total : 592 time to create 1 rle with old method : 0.0006968975067138672 time for calcul the mask position with numpy : 0.008675575256347656 nb_pixel_total : 272 time to create 1 rle with old method : 0.0003230571746826172 time for calcul the mask position with numpy : 0.009080648422241211 nb_pixel_total : 529 time to create 1 rle with old method : 0.0006456375122070312 time for calcul the mask position with numpy : 0.008642435073852539 nb_pixel_total : 1070 time to create 1 rle with old method : 0.001312255859375 time for calcul the mask position with numpy : 0.008719682693481445 nb_pixel_total : 486 time to create 1 rle with old method : 0.0006506443023681641 time for calcul the mask position with numpy : 0.00857400894165039 nb_pixel_total : 1663 time to create 1 rle with old method : 0.0018830299377441406 time for calcul the mask position with numpy : 0.0083160400390625 nb_pixel_total : 1412 time to create 1 rle with old method : 0.0016484260559082031 time for calcul the mask position with numpy : 0.008280277252197266 nb_pixel_total : 578 time to create 1 rle with old method : 0.0006806850433349609 time for calcul the mask position with numpy : 0.008346080780029297 nb_pixel_total : 1189 time to create 1 rle with old method : 0.001325845718383789 time for calcul the mask position with numpy : 0.0084228515625 nb_pixel_total : 52 time to create 1 rle with old method : 0.00010347366333007812 time for calcul the mask position with numpy : 0.008345603942871094 nb_pixel_total : 9 time to create 1 rle with old method : 3.6716461181640625e-05 time for calcul the mask position with numpy : 0.008316278457641602 nb_pixel_total : 935 time to create 1 rle with old method : 0.0010788440704345703 time for calcul the mask position with numpy : 0.008497238159179688 nb_pixel_total : 17 time to create 1 rle with old method : 4.863739013671875e-05 time for calcul the mask position with numpy : 0.008313894271850586 nb_pixel_total : 278 time to create 1 rle with old method : 0.0002989768981933594 time for calcul the mask position with numpy : 0.008219718933105469 nb_pixel_total : 1669 time to create 1 rle with old method : 0.0019729137420654297 time for calcul the mask position with numpy : 0.008561849594116211 nb_pixel_total : 237 time to create 1 rle with old method : 0.00030803680419921875 time for calcul the mask position with numpy : 0.008461475372314453 nb_pixel_total : 312 time to create 1 rle with old method : 0.00041294097900390625 time for calcul the mask position with numpy : 0.008488178253173828 nb_pixel_total : 7 time to create 1 rle with old method : 4.506111145019531e-05 time for calcul the mask position with numpy : 0.008657217025756836 nb_pixel_total : 180 time to create 1 rle with old method : 0.0002951622009277344 time for calcul the mask position with numpy : 0.008622169494628906 nb_pixel_total : 221 time to create 1 rle with old method : 0.00028228759765625 time for calcul the mask position with numpy : 0.0085601806640625 nb_pixel_total : 908 time to create 1 rle with old method : 0.001081228256225586 time for calcul the mask position with numpy : 0.008499622344970703 nb_pixel_total : 1278 time to create 1 rle with old method : 0.0016047954559326172 time for calcul the mask position with numpy : 0.008498668670654297 nb_pixel_total : 400 time to create 1 rle with old method : 0.0004742145538330078 time for calcul the mask position with numpy : 0.008534908294677734 nb_pixel_total : 12 time to create 1 rle with old method : 3.0994415283203125e-05 time for calcul the mask position with numpy : 0.00848841667175293 nb_pixel_total : 1038 time to create 1 rle with old method : 0.0011913776397705078 time for calcul the mask position with numpy : 0.008525609970092773 nb_pixel_total : 1384 time to create 1 rle with old method : 0.0016646385192871094 time for calcul the mask position with numpy : 0.008437871932983398 nb_pixel_total : 501 time to create 1 rle with old method : 0.0005757808685302734 time for calcul the mask position with numpy : 0.008590459823608398 nb_pixel_total : 927 time to create 1 rle with old method : 0.0010797977447509766 time for calcul the mask position with numpy : 0.008613824844360352 nb_pixel_total : 1023 time to create 1 rle with old method : 0.0011725425720214844 time for calcul the mask position with numpy : 0.00847172737121582 nb_pixel_total : 242 time to create 1 rle with old method : 0.0003285408020019531 time for calcul the mask position with numpy : 0.008457660675048828 nb_pixel_total : 1296 time to create 1 rle with old method : 0.001455068588256836 time for calcul the mask position with numpy : 0.008447885513305664 nb_pixel_total : 21 time to create 1 rle with old method : 6.031990051269531e-05 time for calcul the mask position with numpy : 0.008419990539550781 nb_pixel_total : 72 time to create 1 rle with old method : 0.00010061264038085938 time for calcul the mask position with numpy : 0.00852513313293457 nb_pixel_total : 849 time to create 1 rle with old method : 0.0009927749633789062 time for calcul the mask position with numpy : 0.00865626335144043 nb_pixel_total : 430 time to create 1 rle with old method : 0.0005419254302978516 time for calcul the mask position with numpy : 0.009318113327026367 nb_pixel_total : 576 time to create 1 rle with old method : 0.0010769367218017578 time for calcul the mask position with numpy : 0.009105682373046875 nb_pixel_total : 147 time to create 1 rle with old method : 0.00020003318786621094 time for calcul the mask position with numpy : 0.008627653121948242 nb_pixel_total : 540 time to create 1 rle with old method : 0.0006444454193115234 time for calcul the mask position with numpy : 0.008883476257324219 nb_pixel_total : 233 time to create 1 rle with old method : 0.00033164024353027344 create new chi : 1.882267713546753 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.005964040756225586 batch 1 Loaded 136 chid ids of type : 4230 Number RLEs to save : 11799 TO DO : save crop sub photo not yet done ! save time : 0.7138099670410156 nb_obj : 158 nb_hashtags : 8 time to prepare the origin masks : 2.670114755630493 time for calcul the mask position with numpy : 0.09026050567626953 nb_pixel_total : 1782449 time to create 1 rle with new method : 0.10207080841064453 time for calcul the mask position with numpy : 0.010512828826904297 nb_pixel_total : 3424 time to create 1 rle with old method : 0.004067182540893555 time for calcul the mask position with numpy : 0.006342887878417969 nb_pixel_total : 164 time to create 1 rle with old method : 0.00024580955505371094 time for calcul the mask position with numpy : 0.006315708160400391 nb_pixel_total : 109 time to create 1 rle with old method : 0.0001728534698486328 time for calcul the mask position with numpy : 0.00628972053527832 nb_pixel_total : 1043 time to create 1 rle with old method : 0.0012905597686767578 time for calcul the mask position with numpy : 0.00638127326965332 nb_pixel_total : 1104 time to create 1 rle with old method : 0.0012786388397216797 time for calcul the mask position with numpy : 0.006216764450073242 nb_pixel_total : 78 time to create 1 rle with old method : 0.00018095970153808594 time for calcul the mask position with numpy : 0.006357908248901367 nb_pixel_total : 66 time to create 1 rle with old method : 0.00012683868408203125 time for calcul the mask position with numpy : 0.006660938262939453 nb_pixel_total : 129 time to create 1 rle with old method : 0.00017571449279785156 time for calcul the mask position with numpy : 0.006865024566650391 nb_pixel_total : 181 time to create 1 rle with old method : 0.00024056434631347656 time for calcul the mask position with numpy : 0.0067291259765625 nb_pixel_total : 629 time to create 1 rle with old method : 0.0008065700531005859 time for calcul the mask position with numpy : 0.0064525604248046875 nb_pixel_total : 385 time to create 1 rle with old method : 0.0005030632019042969 time for calcul the mask position with numpy : 0.006403684616088867 nb_pixel_total : 424 time to create 1 rle with old method : 0.0007283687591552734 time for calcul the mask position with numpy : 0.00683140754699707 nb_pixel_total : 276 time to create 1 rle with old method : 0.0005581378936767578 time for calcul the mask position with numpy : 0.006913661956787109 nb_pixel_total : 2529 time to create 1 rle with old method : 0.004113912582397461 time for calcul the mask position with numpy : 0.007004976272583008 nb_pixel_total : 54297 time to create 1 rle with old method : 0.07803988456726074 time for calcul the mask position with numpy : 0.006307840347290039 nb_pixel_total : 805 time to create 1 rle with old method : 0.0009424686431884766 time for calcul the mask position with numpy : 0.00629878044128418 nb_pixel_total : 1540 time to create 1 rle with old method : 0.0019752979278564453 time for calcul the mask position with numpy : 0.007772922515869141 nb_pixel_total : 131 time to create 1 rle with old method : 0.00023818016052246094 time for calcul the mask position with numpy : 0.0075054168701171875 nb_pixel_total : 400 time to create 1 rle with old method : 0.0004875659942626953 time for calcul the mask position with numpy : 0.0064465999603271484 nb_pixel_total : 745 time to create 1 rle with old method : 0.0009012222290039062 time for calcul the mask position with numpy : 0.006445646286010742 nb_pixel_total : 207 time to create 1 rle with old method : 0.0002777576446533203 time for calcul the mask position with numpy : 0.006445169448852539 nb_pixel_total : 541 time to create 1 rle with old method : 0.0006735324859619141 time for calcul the mask position with numpy : 0.006494998931884766 nb_pixel_total : 748 time to create 1 rle with old method : 0.0009357929229736328 time for calcul the mask position with numpy : 0.0064983367919921875 nb_pixel_total : 838 time to create 1 rle with old method : 0.0010006427764892578 time for calcul the mask position with numpy : 0.006509065628051758 nb_pixel_total : 629 time to create 1 rle with old method : 0.0008232593536376953 time for calcul the mask position with numpy : 0.006608247756958008 nb_pixel_total : 1015 time to create 1 rle with old method : 0.00128936767578125 time for calcul the mask position with numpy : 0.007074117660522461 nb_pixel_total : 403 time to create 1 rle with old method : 0.000644683837890625 time for calcul the mask position with numpy : 0.007537364959716797 nb_pixel_total : 1192 time to create 1 rle with old method : 0.0015707015991210938 time for calcul the mask position with numpy : 0.006154060363769531 nb_pixel_total : 93 time to create 1 rle with old method : 0.00017142295837402344 time for calcul the mask position with numpy : 0.006322145462036133 nb_pixel_total : 5522 time to create 1 rle with old method : 0.006806135177612305 time for calcul the mask position with numpy : 0.006251096725463867 nb_pixel_total : 498 time to create 1 rle with old method : 0.0006389617919921875 time for calcul the mask position with numpy : 0.007776498794555664 nb_pixel_total : 708 time to create 1 rle with old method : 0.0008766651153564453 time for calcul the mask position with numpy : 0.011014699935913086 nb_pixel_total : 2137 time to create 1 rle with old method : 0.0025556087493896484 time for calcul the mask position with numpy : 0.010452747344970703 nb_pixel_total : 5609 time to create 1 rle with old method : 0.006219625473022461 time for calcul the mask position with numpy : 0.011524200439453125 nb_pixel_total : 409 time to create 1 rle with old method : 0.0005805492401123047 time for calcul the mask position with numpy : 0.010324239730834961 nb_pixel_total : 727 time to create 1 rle with old method : 0.001001596450805664 time for calcul the mask position with numpy : 0.010388612747192383 nb_pixel_total : 9555 time to create 1 rle with old method : 0.010654211044311523 time for calcul the mask position with numpy : 0.010599374771118164 nb_pixel_total : 261 time to create 1 rle with old method : 0.0005197525024414062 time for calcul the mask position with numpy : 0.01334834098815918 nb_pixel_total : 230 time to create 1 rle with old method : 0.00027298927307128906 time for calcul the mask position with numpy : 0.010360240936279297 nb_pixel_total : 10174 time to create 1 rle with old method : 0.01191568374633789 time for calcul the mask position with numpy : 0.011893987655639648 nb_pixel_total : 618 time to create 1 rle with old method : 0.0009765625 time for calcul the mask position with numpy : 0.011153459548950195 nb_pixel_total : 662 time to create 1 rle with old method : 0.0008611679077148438 time for calcul the mask position with numpy : 0.011252164840698242 nb_pixel_total : 2947 time to create 1 rle with old method : 0.003711700439453125 time for calcul the mask position with numpy : 0.010524749755859375 nb_pixel_total : 1035 time to create 1 rle with old method : 0.0013289451599121094 time for calcul the mask position with numpy : 0.006669044494628906 nb_pixel_total : 3569 time to create 1 rle with old method : 0.0047266483306884766 time for calcul the mask position with numpy : 0.006810665130615234 nb_pixel_total : 713 time to create 1 rle with old method : 0.0008802413940429688 time for calcul the mask position with numpy : 0.0064661502838134766 nb_pixel_total : 1900 time to create 1 rle with old method : 0.0024230480194091797 time for calcul the mask position with numpy : 0.006472349166870117 nb_pixel_total : 606 time to create 1 rle with old method : 0.0007638931274414062 time for calcul the mask position with numpy : 0.006379127502441406 nb_pixel_total : 160 time to create 1 rle with old method : 0.0002105236053466797 time for calcul the mask position with numpy : 0.006931304931640625 nb_pixel_total : 1219 time to create 1 rle with old method : 0.001585245132446289 time for calcul the mask position with numpy : 0.006719112396240234 nb_pixel_total : 499 time to create 1 rle with old method : 0.0005900859832763672 time for calcul the mask position with numpy : 0.006408214569091797 nb_pixel_total : 322 time to create 1 rle with old method : 0.0004119873046875 time for calcul the mask position with numpy : 0.006318092346191406 nb_pixel_total : 181 time to create 1 rle with old method : 0.00023245811462402344 time for calcul the mask position with numpy : 0.006217002868652344 nb_pixel_total : 73 time to create 1 rle with old method : 0.00010395050048828125 time for calcul the mask position with numpy : 0.00616145133972168 nb_pixel_total : 137 time to create 1 rle with old method : 0.00018453598022460938 time for calcul the mask position with numpy : 0.006245136260986328 nb_pixel_total : 1514 time to create 1 rle with old method : 0.0017933845520019531 time for calcul the mask position with numpy : 0.006390810012817383 nb_pixel_total : 641 time to create 1 rle with old method : 0.0007734298706054688 time for calcul the mask position with numpy : 0.006267070770263672 nb_pixel_total : 338 time to create 1 rle with old method : 0.00041413307189941406 time for calcul the mask position with numpy : 0.006375312805175781 nb_pixel_total : 315 time to create 1 rle with old method : 0.0004467964172363281 time for calcul the mask position with numpy : 0.006353616714477539 nb_pixel_total : 690 time to create 1 rle with old method : 0.0008130073547363281 time for calcul the mask position with numpy : 0.006327390670776367 nb_pixel_total : 452 time to create 1 rle with old method : 0.0005614757537841797 time for calcul the mask position with numpy : 0.006299734115600586 nb_pixel_total : 229 time to create 1 rle with old method : 0.0003299713134765625 time for calcul the mask position with numpy : 0.006426811218261719 nb_pixel_total : 600 time to create 1 rle with old method : 0.0008046627044677734 time for calcul the mask position with numpy : 0.008905649185180664 nb_pixel_total : 54 time to create 1 rle with old method : 0.00017786026000976562 time for calcul the mask position with numpy : 0.007129669189453125 nb_pixel_total : 396 time to create 1 rle with old method : 0.0004782676696777344 time for calcul the mask position with numpy : 0.0062029361724853516 nb_pixel_total : 43 time to create 1 rle with old method : 8.106231689453125e-05 time for calcul the mask position with numpy : 0.006795167922973633 nb_pixel_total : 105894 time to create 1 rle with old method : 0.11680889129638672 time for calcul the mask position with numpy : 0.006890058517456055 nb_pixel_total : 177 time to create 1 rle with old method : 0.00021958351135253906 time for calcul the mask position with numpy : 0.006359577178955078 nb_pixel_total : 1168 time to create 1 rle with old method : 0.001474618911743164 time for calcul the mask position with numpy : 0.006813526153564453 nb_pixel_total : 1066 time to create 1 rle with old method : 0.0012619495391845703 time for calcul the mask position with numpy : 0.0063364505767822266 nb_pixel_total : 15 time to create 1 rle with old method : 5.1021575927734375e-05 time for calcul the mask position with numpy : 0.006418943405151367 nb_pixel_total : 25 time to create 1 rle with old method : 7.510185241699219e-05 time for calcul the mask position with numpy : 0.006392478942871094 nb_pixel_total : 258 time to create 1 rle with old method : 0.0003180503845214844 time for calcul the mask position with numpy : 0.00672149658203125 nb_pixel_total : 316 time to create 1 rle with old method : 0.0003807544708251953 time for calcul the mask position with numpy : 0.00642704963684082 nb_pixel_total : 208 time to create 1 rle with old method : 0.00027298927307128906 time for calcul the mask position with numpy : 0.00641942024230957 nb_pixel_total : 2 time to create 1 rle with old method : 2.0265579223632812e-05 time for calcul the mask position with numpy : 0.006396055221557617 nb_pixel_total : 2992 time to create 1 rle with old method : 0.0033845901489257812 time for calcul the mask position with numpy : 0.006886720657348633 nb_pixel_total : 905 time to create 1 rle with old method : 0.0010571479797363281 time for calcul the mask position with numpy : 0.006778717041015625 nb_pixel_total : 468 time to create 1 rle with old method : 0.0005943775177001953 time for calcul the mask position with numpy : 0.009727239608764648 nb_pixel_total : 310 time to create 1 rle with old method : 0.0005574226379394531 time for calcul the mask position with numpy : 0.0069866180419921875 nb_pixel_total : 70 time to create 1 rle with old method : 0.00010275840759277344 time for calcul the mask position with numpy : 0.006351947784423828 nb_pixel_total : 2668 time to create 1 rle with old method : 0.003025531768798828 time for calcul the mask position with numpy : 0.0063321590423583984 nb_pixel_total : 234 time to create 1 rle with old method : 0.0002815723419189453 time for calcul the mask position with numpy : 0.006129264831542969 nb_pixel_total : 290 time to create 1 rle with old method : 0.0003807544708251953 time for calcul the mask position with numpy : 0.006963253021240234 nb_pixel_total : 321 time to create 1 rle with old method : 0.0004036426544189453 time for calcul the mask position with numpy : 0.006306886672973633 nb_pixel_total : 244 time to create 1 rle with old method : 0.00032401084899902344 time for calcul the mask position with numpy : 0.006247997283935547 nb_pixel_total : 806 time to create 1 rle with old method : 0.0009546279907226562 time for calcul the mask position with numpy : 0.006250858306884766 nb_pixel_total : 12 time to create 1 rle with old method : 5.0067901611328125e-05 time for calcul the mask position with numpy : 0.006701469421386719 nb_pixel_total : 949 time to create 1 rle with old method : 0.0011484622955322266 time for calcul the mask position with numpy : 0.006447792053222656 nb_pixel_total : 493 time to create 1 rle with old method : 0.0006198883056640625 time for calcul the mask position with numpy : 0.006628990173339844 nb_pixel_total : 544 time to create 1 rle with old method : 0.0006844997406005859 time for calcul the mask position with numpy : 0.006243228912353516 nb_pixel_total : 323 time to create 1 rle with old method : 0.00039577484130859375 time for calcul the mask position with numpy : 0.006316184997558594 nb_pixel_total : 1046 time to create 1 rle with old method : 0.0012922286987304688 time for calcul the mask position with numpy : 0.0064411163330078125 nb_pixel_total : 335 time to create 1 rle with old method : 0.0004124641418457031 time for calcul the mask position with numpy : 0.006659269332885742 nb_pixel_total : 315 time to create 1 rle with old method : 0.0003859996795654297 time for calcul the mask position with numpy : 0.006833553314208984 nb_pixel_total : 438 time to create 1 rle with old method : 0.0005726814270019531 time for calcul the mask position with numpy : 0.006515026092529297 nb_pixel_total : 766 time to create 1 rle with old method : 0.0009448528289794922 time for calcul the mask position with numpy : 0.006400108337402344 nb_pixel_total : 689 time to create 1 rle with old method : 0.0007998943328857422 time for calcul the mask position with numpy : 0.006497383117675781 nb_pixel_total : 207 time to create 1 rle with old method : 0.0002696514129638672 time for calcul the mask position with numpy : 0.006715536117553711 nb_pixel_total : 551 time to create 1 rle with old method : 0.0006625652313232422 time for calcul the mask position with numpy : 0.0066242218017578125 nb_pixel_total : 10 time to create 1 rle with old method : 5.626678466796875e-05 time for calcul the mask position with numpy : 0.006683826446533203 nb_pixel_total : 370 time to create 1 rle with old method : 0.00044035911560058594 time for calcul the mask position with numpy : 0.006489276885986328 nb_pixel_total : 635 time to create 1 rle with old method : 0.0007677078247070312 time for calcul the mask position with numpy : 0.006334781646728516 nb_pixel_total : 320 time to create 1 rle with old method : 0.0003819465637207031 time for calcul the mask position with numpy : 0.0067138671875 nb_pixel_total : 186 time to create 1 rle with old method : 0.00024199485778808594 time for calcul the mask position with numpy : 0.0065746307373046875 nb_pixel_total : 132 time to create 1 rle with old method : 0.00017523765563964844 time for calcul the mask position with numpy : 0.006711006164550781 nb_pixel_total : 1638 time to create 1 rle with old method : 0.001940011978149414 time for calcul the mask position with numpy : 0.0066034793853759766 nb_pixel_total : 1243 time to create 1 rle with old method : 0.0015001296997070312 time for calcul the mask position with numpy : 0.006608486175537109 nb_pixel_total : 39 time to create 1 rle with old method : 7.557868957519531e-05 time for calcul the mask position with numpy : 0.006737709045410156 nb_pixel_total : 320 time to create 1 rle with old method : 0.00040602684020996094 time for calcul the mask position with numpy : 0.0067026615142822266 nb_pixel_total : 523 time to create 1 rle with old method : 0.0006427764892578125 time for calcul the mask position with numpy : 0.009847402572631836 nb_pixel_total : 143 time to create 1 rle with old method : 0.00019812583923339844 time for calcul the mask position with numpy : 0.006357669830322266 nb_pixel_total : 513 time to create 1 rle with old method : 0.0006263256072998047 time for calcul the mask position with numpy : 0.006409645080566406 nb_pixel_total : 814 time to create 1 rle with old method : 0.0009582042694091797 time for calcul the mask position with numpy : 0.006429433822631836 nb_pixel_total : 720 time to create 1 rle with old method : 0.0008873939514160156 time for calcul the mask position with numpy : 0.006598711013793945 nb_pixel_total : 609 time to create 1 rle with old method : 0.0007276535034179688 time for calcul the mask position with numpy : 0.005941152572631836 nb_pixel_total : 145 time to create 1 rle with old method : 0.00020885467529296875 time for calcul the mask position with numpy : 0.006111860275268555 nb_pixel_total : 1200 time to create 1 rle with old method : 0.0013480186462402344 time for calcul the mask position with numpy : 0.006094217300415039 nb_pixel_total : 1108 time to create 1 rle with old method : 0.0012369155883789062 time for calcul the mask position with numpy : 0.005878448486328125 nb_pixel_total : 430 time to create 1 rle with old method : 0.0005311965942382812 time for calcul the mask position with numpy : 0.006038665771484375 nb_pixel_total : 973 time to create 1 rle with old method : 0.0011451244354248047 time for calcul the mask position with numpy : 0.006161689758300781 nb_pixel_total : 387 time to create 1 rle with old method : 0.00045943260192871094 time for calcul the mask position with numpy : 0.006214618682861328 nb_pixel_total : 462 time to create 1 rle with old method : 0.0005614757537841797 time for calcul the mask position with numpy : 0.006476879119873047 nb_pixel_total : 280 time to create 1 rle with old method : 0.00035858154296875 time for calcul the mask position with numpy : 0.006092548370361328 nb_pixel_total : 368 time to create 1 rle with old method : 0.00045013427734375 time for calcul the mask position with numpy : 0.0063018798828125 nb_pixel_total : 371 time to create 1 rle with old method : 0.0004715919494628906 time for calcul the mask position with numpy : 0.0075991153717041016 nb_pixel_total : 18 time to create 1 rle with old method : 6.29425048828125e-05 time for calcul the mask position with numpy : 0.007585048675537109 nb_pixel_total : 2488 time to create 1 rle with old method : 0.003679037094116211 time for calcul the mask position with numpy : 0.007770061492919922 nb_pixel_total : 34 time to create 1 rle with old method : 9.322166442871094e-05 time for calcul the mask position with numpy : 0.0078125 nb_pixel_total : 1061 time to create 1 rle with old method : 0.0016202926635742188 time for calcul the mask position with numpy : 0.007948160171508789 nb_pixel_total : 266 time to create 1 rle with old method : 0.00036334991455078125 time for calcul the mask position with numpy : 0.008186101913452148 nb_pixel_total : 1153 time to create 1 rle with old method : 0.0018031597137451172 time for calcul the mask position with numpy : 0.008343935012817383 nb_pixel_total : 1332 time to create 1 rle with old method : 0.0022242069244384766 time for calcul the mask position with numpy : 0.008015632629394531 nb_pixel_total : 868 time to create 1 rle with old method : 0.0011548995971679688 time for calcul the mask position with numpy : 0.008025169372558594 nb_pixel_total : 188 time to create 1 rle with old method : 0.0002562999725341797 time for calcul the mask position with numpy : 0.011897087097167969 nb_pixel_total : 1027 time to create 1 rle with old method : 0.001741170883178711 time for calcul the mask position with numpy : 0.012182474136352539 nb_pixel_total : 30 time to create 1 rle with old method : 0.00010323524475097656 time for calcul the mask position with numpy : 0.012270450592041016 nb_pixel_total : 1212 time to create 1 rle with old method : 0.0018911361694335938 time for calcul the mask position with numpy : 0.01216888427734375 nb_pixel_total : 1522 time to create 1 rle with old method : 0.002203702926635742 time for calcul the mask position with numpy : 0.011719703674316406 nb_pixel_total : 246 time to create 1 rle with old method : 0.00038170814514160156 time for calcul the mask position with numpy : 0.012321710586547852 nb_pixel_total : 505 time to create 1 rle with old method : 0.0007879734039306641 time for calcul the mask position with numpy : 0.011890888214111328 nb_pixel_total : 843 time to create 1 rle with old method : 0.0013456344604492188 time for calcul the mask position with numpy : 0.011886119842529297 nb_pixel_total : 831 time to create 1 rle with old method : 0.0012960433959960938 time for calcul the mask position with numpy : 0.01214289665222168 nb_pixel_total : 972 time to create 1 rle with old method : 0.001399993896484375 time for calcul the mask position with numpy : 0.011050939559936523 nb_pixel_total : 1187 time to create 1 rle with old method : 0.0018239021301269531 time for calcul the mask position with numpy : 0.010379552841186523 nb_pixel_total : 85 time to create 1 rle with old method : 0.0001327991485595703 time for calcul the mask position with numpy : 0.010701656341552734 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002923011779785156 time for calcul the mask position with numpy : 0.010727167129516602 nb_pixel_total : 1137 time to create 1 rle with old method : 0.0015230178833007812 time for calcul the mask position with numpy : 0.010845661163330078 nb_pixel_total : 161 time to create 1 rle with old method : 0.0002741813659667969 time for calcul the mask position with numpy : 0.015335321426391602 nb_pixel_total : 2411 time to create 1 rle with old method : 0.0031092166900634766 time for calcul the mask position with numpy : 0.010670900344848633 nb_pixel_total : 566 time to create 1 rle with old method : 0.0008702278137207031 time for calcul the mask position with numpy : 0.011298656463623047 nb_pixel_total : 187 time to create 1 rle with old method : 0.00035643577575683594 time for calcul the mask position with numpy : 0.011419534683227539 nb_pixel_total : 133 time to create 1 rle with old method : 0.00018596649169921875 time for calcul the mask position with numpy : 0.011255741119384766 nb_pixel_total : 844 time to create 1 rle with old method : 0.0011878013610839844 time for calcul the mask position with numpy : 0.011558771133422852 nb_pixel_total : 413 time to create 1 rle with old method : 0.0006380081176757812 time for calcul the mask position with numpy : 0.010050773620605469 nb_pixel_total : 251 time to create 1 rle with old method : 0.0002598762512207031 time for calcul the mask position with numpy : 0.008432388305664062 nb_pixel_total : 95 time to create 1 rle with old method : 0.00012254714965820312 time for calcul the mask position with numpy : 0.008499622344970703 nb_pixel_total : 2 time to create 1 rle with old method : 1.4543533325195312e-05 create new chi : 1.7898674011230469 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0018680095672607422 batch 1 Loaded 159 chid ids of type : 4230 Number RLEs to save : 14407 TO DO : save crop sub photo not yet done ! save time : 1.2005040645599365 map_output_result : {1341464000: (0.0, 'Should be the crop_list due to order', 0.0), 1341463952: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1341464000, 1341463952] Looping around the photos to save general results len do output : 2 /1341464000.Didn't retrieve data . /1341463952.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2648334') ('4234', '21141655', '1341464000', None, None, None, None, None, '2648334') ('4234', None, None, None, None, None, None, None, '2648334') ('4234', '21141655', '1341463952', None, None, None, None, None, '2648334') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.011762142181396484 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.995779275894165 time spend to save output : 0.01201939582824707 total time spend for step 4 : 10.007798671722412 step5:crop_condition Fri Mar 7 14:21:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 2 ! batch 1 Loaded 295 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 109 About to insert : list_path_to_insert length 109 new photo from crops ! About to upload 109 photos upload in portfolio : 4869462 init cache_photo without model_param we have 109 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741353670_3074870 we have uploaded 109 photos in the portfolio 4869462 time of upload the photos Elapsed time : 33.50081515312195 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 26 About to insert : list_path_to_insert length 26 new photo from crops ! About to upload 26 photos upload in portfolio : 4869462 init cache_photo without model_param we have 26 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741353704_3074870 we have uploaded 26 photos in the portfolio 4869462 time of upload the photos Elapsed time : 10.372491121292114 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741353714_3074870 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.491633653640747 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 9 About to insert : list_path_to_insert length 9 new photo from crops ! About to upload 9 photos upload in portfolio : 4869462 init cache_photo without model_param we have 9 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741353716_3074870 we have uploaded 9 photos in the portfolio 4869462 time of upload the photos Elapsed time : 3.1808674335479736 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 42 About to insert : list_path_to_insert length 42 new photo from crops ! About to upload 42 photos upload in portfolio : 4869462 init cache_photo without model_param we have 42 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741353720_3074870 we have uploaded 42 photos in the portfolio 4869462 time of upload the photos Elapsed time : 23.139628887176514 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741353743_3074870 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.2381765842437744 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1341464000, 1341463952] Looping around the photos to save general results len do output : 190 /1341467452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467462Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467496Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467510Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467523Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467530Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467531Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467532Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467533Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467534Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467535Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467536Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467537Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467538Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467539Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467540Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467541Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467543Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467544Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467545Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467546Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467547Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467548Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467549Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467551Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467552Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467553Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467555Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467556Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467557Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467558Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467559Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467560Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467561Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467562Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467564Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467565Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467566Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467567Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467568Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467570Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467571Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467572Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467573Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467574Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467575Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467576Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467577Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467578Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467579Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467580Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467581Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467582Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467588Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467589Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467590Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467592Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467593Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467594Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467595Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467596Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467598Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467599Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467602Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467603Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467604Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467605Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467606Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467607Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467608Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467609Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467610Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467611Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467612Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467613Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467614Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467615Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467616Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467617Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467618Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467620Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467625Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467626Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467627Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467628Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467630Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467632Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467634Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467636Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467729Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341467760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2648334') ('4234', '21141655', '1341464000', None, None, None, None, None, '2648334') ('4234', None, None, None, None, None, None, None, '2648334') ('4234', '21141655', '1341463952', None, None, None, None, None, '2648334') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 572 time used for this insertion : 0.0380401611328125 save_final save missing photos in datou_result : time spend for datou_step_exec : 76.23048520088196 time spend to save output : 0.04331636428833008 total time spend for step 5 : 76.27380156517029 step6:thcl Fri Mar 7 14:22:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.0027093887329101562 time to convert the images to numpy array : 0.0631556510925293 time to import caffe and check if the image exist : 0.011304616928100586 time to convert the images to numpy array : 0.060243844985961914 time to import caffe and check if the image exist : 0.01472926139831543 time to convert the images to numpy array : 0.07126116752624512 time to import caffe and check if the image exist : 0.016476869583129883 time to convert the images to numpy array : 0.0723886489868164 time to import caffe and check if the image exist : 0.017906665802001953 time to convert the images to numpy array : 0.07510805130004883 time to import caffe and check if the image exist : 0.02401876449584961 time to convert the images to numpy array : 0.0721125602722168 time to import caffe and check if the image exist : 0.029059886932373047 time to convert the images to numpy array : 0.06563472747802734 time to import caffe and check if the image exist : 0.019971609115600586 time to convert the images to numpy array : 0.07634949684143066 time to import caffe and check if the image exist : 0.03169655799865723 time to convert the images to numpy array : 0.06864690780639648 time to import caffe and check if the image exist : 0.030691862106323242 time to convert the images to numpy array : 0.06760478019714355 total time to convert the images to numpy array : 0.4245421886444092 list photo_ids error: [] list photo_ids correct : [1341467546, 1341467547, 1341467548, 1341467549, 1341467551, 1341467552, 1341467553, 1341467555, 1341467556, 1341467557, 1341467558, 1341467559, 1341467560, 1341467561, 1341467562, 1341467564, 1341467565, 1341467566, 1341467567, 1341467452, 1341467453, 1341467454, 1341467455, 1341467456, 1341467457, 1341467458, 1341467459, 1341467460, 1341467461, 1341467462, 1341467463, 1341467464, 1341467465, 1341467466, 1341467467, 1341467469, 1341467471, 1341467476, 1341467616, 1341467617, 1341467618, 1341467620, 1341467625, 1341467626, 1341467627, 1341467628, 1341467630, 1341467632, 1341467634, 1341467636, 1341467638, 1341467712, 1341467713, 1341467714, 1341467715, 1341467716, 1341467717, 1341467568, 1341467570, 1341467571, 1341467572, 1341467573, 1341467574, 1341467575, 1341467576, 1341467577, 1341467578, 1341467579, 1341467580, 1341467581, 1341467582, 1341467588, 1341467589, 1341467590, 1341467592, 1341467593, 1341467522, 1341467523, 1341467524, 1341467525, 1341467530, 1341467531, 1341467532, 1341467533, 1341467534, 1341467535, 1341467536, 1341467537, 1341467538, 1341467539, 1341467540, 1341467541, 1341467543, 1341467544, 1341467545, 1341467503, 1341467504, 1341467505, 1341467506, 1341467507, 1341467508, 1341467509, 1341467510, 1341467511, 1341467512, 1341467513, 1341467514, 1341467515, 1341467516, 1341467517, 1341467518, 1341467519, 1341467520, 1341467521, 1341467738, 1341467740, 1341467741, 1341467742, 1341467743, 1341467744, 1341467745, 1341467746, 1341467747, 1341467748, 1341467750, 1341467751, 1341467752, 1341467753, 1341467754, 1341467755, 1341467756, 1341467759, 1341467760, 1341467718, 1341467719, 1341467720, 1341467721, 1341467722, 1341467723, 1341467724, 1341467725, 1341467726, 1341467727, 1341467728, 1341467729, 1341467730, 1341467731, 1341467732, 1341467733, 1341467734, 1341467736, 1341467737, 1341467479, 1341467482, 1341467483, 1341467484, 1341467485, 1341467486, 1341467487, 1341467489, 1341467492, 1341467493, 1341467494, 1341467495, 1341467496, 1341467497, 1341467498, 1341467499, 1341467500, 1341467501, 1341467502, 1341467594, 1341467595, 1341467596, 1341467598, 1341467599, 1341467602, 1341467603, 1341467604, 1341467605, 1341467606, 1341467607, 1341467608, 1341467609, 1341467610, 1341467611, 1341467612, 1341467613, 1341467614, 1341467615] number of photos to traite : 190 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10372 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10153 max_wait_temp : 1 max_wait : 0 dict_keys(['prob', 'pool5']) time used to do the prepocess of the images : 0.9726498126983643 time used to do the prediction : 0.7216880321502686 save descriptor for thcl : 3237 time to traite the descriptors : 1.120039463043213 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1341467546 To insert : 1341467547 To insert : 1341467548 To insert : 1341467549 To insert : 1341467551 To insert : 1341467552 To insert : 1341467553 To insert : 1341467555 To insert : 1341467556 To insert : 1341467557 To insert : 1341467558 To insert : 1341467559 To insert : 1341467560 To insert : 1341467561 To insert : 1341467562 To insert : 1341467564 To insert : 1341467565 To insert : 1341467566 To insert : 1341467567 To insert : 1341467452 To insert : 1341467453 To insert : 1341467454 To insert : 1341467455 To insert : 1341467456 To insert : 1341467457 To insert : 1341467458 To insert : 1341467459 To insert : 1341467460 To insert : 1341467461 To insert : 1341467462 To insert : 1341467463 To insert : 1341467464 To insert : 1341467465 To insert : 1341467466 To insert : 1341467467 To insert : 1341467469 To insert : 1341467471 To insert : 1341467476 To insert : 1341467616 To insert : 1341467617 To insert : 1341467618 To insert : 1341467620 To insert : 1341467625 To insert : 1341467626 To insert : 1341467627 To insert : 1341467628 To insert : 1341467630 To insert : 1341467632 To insert : 1341467634 To insert : 1341467636 To insert : 1341467638 To insert : 1341467712 To insert : 1341467713 To insert : 1341467714 To insert : 1341467715 To insert : 1341467716 To insert : 1341467717 To insert : 1341467568 To insert : 1341467570 To insert : 1341467571 To insert : 1341467572 To insert : 1341467573 To insert : 1341467574 To insert : 1341467575 To insert : 1341467576 To insert : 1341467577 To insert : 1341467578 To insert : 1341467579 To insert : 1341467580 To insert : 1341467581 To insert : 1341467582 To insert : 1341467588 To insert : 1341467589 To insert : 1341467590 To insert : 1341467592 To insert : 1341467593 To insert : 1341467522 To insert : 1341467523 To insert : 1341467524 To insert : 1341467525 To insert : 1341467530 To insert : 1341467531 To insert : 1341467532 To insert : 1341467533 To insert : 1341467534 To insert : 1341467535 To insert : 1341467536 To insert : 1341467537 To insert : 1341467538 To insert : 1341467539 To insert : 1341467540 To insert : 1341467541 To insert : 1341467543 To insert : 1341467544 To insert : 1341467545 To insert : 1341467503 To insert : 1341467504 To insert : 1341467505 To insert : 1341467506 To insert : 1341467507 To insert : 1341467508 To insert : 1341467509 To insert : 1341467510 To insert : 1341467511 To insert : 1341467512 To insert : 1341467513 To insert : 1341467514 To insert : 1341467515 To insert : 1341467516 To insert : 1341467517 To insert : 1341467518 To insert : 1341467519 To insert : 1341467520 To insert : 1341467521 To insert : 1341467738 To insert : 1341467740 To insert : 1341467741 To insert : 1341467742 To insert : 1341467743 To insert : 1341467744 To insert : 1341467745 To insert : 1341467746 To insert : 1341467747 To insert : 1341467748 To insert : 1341467750 To insert : 1341467751 To insert : 1341467752 To insert : 1341467753 To insert : 1341467754 To insert : 1341467755 To insert : 1341467756 To insert : 1341467759 To insert : 1341467760 To insert : 1341467718 To insert : 1341467719 To insert : 1341467720 To insert : 1341467721 To insert : 1341467722 To insert : 1341467723 To insert : 1341467724 To insert : 1341467725 To insert : 1341467726 To insert : 1341467727 To insert : 1341467728 To insert : 1341467729 To insert : 1341467730 To insert : 1341467731 To insert : 1341467732 To insert : 1341467733 To insert : 1341467734 To insert : 1341467736 To insert : 1341467737 To insert : 1341467479 To insert : 1341467482 To insert : 1341467483 To insert : 1341467484 To insert : 1341467485 To insert : 1341467486 To insert : 1341467487 To insert : 1341467489 To insert : 1341467492 To insert : 1341467493 To insert : 1341467494 To insert : 1341467495 To insert : 1341467496 To insert : 1341467497 To insert : 1341467498 To insert : 1341467499 To insert : 1341467500 To insert : 1341467501 To insert : 1341467502 To insert : 1341467594 To insert : 1341467595 To insert : 1341467596 To insert : 1341467598 To insert : 1341467599 To insert : 1341467602 To insert : 1341467603 To insert : 1341467604 To insert : 1341467605 To insert : 1341467606 To insert : 1341467607 To insert : 1341467608 To insert : 1341467609 To insert : 1341467610 To insert : 1341467611 To insert : 1341467612 To insert : 1341467613 To insert : 1341467614 To insert : 1341467615 time to insert the descriptors : 66.4787187576294 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 301 time used for this insertion : 2.860034704208374 save missing photos in datou_result : time spend for datou_step_exec : 73.95075130462646 time spend to save output : 2.910222053527832 total time spend for step 6 : 76.8609733581543 step7:ventilate_hashtags_in_portfolio Fri Mar 7 14:23:41 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 21141655 get user id for portfolio 21141655 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21141655 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','PET_clair','Tetrapak','pet_clair','pet_fonce','mal_croppe','autre','carton','metal','refus','flou','Carton','environnement','Film_plastique','PET_fonce','Papier','PEHD','papier')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21141655 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','PET_clair','Tetrapak','pet_clair','pet_fonce','mal_croppe','autre','carton','metal','refus','flou','Carton','environnement','Film_plastique','PET_fonce','Papier','PEHD','papier')) AND mptpi.`min_score`=0.6 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21141655 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','PET_clair','Tetrapak','pet_clair','pet_fonce','mal_croppe','autre','carton','metal','refus','flou','Carton','environnement','Film_plastique','PET_fonce','Papier','PEHD','papier')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21141655 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','PET_clair','Tetrapak','pet_clair','pet_fonce','mal_croppe','autre','carton','metal','refus','flou','Carton','environnement','Film_plastique','PET_fonce','Papier','PEHD','papier')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/21142057,21142044,21142043,21142055,21142046,21142047,21142052,21142049,21142050,21142051,21142053,21142054,21142058?tags=pehd,pet_clair,tetrapak,pet_fonce,mal_croppe,autre,carton,metal,refus,flou,environnement,film_plastique,papier&datou_id_consolidate=4235&port_consolidate=21141655 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1341464000, 1341463952] Looping around the photos to save general results len do output : 1 /21141655. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2648334') ('4234', '21141655', '1341464000', None, None, None, None, None, '2648334') ('4234', None, None, None, None, None, None, None, '2648334') ('4234', '21141655', '1341463952', None, None, None, None, None, '2648334') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.0116424560546875 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.760657787322998 time spend to save output : 0.011879682540893555 total time spend for step 7 : 1.7725374698638916 step8:final Fri Mar 7 14:23:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1341464000: ('0.20272673253718004',), 1341463952: ('0.20272673253718004',)} new output for save of step final : {1341464000: ('0.20272673253718004',), 1341463952: ('0.20272673253718004',)} [1341464000, 1341463952] Looping around the photos to save general results len do output : 2 /1341464000.Didn't retrieve data . /1341463952.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2648334') ('4234', '21141655', '1341464000', None, None, None, None, None, '2648334') ('4234', None, None, None, None, None, None, None, '2648334') ('4234', '21141655', '1341463952', None, None, None, None, None, '2648334') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.013262748718261719 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11843633651733398 time spend to save output : 0.013498067855834961 total time spend for step 8 : 0.13193440437316895 step9:velours_tree Fri Mar 7 14:23:43 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 21142057,21142044,21142043,21142055,21142046,21142047,21142052,21142049,21142050,21142051,21142053,21142054,21142058 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21142057 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21142044 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21142043 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21142055 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21142046 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21142047 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21142052 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21142049 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21142050 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21142051 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21142053 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21142054 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21142058 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 190 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [5 3 2 2 1 0 2 2 1 2 0 2 0 2 2 0 1 5 0 2 0 2 1 2 1 1 1 2 2 2 2 2 2 2 1 2 0 0 0 0 0 2 2 2 1 1 2 2 2 0 2 0 0 2 0 2 0 0 0 1 0 2 1 0 0 2 2 0 2 1 0 0 2 0 2 0 0 1 2 4 0 2 1 2 2 2 2 0 2 2 2 1 2 0 1 2 0 2 2 2 1 5 2 2 2 2 0 2 0 0 0 2 5 4 0 1 3 0 1 0 5 5 0 3 2 5 5 0 0 1 1 1 3 0 1 0 0 2 0 0 2 0 0 0 0 0 3 3 5 2 0 2 5 1 0 0 1 5 1 1 2 2 2 1 1 3 3 3 2 5 0 0 2 0 2 0 2 1 5 0 2 1 1 2 2 1 1 5 0 5] Elapsed time: 0.027973175048828125 graph_id used : 81889 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/21142057,21142044,21142043,21142055,21142046,21142047,21142052,21142049,21142050,21142051,21142053,21142054,21142058?tags=pehd,pet_clair,tetrapak,pet_fonce,mal_croppe,autre,carton,metal,refus,flou,environnement,film_plastique,papier&datou_id_consolidate=4235&port_consolidate=21141655&tree_id=81889 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1341464000, 1341463952] Looping around the photos to save general results len do output : 1 /21141655Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2648334') ('4234', '21141655', '1341464000', None, None, None, None, None, '2648334') ('4234', None, None, None, None, None, None, None, '2648334') ('4234', '21141655', '1341463952', None, None, None, None, None, '2648334') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.012603044509887695 save_final save missing photos in datou_result : time spend for datou_step_exec : 19.4351224899292 time spend to save output : 0.01296854019165039 total time spend for step 9 : 19.44809103012085 step10:send_mail_cod Fri Mar 7 14:24:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P21141655_07-03-2025_14_24_03.pdf 21142039 change filename to text .change filename to text .imagette211420391741353843 21142026 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211420261741353843 21142025 imagette211420251741353844 21142037 imagette211420371741353844 21142028 imagette211420281741353844 21142029 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211420291741353844 21142034 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211420341741353845 21142031 change filename to text .change filename to text .imagette211420311741353846 21142032 imagette211420321741353846 21142033 imagette211420331741353846 21142036 imagette211420361741353846 21142040 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211420401741353846 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=21141655 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/21142057,21142044,21142043,21142055,21142046,21142047,21142052,21142049,21142050,21142051,21142053,21142054,21142058?tags=pehd,pet_clair,tetrapak,pet_fonce,mal_croppe,autre,carton,metal,refus,flou,environnement,film_plastique,papier&datou_id_consolidate=4235&port_consolidate=21141655&tree_id=81889 your option no_mail is active, we will not send the real mail to your client args[1341464000] : ((1341464000, -7.8008035160160825, 492609224), (1341464000, -0.4220852842318868, 496442774), '0.20272673253718004') We are sending mail with results at cod@fotonower.com args[1341463952] : ((1341463952, -7.855991277478289, 492609224), (1341463952, -0.4030057735777411, 496442774), '0.20272673253718004') We are sending mail with results at cod@fotonower.com refus_total : 0.20272673253718004 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21141655 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21141655_07-03-2025_14_24_03.pdf results_Qualipapia_P21141655_07-03-2025_14_24_03.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21141655_07-03-2025_14_24_03.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','21141655','results_Qualipapia_P21141655_07-03-2025_14_24_03.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21141655_07-03-2025_14_24_03.pdf','pdf','','0.15','0.20272673253718004') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1341464000, 1341463952] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2648334') ('4234', '21141655', '1341464000', None, None, None, None, None, '2648334') ('4234', None, None, None, None, None, None, None, '2648334') ('4234', '21141655', '1341463952', None, None, None, None, None, '2648334') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.01183009147644043 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.778223037719727 time spend to save output : 0.012051820755004883 total time spend for step 10 : 5.7902748584747314 step11:split_time_score Fri Mar 7 14:24:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('11', 2),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 07032025 21141655 Nombre de photos uploadées : 2 / 23040 (0%) 07032025 21141655 Nombre de photos taguées (types de déchets): 2 / 2 (100%) 07032025 21141655 Nombre de photos taguées (volume) : 0 / 2 (0%) elapsed_time : load_data_split_time_score 3.5762786865234375e-06 elapsed_time : order_list_meta_photo_and_scores 1.0251998901367188e-05 ?? elapsed_time : fill_and_build_computed_from_old_data 0.00025391578674316406 elapsed_time : insert_dashboard_record_day_entry 0.023619890213012695 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21140557 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21140557 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21140558 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21140559 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21140559 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21140560 order by id desc limit 1 Qualite : 0.1918403156698496 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21140561_07-03-2025_12_49_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21140561 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21140561 AND mptpi.`type`=4230 To do Qualite : 0.22789197218835494 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21140562_07-03-2025_13_49_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21140562 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21140562 AND mptpi.`type`=4230 To do Qualite : 0.1826647347275418 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21140563_07-03-2025_13_33_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21140563 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21140563 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21141642 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21141645 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21141647 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21141650 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21141652 order by id desc limit 1 Qualite : 0.20272673253718004 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21141655_07-03-2025_14_24_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21141655 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21141655 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21141657 order by id desc limit 1 NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'07032025': {'nb_upload': 2, 'nb_taggue_class': 2, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1341464000, 1341463952] Looping around the photos to save general results len do output : 1 /21141655Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2648334') ('4234', '21141655', '1341464000', None, None, None, None, None, '2648334') ('4234', None, None, None, None, None, None, None, '2648334') ('4234', '21141655', '1341463952', None, None, None, None, None, '2648334') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.01218271255493164 save_final save missing photos in datou_result : time spend for datou_step_exec : 10.388667106628418 time spend to save output : 0.012379646301269531 total time spend for step 11 : 10.401046752929688 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 2 set_done_treatment 37.57user 22.81system 3:53.23elapsed 25%CPU (0avgtext+0avgdata 2714924maxresident)k 697984inputs+12472outputs (152major+2501373minor)pagefaults 0swaps