python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3990467 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 we have a portfolio with more photos than limit : 23>5 please execute split_portfolio.py -i 20957641 -l 5 size over we load limit photo not treated list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2627702'] with mtr_portfolio_ids : ['20957641'] and first list_photo_ids : [] new path : /proc/3990467/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! BFBFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 5 ; length of list_pids : 5 ; length of list_args : 5 time to download the photos : 1.1786229610443115 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Mon Mar 3 02:20:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10814 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-03 02:20:32.812098: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-03 02:20:32.843045: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-03 02:20:32.845221: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f9a38000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-03 02:20:32.845280: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-03 02:20:32.849363: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-03 02:20:33.092975: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0xd6aecd0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-03 02:20:33.093016: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-03 02:20:33.093999: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-03 02:20:33.094341: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-03 02:20:33.096497: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-03 02:20:33.098599: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-03 02:20:33.098952: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-03 02:20:33.101322: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-03 02:20:33.102371: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-03 02:20:33.106913: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-03 02:20:33.108432: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-03 02:20:33.108511: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-03 02:20:33.109244: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-03 02:20:33.109259: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-03 02:20:33.109267: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-03 02:20:33.112620: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-03 02:20:33.472191: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-03 02:20:33.472278: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-03 02:20:33.472301: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-03 02:20:33.472322: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-03 02:20:33.472342: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-03 02:20:33.472363: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-03 02:20:33.472383: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-03 02:20:33.472403: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-03 02:20:33.474074: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-03 02:20:33.475421: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-03 02:20:33.475456: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-03 02:20:33.475475: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-03 02:20:33.475492: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-03 02:20:33.475509: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-03 02:20:33.475526: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-03 02:20:33.475543: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-03 02:20:33.475560: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-03 02:20:33.477157: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-03 02:20:33.477190: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-03 02:20:33.477200: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-03 02:20:33.477210: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-03 02:20:33.478848: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 10023 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-03 02:20:40.424867: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-03 02:20:40.614987: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 5 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.04766 max: 149.20937 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.0006079673767089844 length of segment : 46 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 439 time to create 1 rle with old method : 0.0008530616760253906 length of segment : 40 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 279 time to create 1 rle with old method : 0.0005307197570800781 length of segment : 27 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 466 time to create 1 rle with old method : 0.0008599758148193359 length of segment : 27 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1091 time to create 1 rle with old method : 0.002062082290649414 length of segment : 40 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 737 time to create 1 rle with old method : 0.0013740062713623047 length of segment : 35 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 411 time to create 1 rle with old method : 0.0008461475372314453 length of segment : 52 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.83672 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 2576 time to create 1 rle with old method : 0.0032072067260742188 length of segment : 50 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 484 time to create 1 rle with old method : 0.0006282329559326172 length of segment : 31 time for calcul the mask position with numpy : 0.0001964569091796875 nb_pixel_total : 34 time to create 1 rle with old method : 0.0001201629638671875 length of segment : 19 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 178 time to create 1 rle with old method : 0.00026154518127441406 length of segment : 17 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 53 time to create 1 rle with old method : 0.00010204315185546875 length of segment : 8 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 2478 time to create 1 rle with old method : 0.002986431121826172 length of segment : 92 Processing 1 images image shape: (400, 400, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -103.40313 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 1488 time to create 1 rle with old method : 0.0018696784973144531 length of segment : 35 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 460 time to create 1 rle with old method : 0.0007002353668212891 length of segment : 13 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 475 time to create 1 rle with old method : 0.0007274150848388672 length of segment : 14 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.38750 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 232 time to create 1 rle with old method : 0.0003380775451660156 length of segment : 23 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 570 time to create 1 rle with old method : 0.0007157325744628906 length of segment : 58 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 460 time to create 1 rle with old method : 0.0007128715515136719 length of segment : 24 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 234.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 112.36953 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 547 time to create 1 rle with old method : 0.001390218734741211 length of segment : 18 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 561 time to create 1 rle with old method : 0.0006804466247558594 length of segment : 57 Processing 1 images image shape: (400, 400, 3) min: 29.00000 max: 199.00000 molded_images shape: (1, 640, 640, 3) min: -94.70000 max: 75.82266 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.11016 max: 150.78750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 2297 time to create 1 rle with old method : 0.0029349327087402344 length of segment : 49 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 121 time to create 1 rle with old method : 0.00019407272338867188 length of segment : 16 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 392 time to create 1 rle with old method : 0.0005822181701660156 length of segment : 17 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.0005991458892822266 length of segment : 16 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 567 time to create 1 rle with old method : 0.0011022090911865234 length of segment : 29 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 588 time to create 1 rle with old method : 0.0007996559143066406 length of segment : 26 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 1063 time to create 1 rle with old method : 0.0019326210021972656 length of segment : 49 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 1228 time to create 1 rle with old method : 0.0015187263488769531 length of segment : 52 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.65313 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 481 time to create 1 rle with old method : 0.0007205009460449219 length of segment : 20 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 712 time to create 1 rle with old method : 0.0009284019470214844 length of segment : 31 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 1039 time to create 1 rle with old method : 0.0013480186462402344 length of segment : 62 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 140 time to create 1 rle with old method : 0.0002751350402832031 length of segment : 13 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.91094 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 1990 time to create 1 rle with old method : 0.0025489330291748047 length of segment : 45 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 983 time to create 1 rle with old method : 0.0014584064483642578 length of segment : 32 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 1174 time to create 1 rle with old method : 0.0014653205871582031 length of segment : 36 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 1373 time to create 1 rle with old method : 0.0021228790283203125 length of segment : 43 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 819 time to create 1 rle with old method : 0.0012879371643066406 length of segment : 38 time for calcul the mask position with numpy : 0.00020503997802734375 nb_pixel_total : 5848 time to create 1 rle with old method : 0.0072174072265625 length of segment : 190 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 796 time to create 1 rle with old method : 0.000982522964477539 length of segment : 37 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.72109 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 1585 time to create 1 rle with old method : 0.002050161361694336 length of segment : 156 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 212 time to create 1 rle with old method : 0.0002989768981933594 length of segment : 30 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 1287 time to create 1 rle with old method : 0.0016984939575195312 length of segment : 76 time for calcul the mask position with numpy : 0.0002105236053466797 nb_pixel_total : 4040 time to create 1 rle with old method : 0.004889249801635742 length of segment : 193 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 865 time to create 1 rle with old method : 0.0011963844299316406 length of segment : 46 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 487 time to create 1 rle with old method : 0.0006678104400634766 length of segment : 61 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.0004353523254394531 length of segment : 30 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 618 time to create 1 rle with old method : 0.0007998943328857422 length of segment : 47 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 558 time to create 1 rle with old method : 0.0007076263427734375 length of segment : 60 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 292 time to create 1 rle with old method : 0.0003886222839355469 length of segment : 30 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 682 time to create 1 rle with old method : 0.0008940696716308594 length of segment : 42 Processing 1 images image shape: (280, 400, 3) min: 13.00000 max: 187.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 71.87344 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009834766387939453 nb_pixel_total : 102990 time to create 1 rle with old method : 0.11284756660461426 length of segment : 279 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 7.2479248046875e-05 nb_pixel_total : 3011 time to create 1 rle with old method : 0.0037827491760253906 length of segment : 44 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 1625 time to create 1 rle with old method : 0.002094268798828125 length of segment : 40 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 663 time to create 1 rle with old method : 0.0008780956268310547 length of segment : 33 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 195 time to create 1 rle with old method : 0.0003218650817871094 length of segment : 16 time for calcul the mask position with numpy : 8.0108642578125e-05 nb_pixel_total : 627 time to create 1 rle with old method : 0.0008380413055419922 length of segment : 133 time for calcul the mask position with numpy : 0.000148773193359375 nb_pixel_total : 7714 time to create 1 rle with old method : 0.009404182434082031 length of segment : 93 time for calcul the mask position with numpy : 9.226799011230469e-05 nb_pixel_total : 3090 time to create 1 rle with old method : 0.003892183303833008 length of segment : 100 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 142 time to create 1 rle with old method : 0.0002205371856689453 length of segment : 53 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 40 time to create 1 rle with old method : 8.344650268554688e-05 length of segment : 8 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.00037479400634765625 length of segment : 38 time for calcul the mask position with numpy : 0.00010466575622558594 nb_pixel_total : 3519 time to create 1 rle with old method : 0.004128932952880859 length of segment : 87 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.80703 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 292 time to create 1 rle with old method : 0.0004153251647949219 length of segment : 22 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.00025653839111328125 length of segment : 16 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 267 time to create 1 rle with old method : 0.0004057884216308594 length of segment : 16 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 557 time to create 1 rle with old method : 0.0007274150848388672 length of segment : 35 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 299 time to create 1 rle with old method : 0.0004315376281738281 length of segment : 19 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 267 time to create 1 rle with old method : 0.0004582405090332031 length of segment : 22 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 623 time to create 1 rle with old method : 0.0007982254028320312 length of segment : 45 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 58 time to create 1 rle with old method : 0.00012040138244628906 length of segment : 6 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 268 time to create 1 rle with old method : 0.0003826618194580078 length of segment : 22 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 282 time to create 1 rle with old method : 0.000385284423828125 length of segment : 22 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.02187 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 179 time to create 1 rle with old method : 0.00033593177795410156 length of segment : 20 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 232 time to create 1 rle with old method : 0.0004062652587890625 length of segment : 25 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 483 time to create 1 rle with old method : 0.0007021427154541016 length of segment : 24 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.47500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.0005290508270263672 nb_pixel_total : 37971 time to create 1 rle with old method : 0.0430905818939209 length of segment : 226 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 16 time to create 1 rle with old method : 5.435943603515625e-05 length of segment : 4 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 65 time to create 1 rle with old method : 0.00011610984802246094 length of segment : 20 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.68438 max: 150.16250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 827 time to create 1 rle with old method : 0.0011043548583984375 length of segment : 55 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 1134 time to create 1 rle with old method : 0.0015208721160888672 length of segment : 32 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 790 time to create 1 rle with old method : 0.0010750293731689453 length of segment : 56 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 480 time to create 1 rle with old method : 0.0006237030029296875 length of segment : 26 time for calcul the mask position with numpy : 0.0001227855682373047 nb_pixel_total : 1902 time to create 1 rle with old method : 0.0025806427001953125 length of segment : 111 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 369 time to create 1 rle with old method : 0.0004863739013671875 length of segment : 29 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 566 time to create 1 rle with old method : 0.0008339881896972656 length of segment : 54 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 1270 time to create 1 rle with old method : 0.0016832351684570312 length of segment : 29 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.66094 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 2501 time to create 1 rle with old method : 0.0030794143676757812 length of segment : 49 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 242 time to create 1 rle with old method : 0.00031876564025878906 length of segment : 36 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 454 time to create 1 rle with old method : 0.0005829334259033203 length of segment : 31 time for calcul the mask position with numpy : 2.7894973754882812e-05 nb_pixel_total : 46 time to create 1 rle with old method : 0.0001277923583984375 length of segment : 10 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -108.14141 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 453 time to create 1 rle with old method : 0.00066375732421875 length of segment : 14 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 454 time to create 1 rle with old method : 0.0007188320159912109 length of segment : 14 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.16094 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 555 time to create 1 rle with old method : 0.0007009506225585938 length of segment : 54 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 267 time to create 1 rle with old method : 0.0003654956817626953 length of segment : 23 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 229.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 112.85000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 535 time to create 1 rle with old method : 0.0007688999176025391 length of segment : 18 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 536 time to create 1 rle with old method : 0.0006673336029052734 length of segment : 52 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 83 time to create 1 rle with old method : 0.00016021728515625 length of segment : 12 time for calcul the mask position with numpy : 0.0007348060607910156 nb_pixel_total : 67759 time to create 1 rle with old method : 0.07640528678894043 length of segment : 291 Processing 1 images image shape: (400, 400, 3) min: 25.00000 max: 199.00000 molded_images shape: (1, 640, 640, 3) min: -93.73906 max: 75.82266 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.90313 max: 150.24062 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 7.2479248046875e-05 nb_pixel_total : 2367 time to create 1 rle with old method : 0.0028836727142333984 length of segment : 51 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 515 time to create 1 rle with old method : 0.0006923675537109375 length of segment : 26 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 119 time to create 1 rle with old method : 0.00026679039001464844 length of segment : 17 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 1321 time to create 1 rle with old method : 0.0020847320556640625 length of segment : 51 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 354 time to create 1 rle with old method : 0.0005152225494384766 length of segment : 16 Processing 1 images image shape: (400, 400, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.79766 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 1095 time to create 1 rle with old method : 0.0012798309326171875 length of segment : 58 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 206 time to create 1 rle with old method : 0.00027060508728027344 length of segment : 18 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 596 time to create 1 rle with old method : 0.0008366107940673828 length of segment : 22 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 710 time to create 1 rle with old method : 0.0008251667022705078 length of segment : 29 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.0002560615539550781 length of segment : 12 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 262 time to create 1 rle with old method : 0.00038552284240722656 length of segment : 13 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 325 time to create 1 rle with old method : 0.00046944618225097656 length of segment : 14 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.01250 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 2625 time to create 1 rle with old method : 0.003064393997192383 length of segment : 60 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 808 time to create 1 rle with old method : 0.001028299331665039 length of segment : 36 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 1318 time to create 1 rle with old method : 0.001508951187133789 length of segment : 41 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 1549 time to create 1 rle with old method : 0.001901388168334961 length of segment : 114 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 1360 time to create 1 rle with old method : 0.0016186237335205078 length of segment : 40 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.99844 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 1359 time to create 1 rle with old method : 0.0018315315246582031 length of segment : 74 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 629 time to create 1 rle with old method : 0.0008385181427001953 length of segment : 73 time for calcul the mask position with numpy : 7.414817810058594e-05 nb_pixel_total : 2172 time to create 1 rle with old method : 0.0026285648345947266 length of segment : 149 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 222 time to create 1 rle with old method : 0.00031185150146484375 length of segment : 31 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 744 time to create 1 rle with old method : 0.0009317398071289062 length of segment : 33 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 262 time to create 1 rle with old method : 0.0003554821014404297 length of segment : 28 time for calcul the mask position with numpy : 0.00014925003051757812 nb_pixel_total : 4108 time to create 1 rle with old method : 0.004851341247558594 length of segment : 191 time for calcul the mask position with numpy : 0.00017118453979492188 nb_pixel_total : 4612 time to create 1 rle with old method : 0.0052089691162109375 length of segment : 229 Processing 1 images image shape: (280, 400, 3) min: 14.00000 max: 188.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 74.40859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 2846 time to create 1 rle with old method : 0.0034847259521484375 length of segment : 44 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 176 time to create 1 rle with old method : 0.0002281665802001953 length of segment : 29 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 199 time to create 1 rle with old method : 0.00027751922607421875 length of segment : 16 time for calcul the mask position with numpy : 0.00013184547424316406 nb_pixel_total : 7423 time to create 1 rle with old method : 0.008761882781982422 length of segment : 104 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.00026988983154296875 length of segment : 56 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 1159 time to create 1 rle with old method : 0.0015249252319335938 length of segment : 33 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 647 time to create 1 rle with old method : 0.0008361339569091797 length of segment : 34 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 1591 time to create 1 rle with old method : 0.002038240432739258 length of segment : 41 time for calcul the mask position with numpy : 8.392333984375e-05 nb_pixel_total : 2714 time to create 1 rle with old method : 0.0033185482025146484 length of segment : 92 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 460 time to create 1 rle with old method : 0.0006532669067382812 length of segment : 30 time for calcul the mask position with numpy : 8.96453857421875e-05 nb_pixel_total : 662 time to create 1 rle with old method : 0.0009033679962158203 length of segment : 145 time for calcul the mask position with numpy : 9.465217590332031e-05 nb_pixel_total : 3183 time to create 1 rle with old method : 0.0038645267486572266 length of segment : 97 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 140.02187 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.0003674030303955078 length of segment : 20 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 169 time to create 1 rle with old method : 0.0002925395965576172 length of segment : 16 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 359 time to create 1 rle with old method : 0.0005128383636474609 length of segment : 30 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 550 time to create 1 rle with old method : 0.0007276535034179688 length of segment : 34 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 301 time to create 1 rle with old method : 0.0006418228149414062 length of segment : 17 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 287 time to create 1 rle with old method : 0.0006113052368164062 length of segment : 16 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 593 time to create 1 rle with old method : 0.0007576942443847656 length of segment : 47 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 298 time to create 1 rle with old method : 0.00043845176696777344 length of segment : 17 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 279 time to create 1 rle with old method : 0.00038433074951171875 length of segment : 23 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 636 time to create 1 rle with old method : 0.0007874965667724609 length of segment : 51 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 263 time to create 1 rle with old method : 0.00035881996154785156 length of segment : 21 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.10391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 64 time to create 1 rle with old method : 0.00014162063598632812 length of segment : 22 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 274 time to create 1 rle with old method : 0.0004699230194091797 length of segment : 27 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.00028395652770996094 length of segment : 22 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 424 time to create 1 rle with old method : 0.0006093978881835938 length of segment : 22 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.22500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 504 time to create 1 rle with old method : 0.0006883144378662109 length of segment : 31 time for calcul the mask position with numpy : 0.0004220008850097656 nb_pixel_total : 38188 time to create 1 rle with old method : 0.04299640655517578 length of segment : 264 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 62 time to create 1 rle with old method : 0.00021338462829589844 length of segment : 30 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 20 time to create 1 rle with old method : 5.221366882324219e-05 length of segment : 4 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.04766 max: 149.20937 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 721 time to create 1 rle with old method : 0.0009915828704833984 length of segment : 58 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 919 time to create 1 rle with old method : 0.0012297630310058594 length of segment : 38 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 472 time to create 1 rle with old method : 0.0006458759307861328 length of segment : 27 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 1991 time to create 1 rle with old method : 0.002593517303466797 length of segment : 35 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 1217 time to create 1 rle with old method : 0.0015838146209716797 length of segment : 29 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 815 time to create 1 rle with old method : 0.0011420249938964844 length of segment : 49 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.96953 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 2766 time to create 1 rle with old method : 0.0034024715423583984 length of segment : 52 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 516 time to create 1 rle with old method : 0.0008337497711181641 length of segment : 29 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.00031375885009765625 length of segment : 32 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 47 time to create 1 rle with old method : 8.535385131835938e-05 length of segment : 8 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 2210 time to create 1 rle with old method : 0.0026810169219970703 length of segment : 91 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 508 time to create 1 rle with old method : 0.0006570816040039062 length of segment : 29 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.20781 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 1317 time to create 1 rle with old method : 0.0015933513641357422 length of segment : 49 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 1433 time to create 1 rle with old method : 0.0016665458679199219 length of segment : 32 time for calcul the mask position with numpy : 7.796287536621094e-05 nb_pixel_total : 4645 time to create 1 rle with old method : 0.005780935287475586 length of segment : 55 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 446 time to create 1 rle with old method : 0.0006728172302246094 length of segment : 13 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 56 time to create 1 rle with old method : 0.00011491775512695312 length of segment : 5 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 452 time to create 1 rle with old method : 0.0007193088531494141 length of segment : 12 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.89141 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 256 time to create 1 rle with old method : 0.00035762786865234375 length of segment : 23 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 509 time to create 1 rle with old method : 0.000637054443359375 length of segment : 57 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 234.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 112.35781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 538 time to create 1 rle with old method : 0.0007660388946533203 length of segment : 18 time for calcul the mask position with numpy : 0.0005106925964355469 nb_pixel_total : 51314 time to create 1 rle with old method : 0.05769491195678711 length of segment : 256 time for calcul the mask position with numpy : 0.0007097721099853516 nb_pixel_total : 64452 time to create 1 rle with old method : 0.07088828086853027 length of segment : 334 Processing 1 images image shape: (400, 400, 3) min: 22.00000 max: 198.00000 molded_images shape: (1, 640, 640, 3) min: -92.59063 max: 76.96328 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.87188 max: 151.02187 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 2316 time to create 1 rle with old method : 0.0029315948486328125 length of segment : 50 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 1271 time to create 1 rle with old method : 0.0014121532440185547 length of segment : 52 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 1087 time to create 1 rle with old method : 0.0012249946594238281 length of segment : 47 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 355 time to create 1 rle with old method : 0.0004878044128417969 length of segment : 16 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.59063 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 707 time to create 1 rle with old method : 0.0010876655578613281 length of segment : 32 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 490 time to create 1 rle with old method : 0.0005643367767333984 length of segment : 48 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 509 time to create 1 rle with old method : 0.0007441043853759766 length of segment : 19 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 188 time to create 1 rle with old method : 0.0002543926239013672 length of segment : 18 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 156 time to create 1 rle with old method : 0.0002522468566894531 length of segment : 13 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.05156 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 7.319450378417969e-05 nb_pixel_total : 1872 time to create 1 rle with old method : 0.002659320831298828 length of segment : 46 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 1297 time to create 1 rle with old method : 0.0014841556549072266 length of segment : 40 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 1330 time to create 1 rle with old method : 0.001508474349975586 length of segment : 40 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 802 time to create 1 rle with old method : 0.0009329319000244141 length of segment : 38 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.15078 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 1941 time to create 1 rle with old method : 0.0023565292358398438 length of segment : 154 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 1457 time to create 1 rle with old method : 0.0019309520721435547 length of segment : 77 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 484 time to create 1 rle with old method : 0.0008554458618164062 length of segment : 56 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.00058746337890625 length of segment : 29 time for calcul the mask position with numpy : 0.0001838207244873047 nb_pixel_total : 3749 time to create 1 rle with old method : 0.0055925846099853516 length of segment : 187 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 216 time to create 1 rle with old method : 0.0002815723419189453 length of segment : 29 Processing 1 images image shape: (280, 400, 3) min: 20.00000 max: 193.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 75.83437 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0008959770202636719 nb_pixel_total : 105260 time to create 1 rle with old method : 0.11514496803283691 length of segment : 285 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 2935 time to create 1 rle with old method : 0.0034410953521728516 length of segment : 47 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 1645 time to create 1 rle with old method : 0.0019669532775878906 length of segment : 40 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 2922 time to create 1 rle with old method : 0.003548860549926758 length of segment : 103 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 613 time to create 1 rle with old method : 0.0008115768432617188 length of segment : 32 time for calcul the mask position with numpy : 9.179115295410156e-05 nb_pixel_total : 4473 time to create 1 rle with old method : 0.0052297115325927734 length of segment : 74 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 179 time to create 1 rle with old method : 0.00024580955505371094 length of segment : 56 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.000324249267578125 length of segment : 18 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.0001857280731201172 length of segment : 26 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 1104 time to create 1 rle with old method : 0.0013952255249023438 length of segment : 29 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 137.67422 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 177 time to create 1 rle with old method : 0.0003814697265625 length of segment : 17 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 293 time to create 1 rle with old method : 0.0006074905395507812 length of segment : 25 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 725 time to create 1 rle with old method : 0.0013928413391113281 length of segment : 56 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 256 time to create 1 rle with old method : 0.0006880760192871094 length of segment : 19 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 262 time to create 1 rle with old method : 0.0005507469177246094 length of segment : 15 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 242 time to create 1 rle with old method : 0.0004639625549316406 length of segment : 21 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.46719 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 475 time to create 1 rle with old method : 0.0006806850433349609 length of segment : 24 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 194 time to create 1 rle with old method : 0.0002887248992919922 length of segment : 21 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 304 time to create 1 rle with old method : 0.0007424354553222656 length of segment : 27 length of segment : 0 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.47500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.0007429122924804688 nb_pixel_total : 38260 time to create 1 rle with old method : 0.04689979553222656 length of segment : 251 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 18 time to create 1 rle with old method : 6.0558319091796875e-05 length of segment : 5 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.35234 max: 150.13125 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 696 time to create 1 rle with old method : 0.001001119613647461 length of segment : 58 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 342 time to create 1 rle with old method : 0.00042510032653808594 length of segment : 25 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 770 time to create 1 rle with old method : 0.0010178089141845703 length of segment : 66 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 641 time to create 1 rle with old method : 0.0008718967437744141 length of segment : 37 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 288 time to create 1 rle with old method : 0.00057220458984375 length of segment : 21 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 550 time to create 1 rle with old method : 0.0010671615600585938 length of segment : 39 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 818 time to create 1 rle with old method : 0.0015270709991455078 length of segment : 39 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.62578 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 2238 time to create 1 rle with old method : 0.002634763717651367 length of segment : 42 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 497 time to create 1 rle with old method : 0.0006384849548339844 length of segment : 32 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 242 time to create 1 rle with old method : 0.00033283233642578125 length of segment : 33 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 155 time to create 1 rle with old method : 0.00023651123046875 length of segment : 16 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 50 time to create 1 rle with old method : 8.511543273925781e-05 length of segment : 8 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 2238 time to create 1 rle with old method : 0.002660512924194336 length of segment : 108 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 157 time to create 1 rle with old method : 0.0002453327178955078 length of segment : 31 time for calcul the mask position with numpy : 0.00020813941955566406 nb_pixel_total : 7 time to create 1 rle with old method : 3.457069396972656e-05 length of segment : 4 Processing 1 images image shape: (400, 400, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -101.85234 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 460 time to create 1 rle with old method : 0.0009477138519287109 length of segment : 26 time for calcul the mask position with numpy : 8.177757263183594e-05 nb_pixel_total : 4296 time to create 1 rle with old method : 0.005156040191650391 length of segment : 53 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 409 time to create 1 rle with old method : 0.0006308555603027344 length of segment : 13 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 1693 time to create 1 rle with old method : 0.0022389888763427734 length of segment : 37 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0006184577941894531 length of segment : 13 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.39922 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 474 time to create 1 rle with old method : 0.0007603168487548828 length of segment : 51 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 252 time to create 1 rle with old method : 0.00034618377685546875 length of segment : 23 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 231.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 114.55312 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 537 time to create 1 rle with old method : 0.0007500648498535156 length of segment : 19 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 631 time to create 1 rle with old method : 0.0007038116455078125 length of segment : 61 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 374 time to create 1 rle with old method : 0.0005860328674316406 length of segment : 69 Processing 1 images image shape: (400, 400, 3) min: 25.00000 max: 201.00000 molded_images shape: (1, 640, 640, 3) min: -92.67266 max: 79.08828 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.12578 max: 151.00234 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 8.797645568847656e-05 nb_pixel_total : 2269 time to create 1 rle with old method : 0.003339529037475586 length of segment : 51 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 527 time to create 1 rle with old method : 0.0006873607635498047 length of segment : 29 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 320 time to create 1 rle with old method : 0.0007519721984863281 length of segment : 16 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 564 time to create 1 rle with old method : 0.00077056884765625 length of segment : 25 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 1049 time to create 1 rle with old method : 0.001283884048461914 length of segment : 48 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 1243 time to create 1 rle with old method : 0.0013606548309326172 length of segment : 53 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.65313 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 694 time to create 1 rle with old method : 0.0009975433349609375 length of segment : 29 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 615 time to create 1 rle with old method : 0.0008175373077392578 length of segment : 59 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 545 time to create 1 rle with old method : 0.0007343292236328125 length of segment : 23 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 107 time to create 1 rle with old method : 0.00018930435180664062 length of segment : 13 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.00028061866760253906 length of segment : 13 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.94609 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 1802 time to create 1 rle with old method : 0.002778768539428711 length of segment : 41 time for calcul the mask position with numpy : 0.0001709461212158203 nb_pixel_total : 5500 time to create 1 rle with old method : 0.0064885616302490234 length of segment : 185 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 861 time to create 1 rle with old method : 0.0010788440704345703 length of segment : 38 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.10391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 1456 time to create 1 rle with old method : 0.0018849372863769531 length of segment : 73 time for calcul the mask position with numpy : 7.534027099609375e-05 nb_pixel_total : 1785 time to create 1 rle with old method : 0.0022935867309570312 length of segment : 109 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 216 time to create 1 rle with old method : 0.0003039836883544922 length of segment : 29 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 756 time to create 1 rle with old method : 0.00102996826171875 length of segment : 34 time for calcul the mask position with numpy : 0.00018978118896484375 nb_pixel_total : 3937 time to create 1 rle with old method : 0.004677295684814453 length of segment : 194 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 312 time to create 1 rle with old method : 0.00040984153747558594 length of segment : 30 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 577 time to create 1 rle with old method : 0.0007407665252685547 length of segment : 48 Processing 1 images image shape: (280, 400, 3) min: 12.00000 max: 188.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 73.80703 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0011446475982666016 nb_pixel_total : 103757 time to create 1 rle with old method : 0.11717748641967773 length of segment : 281 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 2888 time to create 1 rle with old method : 0.003615140914916992 length of segment : 45 time for calcul the mask position with numpy : 0.00010657310485839844 nb_pixel_total : 3909 time to create 1 rle with old method : 0.0053670406341552734 length of segment : 81 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 654 time to create 1 rle with old method : 0.0008420944213867188 length of segment : 31 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 209 time to create 1 rle with old method : 0.00028896331787109375 length of segment : 18 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 1599 time to create 1 rle with old method : 0.0020203590393066406 length of segment : 39 time for calcul the mask position with numpy : 7.748603820800781e-05 nb_pixel_total : 3590 time to create 1 rle with old method : 0.004310131072998047 length of segment : 62 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 127 time to create 1 rle with old method : 0.000179290771484375 length of segment : 36 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 145 time to create 1 rle with old method : 0.0001850128173828125 length of segment : 26 time for calcul the mask position with numpy : 0.00014638900756835938 nb_pixel_total : 7492 time to create 1 rle with old method : 0.008537054061889648 length of segment : 103 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 138.01797 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 290 time to create 1 rle with old method : 0.0004076957702636719 length of segment : 21 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 174 time to create 1 rle with old method : 0.00026297569274902344 length of segment : 16 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 276 time to create 1 rle with old method : 0.0003864765167236328 length of segment : 17 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.00043463706970214844 length of segment : 17 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 65 time to create 1 rle with old method : 0.00016379356384277344 length of segment : 7 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 497 time to create 1 rle with old method : 0.0006570816040039062 length of segment : 37 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 575 time to create 1 rle with old method : 0.000743865966796875 length of segment : 47 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 578 time to create 1 rle with old method : 0.0007090568542480469 length of segment : 46 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 1057 time to create 1 rle with old method : 0.0013785362243652344 length of segment : 42 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 228 time to create 1 rle with old method : 0.00031828880310058594 length of segment : 21 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 285 time to create 1 rle with old method : 0.0003867149353027344 length of segment : 23 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 277 time to create 1 rle with old method : 0.0003871917724609375 length of segment : 23 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.01016 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 64 time to create 1 rle with old method : 0.00011205673217773438 length of segment : 21 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 205 time to create 1 rle with old method : 0.0002925395965576172 length of segment : 24 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 266 time to create 1 rle with old method : 0.0003619194030761719 length of segment : 29 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 455 time to create 1 rle with old method : 0.0006501674652099609 length of segment : 23 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.72500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.000392913818359375 nb_pixel_total : 38132 time to create 1 rle with old method : 0.042942047119140625 length of segment : 225 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.35234 max: 150.62344 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 622 time to create 1 rle with old method : 0.0008816719055175781 length of segment : 42 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 451 time to create 1 rle with old method : 0.0010111331939697266 length of segment : 28 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 1205 time to create 1 rle with old method : 0.0015931129455566406 length of segment : 26 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 1134 time to create 1 rle with old method : 0.0015268325805664062 length of segment : 25 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 598 time to create 1 rle with old method : 0.0008652210235595703 length of segment : 48 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.82891 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 2575 time to create 1 rle with old method : 0.003186941146850586 length of segment : 50 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.0002448558807373047 length of segment : 17 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 2271 time to create 1 rle with old method : 0.002720355987548828 length of segment : 98 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 232 time to create 1 rle with old method : 0.000316619873046875 length of segment : 37 time for calcul the mask position with numpy : 0.00024008750915527344 nb_pixel_total : 4285 time to create 1 rle with old method : 0.00528264045715332 length of segment : 359 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 515 time to create 1 rle with old method : 0.0006411075592041016 length of segment : 29 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 540 time to create 1 rle with old method : 0.0006422996520996094 length of segment : 30 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.43438 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 1321 time to create 1 rle with old method : 0.001585245132446289 length of segment : 53 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 3258 time to create 1 rle with old method : 0.003823518753051758 length of segment : 49 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 483 time to create 1 rle with old method : 0.0007083415985107422 length of segment : 13 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 477 time to create 1 rle with old method : 0.00064849853515625 length of segment : 14 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.39922 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.0003185272216796875 length of segment : 24 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 531 time to create 1 rle with old method : 0.0006611347198486328 length of segment : 55 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 188 time to create 1 rle with old method : 0.0002880096435546875 length of segment : 16 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 240.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 121.22891 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 541 time to create 1 rle with old method : 0.0008695125579833984 length of segment : 18 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 122 time to create 1 rle with old method : 0.000202178955078125 length of segment : 12 Processing 1 images image shape: (400, 400, 3) min: 27.00000 max: 200.00000 molded_images shape: (1, 640, 640, 3) min: -91.70781 max: 76.96328 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.06719 max: 150.98281 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 2381 time to create 1 rle with old method : 0.003020763397216797 length of segment : 52 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 755 time to create 1 rle with old method : 0.0009946823120117188 length of segment : 27 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 1086 time to create 1 rle with old method : 0.0013108253479003906 length of segment : 45 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 126 time to create 1 rle with old method : 0.0002009868621826172 length of segment : 16 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 321 time to create 1 rle with old method : 0.00046944618225097656 length of segment : 18 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.15313 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 724 time to create 1 rle with old method : 0.0009129047393798828 length of segment : 47 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 714 time to create 1 rle with old method : 0.0008876323699951172 length of segment : 30 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 157 time to create 1 rle with old method : 0.0002694129943847656 length of segment : 13 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 553 time to create 1 rle with old method : 0.0008196830749511719 length of segment : 20 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 156 time to create 1 rle with old method : 0.00023984909057617188 length of segment : 17 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 778 time to create 1 rle with old method : 0.0010144710540771484 length of segment : 24 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.0003898143768310547 length of segment : 12 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.26250 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 9.870529174804688e-05 nb_pixel_total : 1870 time to create 1 rle with old method : 0.0033724308013916016 length of segment : 45 time for calcul the mask position with numpy : 0.00011968612670898438 nb_pixel_total : 1482 time to create 1 rle with old method : 0.002789735794067383 length of segment : 115 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 1358 time to create 1 rle with old method : 0.0016868114471435547 length of segment : 43 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 744 time to create 1 rle with old method : 0.0009005069732666016 length of segment : 36 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 797 time to create 1 rle with old method : 0.0009968280792236328 length of segment : 37 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.79141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 8.320808410644531e-05 nb_pixel_total : 2035 time to create 1 rle with old method : 0.0025663375854492188 length of segment : 152 time for calcul the mask position with numpy : 7.62939453125e-05 nb_pixel_total : 1352 time to create 1 rle with old method : 0.001764059066772461 length of segment : 85 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 193 time to create 1 rle with old method : 0.0002834796905517578 length of segment : 30 time for calcul the mask position with numpy : 0.00020194053649902344 nb_pixel_total : 3832 time to create 1 rle with old method : 0.004599571228027344 length of segment : 193 time for calcul the mask position with numpy : 8.296966552734375e-05 nb_pixel_total : 362 time to create 1 rle with old method : 0.00064849853515625 length of segment : 59 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 815 time to create 1 rle with old method : 0.0011150836944580078 length of segment : 35 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 739 time to create 1 rle with old method : 0.0009322166442871094 length of segment : 47 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 743 time to create 1 rle with old method : 0.0009458065032958984 length of segment : 45 Processing 1 images image shape: (280, 400, 3) min: 14.00000 max: 188.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 73.91250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009326934814453125 nb_pixel_total : 103361 time to create 1 rle with old method : 0.11695718765258789 length of segment : 286 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 1474 time to create 1 rle with old method : 0.002281665802001953 length of segment : 46 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 3060 time to create 1 rle with old method : 0.004143238067626953 length of segment : 45 time for calcul the mask position with numpy : 0.00010013580322265625 nb_pixel_total : 3882 time to create 1 rle with old method : 0.0047206878662109375 length of segment : 91 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 514 time to create 1 rle with old method : 0.0006818771362304688 length of segment : 31 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 218 time to create 1 rle with old method : 0.00033283233642578125 length of segment : 19 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 129 time to create 1 rle with old method : 0.00018835067749023438 length of segment : 18 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 887 time to create 1 rle with old method : 0.0011637210845947266 length of segment : 43 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 137.63516 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 279 time to create 1 rle with old method : 0.0003895759582519531 length of segment : 20 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 177 time to create 1 rle with old method : 0.000293731689453125 length of segment : 17 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 692 time to create 1 rle with old method : 0.0010256767272949219 length of segment : 53 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 277 time to create 1 rle with old method : 0.00040721893310546875 length of segment : 17 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.000461578369140625 length of segment : 19 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 285 time to create 1 rle with old method : 0.0004260540008544922 length of segment : 17 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.0003998279571533203 length of segment : 23 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 1653 time to create 1 rle with old method : 0.0020818710327148438 length of segment : 39 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 495 time to create 1 rle with old method : 0.0006632804870605469 length of segment : 36 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.24062 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.00029277801513671875 length of segment : 22 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 208 time to create 1 rle with old method : 0.00029969215393066406 length of segment : 24 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 448 time to create 1 rle with old method : 0.0005984306335449219 length of segment : 23 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 17 time to create 1 rle with old method : 4.887580871582031e-05 length of segment : 9 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 330 time to create 1 rle with old method : 0.00045561790466308594 length of segment : 23 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 318 time to create 1 rle with old method : 0.0004253387451171875 length of segment : 21 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.97500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 10 time to create 1 rle with old method : 7.724761962890625e-05 length of segment : 9 time for calcul the mask position with numpy : 0.00043845176696777344 nb_pixel_total : 38091 time to create 1 rle with old method : 0.04463458061218262 length of segment : 237 Detection mask done ! Trying to reset tf kernel 3990998 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5525 tf kernel not reseted sub process len(results) : 363 len(list_Values) 363 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 363 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 10814 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 363 chid ids of type : 4228 Number RLEs to save : 18035 save missing photos in datou_result : time spend for datou_step_exec : 28.656136989593506 time spend to save output : 2.304330348968506 total time spend for step 1 : 30.96046733856201 step2:brightness Mon Mar 3 02:21:01 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1740964829_3990467_1340529450_1c48aed64644c77c2489d9f16b24b80d.jpg treat image : temp/1740964829_3990467_1340529435_5dd1b5624c40bddc5b1f2f1f76f1c80f.jpg treat image : temp/1740964829_3990467_1340529433_77eed2885ce03542094b345c4fc5cc73.jpg treat image : temp/1740964829_3990467_1340529430_e2d76a793bc825b34b350b54ce11352f.jpg treat image : temp/1740964829_3990467_1340529427_5e777680f1485e5d41b51bf9636f91e0.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.01391911506652832 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.012631416320800781 save missing photos in datou_result : time spend for datou_step_exec : 1.321213722229004 time spend to save output : 0.031857967376708984 total time spend for step 2 : 1.353071689605713 step3:blur_detection Mon Mar 3 02:21:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1740964829_3990467_1340529450_1c48aed64644c77c2489d9f16b24b80d.jpg resize: (1080, 1920) 1340529450 -7.518526137338691 treat image : temp/1740964829_3990467_1340529435_5dd1b5624c40bddc5b1f2f1f76f1c80f.jpg resize: (1080, 1920) 1340529435 -7.513963407904754 treat image : temp/1740964829_3990467_1340529433_77eed2885ce03542094b345c4fc5cc73.jpg resize: (1080, 1920) 1340529433 -7.508022309889931 treat image : temp/1740964829_3990467_1340529430_e2d76a793bc825b34b350b54ce11352f.jpg resize: (1080, 1920) 1340529430 -7.5141342490402065 treat image : temp/1740964829_3990467_1340529427_5e777680f1485e5d41b51bf9636f91e0.jpg resize: (1080, 1920) 1340529427 -7.511953827761876 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 5 time used for this insertion : 0.01068425178527832 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 5 time used for this insertion : 0.19946074485778809 save missing photos in datou_result : time spend for datou_step_exec : 4.655715227127075 time spend to save output : 0.21466493606567383 total time spend for step 3 : 4.870380163192749 step4:rle_unique_nms_with_priority Mon Mar 3 02:21:07 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 363 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 78 nb_hashtags : 6 time to prepare the origin masks : 1.028651237487793 time for calcul the mask position with numpy : 0.1179800033569336 nb_pixel_total : 1870420 time to create 1 rle with new method : 0.11111569404602051 time for calcul the mask position with numpy : 0.013066768646240234 nb_pixel_total : 279 time to create 1 rle with old method : 0.0004551410675048828 time for calcul the mask position with numpy : 0.011284589767456055 nb_pixel_total : 484 time to create 1 rle with old method : 0.0006167888641357422 time for calcul the mask position with numpy : 0.009390115737915039 nb_pixel_total : 278 time to create 1 rle with old method : 0.0004017353057861328 time for calcul the mask position with numpy : 0.009692192077636719 nb_pixel_total : 399 time to create 1 rle with old method : 0.0005307197570800781 time for calcul the mask position with numpy : 0.009105205535888672 nb_pixel_total : 12 time to create 1 rle with old method : 3.337860107421875e-05 time for calcul the mask position with numpy : 0.008260965347290039 nb_pixel_total : 466 time to create 1 rle with old method : 0.0005745887756347656 time for calcul the mask position with numpy : 0.00832986831665039 nb_pixel_total : 418 time to create 1 rle with old method : 0.000499725341796875 time for calcul the mask position with numpy : 0.008316993713378906 nb_pixel_total : 936 time to create 1 rle with old method : 0.001104116439819336 time for calcul the mask position with numpy : 0.008356571197509766 nb_pixel_total : 2576 time to create 1 rle with old method : 0.002955198287963867 time for calcul the mask position with numpy : 0.00832986831665039 nb_pixel_total : 53 time to create 1 rle with old method : 6.246566772460938e-05 time for calcul the mask position with numpy : 0.007964134216308594 nb_pixel_total : 34 time to create 1 rle with old method : 5.364418029785156e-05 time for calcul the mask position with numpy : 0.008014202117919922 nb_pixel_total : 232 time to create 1 rle with old method : 0.0002434253692626953 time for calcul the mask position with numpy : 0.007906198501586914 nb_pixel_total : 561 time to create 1 rle with old method : 0.0005819797515869141 time for calcul the mask position with numpy : 0.008199214935302734 nb_pixel_total : 2478 time to create 1 rle with old method : 0.0026891231536865234 time for calcul the mask position with numpy : 0.008276700973510742 nb_pixel_total : 178 time to create 1 rle with old method : 0.0001881122589111328 time for calcul the mask position with numpy : 0.00801992416381836 nb_pixel_total : 460 time to create 1 rle with old method : 0.0005002021789550781 time for calcul the mask position with numpy : 0.008013486862182617 nb_pixel_total : 570 time to create 1 rle with old method : 0.0005831718444824219 time for calcul the mask position with numpy : 0.008052587509155273 nb_pixel_total : 25 time to create 1 rle with old method : 7.605552673339844e-05 time for calcul the mask position with numpy : 0.00960087776184082 nb_pixel_total : 460 time to create 1 rle with old method : 0.0007741451263427734 time for calcul the mask position with numpy : 0.009570837020874023 nb_pixel_total : 1488 time to create 1 rle with old method : 0.002439260482788086 time for calcul the mask position with numpy : 0.009632587432861328 nb_pixel_total : 547 time to create 1 rle with old method : 0.0009448528289794922 time for calcul the mask position with numpy : 0.009578227996826172 nb_pixel_total : 5848 time to create 1 rle with old method : 0.009614229202270508 time for calcul the mask position with numpy : 0.009601593017578125 nb_pixel_total : 712 time to create 1 rle with old method : 0.0011856555938720703 time for calcul the mask position with numpy : 0.009594917297363281 nb_pixel_total : 558 time to create 1 rle with old method : 0.00091552734375 time for calcul the mask position with numpy : 0.008986473083496094 nb_pixel_total : 819 time to create 1 rle with old method : 0.0009388923645019531 time for calcul the mask position with numpy : 0.008344173431396484 nb_pixel_total : 18 time to create 1 rle with old method : 4.506111145019531e-05 time for calcul the mask position with numpy : 0.008095264434814453 nb_pixel_total : 140 time to create 1 rle with old method : 0.0001761913299560547 time for calcul the mask position with numpy : 0.007900476455688477 nb_pixel_total : 212 time to create 1 rle with old method : 0.0002551078796386719 time for calcul the mask position with numpy : 0.00805211067199707 nb_pixel_total : 213 time to create 1 rle with old method : 0.0002713203430175781 time for calcul the mask position with numpy : 0.007984638214111328 nb_pixel_total : 618 time to create 1 rle with old method : 0.0006566047668457031 time for calcul the mask position with numpy : 0.007756710052490234 nb_pixel_total : 73 time to create 1 rle with old method : 0.00015163421630859375 time for calcul the mask position with numpy : 0.008035421371459961 nb_pixel_total : 1174 time to create 1 rle with old method : 0.0012273788452148438 time for calcul the mask position with numpy : 0.008084297180175781 nb_pixel_total : 314 time to create 1 rle with old method : 0.00032639503479003906 time for calcul the mask position with numpy : 0.007915019989013672 nb_pixel_total : 3 time to create 1 rle with old method : 9.298324584960938e-06 time for calcul the mask position with numpy : 0.008027791976928711 nb_pixel_total : 865 time to create 1 rle with old method : 0.0009243488311767578 time for calcul the mask position with numpy : 0.007835865020751953 nb_pixel_total : 377 time to create 1 rle with old method : 0.0004932880401611328 time for calcul the mask position with numpy : 0.008115530014038086 nb_pixel_total : 4040 time to create 1 rle with old method : 0.004343986511230469 time for calcul the mask position with numpy : 0.007938861846923828 nb_pixel_total : 487 time to create 1 rle with old method : 0.0005621910095214844 time for calcul the mask position with numpy : 0.007775783538818359 nb_pixel_total : 1585 time to create 1 rle with old method : 0.0017113685607910156 time for calcul the mask position with numpy : 0.00789642333984375 nb_pixel_total : 1990 time to create 1 rle with old method : 0.0022754669189453125 time for calcul the mask position with numpy : 0.007951974868774414 nb_pixel_total : 481 time to create 1 rle with old method : 0.0005602836608886719 time for calcul the mask position with numpy : 0.007916450500488281 nb_pixel_total : 567 time to create 1 rle with old method : 0.0006120204925537109 time for calcul the mask position with numpy : 0.007942676544189453 nb_pixel_total : 1039 time to create 1 rle with old method : 0.001081228256225586 time for calcul the mask position with numpy : 0.0081329345703125 nb_pixel_total : 392 time to create 1 rle with old method : 0.0004189014434814453 time for calcul the mask position with numpy : 0.007936477661132812 nb_pixel_total : 2297 time to create 1 rle with old method : 0.002382516860961914 time for calcul the mask position with numpy : 0.007848739624023438 nb_pixel_total : 170 time to create 1 rle with old method : 0.00020360946655273438 time for calcul the mask position with numpy : 0.007862567901611328 nb_pixel_total : 1063 time to create 1 rle with old method : 0.0010852813720703125 time for calcul the mask position with numpy : 0.008017301559448242 nb_pixel_total : 983 time to create 1 rle with old method : 0.0010499954223632812 time for calcul the mask position with numpy : 0.008065938949584961 nb_pixel_total : 588 time to create 1 rle with old method : 0.0007340908050537109 time for calcul the mask position with numpy : 0.008277416229248047 nb_pixel_total : 278 time to create 1 rle with old method : 0.0003199577331542969 time for calcul the mask position with numpy : 0.008383989334106445 nb_pixel_total : 121 time to create 1 rle with old method : 0.0001518726348876953 time for calcul the mask position with numpy : 0.008828163146972656 nb_pixel_total : 102990 time to create 1 rle with old method : 0.11747264862060547 time for calcul the mask position with numpy : 0.008413076400756836 nb_pixel_total : 40 time to create 1 rle with old method : 5.984306335449219e-05 time for calcul the mask position with numpy : 0.008208751678466797 nb_pixel_total : 7714 time to create 1 rle with old method : 0.008626937866210938 time for calcul the mask position with numpy : 0.008320093154907227 nb_pixel_total : 65 time to create 1 rle with old method : 8.463859558105469e-05 time for calcul the mask position with numpy : 0.008399486541748047 nb_pixel_total : 483 time to create 1 rle with old method : 0.0005629062652587891 time for calcul the mask position with numpy : 0.00831747055053711 nb_pixel_total : 627 time to create 1 rle with old method : 0.0007195472717285156 time for calcul the mask position with numpy : 0.00829458236694336 nb_pixel_total : 37971 time to create 1 rle with old method : 0.040608882904052734 time for calcul the mask position with numpy : 0.008358001708984375 nb_pixel_total : 3011 time to create 1 rle with old method : 0.0033991336822509766 time for calcul the mask position with numpy : 0.008057832717895508 nb_pixel_total : 623 time to create 1 rle with old method : 0.0007007122039794922 time for calcul the mask position with numpy : 0.008310794830322266 nb_pixel_total : 167 time to create 1 rle with old method : 0.00020766258239746094 time for calcul the mask position with numpy : 0.007942676544189453 nb_pixel_total : 635 time to create 1 rle with old method : 0.0007181167602539062 time for calcul the mask position with numpy : 0.00785207748413086 nb_pixel_total : 646 time to create 1 rle with old method : 0.0007371902465820312 time for calcul the mask position with numpy : 0.008249998092651367 nb_pixel_total : 292 time to create 1 rle with old method : 0.0003383159637451172 time for calcul the mask position with numpy : 0.008171796798706055 nb_pixel_total : 3090 time to create 1 rle with old method : 0.0033583641052246094 time for calcul the mask position with numpy : 0.008369922637939453 nb_pixel_total : 299 time to create 1 rle with old method : 0.00038814544677734375 time for calcul the mask position with numpy : 0.00828862190246582 nb_pixel_total : 1625 time to create 1 rle with old method : 0.0017998218536376953 time for calcul the mask position with numpy : 0.008162498474121094 nb_pixel_total : 232 time to create 1 rle with old method : 0.0002655982971191406 time for calcul the mask position with numpy : 0.008391857147216797 nb_pixel_total : 20 time to create 1 rle with old method : 4.076957702636719e-05 time for calcul the mask position with numpy : 0.00825643539428711 nb_pixel_total : 267 time to create 1 rle with old method : 0.00030159950256347656 time for calcul the mask position with numpy : 0.00811314582824707 nb_pixel_total : 267 time to create 1 rle with old method : 0.0003376007080078125 time for calcul the mask position with numpy : 0.008174657821655273 nb_pixel_total : 10 time to create 1 rle with old method : 2.193450927734375e-05 time for calcul the mask position with numpy : 0.008304834365844727 nb_pixel_total : 16 time to create 1 rle with old method : 2.8133392333984375e-05 time for calcul the mask position with numpy : 0.008327007293701172 nb_pixel_total : 142 time to create 1 rle with old method : 0.000171661376953125 time for calcul the mask position with numpy : 0.008150577545166016 nb_pixel_total : 195 time to create 1 rle with old method : 0.0002086162567138672 time for calcul the mask position with numpy : 0.008023977279663086 nb_pixel_total : 557 time to create 1 rle with old method : 0.0005915164947509766 time for calcul the mask position with numpy : 0.007871389389038086 nb_pixel_total : 179 time to create 1 rle with old method : 0.00018978118896484375 time for calcul the mask position with numpy : 0.00780487060546875 nb_pixel_total : 58 time to create 1 rle with old method : 6.604194641113281e-05 create new chi : 1.1315441131591797 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.014706134796142578 batch 1 Loaded 79 chid ids of type : 4230 Number RLEs to save : 7958 TO DO : save crop sub photo not yet done ! save time : 0.49782562255859375 nb_obj : 75 nb_hashtags : 5 time to prepare the origin masks : 1.665158987045288 time for calcul the mask position with numpy : 0.032515525817871094 nb_pixel_total : 1911590 time to create 1 rle with new method : 0.4006781578063965 time for calcul the mask position with numpy : 0.011922836303710938 nb_pixel_total : 67705 time to create 1 rle with old method : 0.07164239883422852 time for calcul the mask position with numpy : 0.007630586624145508 nb_pixel_total : 242 time to create 1 rle with old method : 0.0002875328063964844 time for calcul the mask position with numpy : 0.005827903747558594 nb_pixel_total : 454 time to create 1 rle with old method : 0.0004775524139404297 time for calcul the mask position with numpy : 0.006632566452026367 nb_pixel_total : 97 time to create 1 rle with old method : 0.000156402587890625 time for calcul the mask position with numpy : 0.0058591365814208984 nb_pixel_total : 234 time to create 1 rle with old method : 0.00031185150146484375 time for calcul the mask position with numpy : 0.005918025970458984 nb_pixel_total : 57 time to create 1 rle with old method : 8.797645568847656e-05 time for calcul the mask position with numpy : 0.00906682014465332 nb_pixel_total : 480 time to create 1 rle with old method : 0.0005016326904296875 time for calcul the mask position with numpy : 0.005832195281982422 nb_pixel_total : 827 time to create 1 rle with old method : 0.0008738040924072266 time for calcul the mask position with numpy : 0.005599498748779297 nb_pixel_total : 1134 time to create 1 rle with old method : 0.0011725425720214844 time for calcul the mask position with numpy : 0.006074428558349609 nb_pixel_total : 167 time to create 1 rle with old method : 0.00023698806762695312 time for calcul the mask position with numpy : 0.006026506423950195 nb_pixel_total : 2501 time to create 1 rle with old method : 0.0026264190673828125 time for calcul the mask position with numpy : 0.0064084529876708984 nb_pixel_total : 46 time to create 1 rle with old method : 0.00011801719665527344 time for calcul the mask position with numpy : 0.006802558898925781 nb_pixel_total : 267 time to create 1 rle with old method : 0.0002868175506591797 time for calcul the mask position with numpy : 0.006100177764892578 nb_pixel_total : 1902 time to create 1 rle with old method : 0.002128124237060547 time for calcul the mask position with numpy : 0.006011009216308594 nb_pixel_total : 536 time to create 1 rle with old method : 0.0006113052368164062 time for calcul the mask position with numpy : 0.005938291549682617 nb_pixel_total : 555 time to create 1 rle with old method : 0.0005803108215332031 time for calcul the mask position with numpy : 0.0059130191802978516 nb_pixel_total : 453 time to create 1 rle with old method : 0.0005183219909667969 time for calcul the mask position with numpy : 0.005881071090698242 nb_pixel_total : 23 time to create 1 rle with old method : 7.605552673339844e-05 time for calcul the mask position with numpy : 0.006052255630493164 nb_pixel_total : 83 time to create 1 rle with old method : 0.00011086463928222656 time for calcul the mask position with numpy : 0.005949258804321289 nb_pixel_total : 535 time to create 1 rle with old method : 0.0006229877471923828 time for calcul the mask position with numpy : 0.006161928176879883 nb_pixel_total : 710 time to create 1 rle with old method : 0.0007984638214111328 time for calcul the mask position with numpy : 0.0061643123626708984 nb_pixel_total : 808 time to create 1 rle with old method : 0.00092315673828125 time for calcul the mask position with numpy : 0.006699800491333008 nb_pixel_total : 146 time to create 1 rle with old method : 0.0001964569091796875 time for calcul the mask position with numpy : 0.006340742111206055 nb_pixel_total : 222 time to create 1 rle with old method : 0.00028204917907714844 time for calcul the mask position with numpy : 0.006506681442260742 nb_pixel_total : 64 time to create 1 rle with old method : 0.00012373924255371094 time for calcul the mask position with numpy : 0.006317853927612305 nb_pixel_total : 262 time to create 1 rle with old method : 0.0003254413604736328 time for calcul the mask position with numpy : 0.007022380828857422 nb_pixel_total : 1318 time to create 1 rle with old method : 0.0022764205932617188 time for calcul the mask position with numpy : 0.007292509078979492 nb_pixel_total : 92 time to create 1 rle with old method : 0.0001399517059326172 time for calcul the mask position with numpy : 0.006333351135253906 nb_pixel_total : 262 time to create 1 rle with old method : 0.00031638145446777344 time for calcul the mask position with numpy : 0.0062787532806396484 nb_pixel_total : 744 time to create 1 rle with old method : 0.0013303756713867188 time for calcul the mask position with numpy : 0.006647348403930664 nb_pixel_total : 823 time to create 1 rle with old method : 0.00110626220703125 time for calcul the mask position with numpy : 0.00619053840637207 nb_pixel_total : 629 time to create 1 rle with old method : 0.0007393360137939453 time for calcul the mask position with numpy : 0.00631260871887207 nb_pixel_total : 1359 time to create 1 rle with old method : 0.0019371509552001953 time for calcul the mask position with numpy : 0.0061986446380615234 nb_pixel_total : 2625 time to create 1 rle with old method : 0.0027313232421875 time for calcul the mask position with numpy : 0.006138324737548828 nb_pixel_total : 4108 time to create 1 rle with old method : 0.0046122074127197266 time for calcul the mask position with numpy : 0.0059757232666015625 nb_pixel_total : 999 time to create 1 rle with old method : 0.0010828971862792969 time for calcul the mask position with numpy : 0.005902290344238281 nb_pixel_total : 596 time to create 1 rle with old method : 0.0007348060607910156 time for calcul the mask position with numpy : 0.006060361862182617 nb_pixel_total : 1095 time to create 1 rle with old method : 0.0011644363403320312 time for calcul the mask position with numpy : 0.006028890609741211 nb_pixel_total : 354 time to create 1 rle with old method : 0.0004138946533203125 time for calcul the mask position with numpy : 0.005963563919067383 nb_pixel_total : 1549 time to create 1 rle with old method : 0.0016405582427978516 time for calcul the mask position with numpy : 0.006051301956176758 nb_pixel_total : 206 time to create 1 rle with old method : 0.00039196014404296875 time for calcul the mask position with numpy : 0.005640268325805664 nb_pixel_total : 2367 time to create 1 rle with old method : 0.0025234222412109375 time for calcul the mask position with numpy : 0.00730133056640625 nb_pixel_total : 1321 time to create 1 rle with old method : 0.0013823509216308594 time for calcul the mask position with numpy : 0.009274721145629883 nb_pixel_total : 515 time to create 1 rle with old method : 0.0005486011505126953 time for calcul the mask position with numpy : 0.00960087776184082 nb_pixel_total : 119 time to create 1 rle with old method : 0.00015234947204589844 time for calcul the mask position with numpy : 0.00988316535949707 nb_pixel_total : 7247 time to create 1 rle with old method : 0.010114669799804688 time for calcul the mask position with numpy : 0.009493589401245117 nb_pixel_total : 359 time to create 1 rle with old method : 0.0004062652587890625 time for calcul the mask position with numpy : 0.00946664810180664 nb_pixel_total : 62 time to create 1 rle with old method : 0.00011849403381347656 time for calcul the mask position with numpy : 0.009464025497436523 nb_pixel_total : 37692 time to create 1 rle with old method : 0.04009842872619629 time for calcul the mask position with numpy : 0.009871721267700195 nb_pixel_total : 424 time to create 1 rle with old method : 0.0004978179931640625 time for calcul the mask position with numpy : 0.009583473205566406 nb_pixel_total : 614 time to create 1 rle with old method : 0.0007178783416748047 time for calcul the mask position with numpy : 0.010019779205322266 nb_pixel_total : 176 time to create 1 rle with old method : 0.0001952648162841797 time for calcul the mask position with numpy : 0.009862899780273438 nb_pixel_total : 1159 time to create 1 rle with old method : 0.0013358592987060547 time for calcul the mask position with numpy : 0.009801864624023438 nb_pixel_total : 2846 time to create 1 rle with old method : 0.0030591487884521484 time for calcul the mask position with numpy : 0.009743928909301758 nb_pixel_total : 52 time to create 1 rle with old method : 8.416175842285156e-05 time for calcul the mask position with numpy : 0.009517908096313477 nb_pixel_total : 593 time to create 1 rle with old method : 0.0006687641143798828 time for calcul the mask position with numpy : 0.009702205657958984 nb_pixel_total : 169 time to create 1 rle with old method : 0.00019025802612304688 time for calcul the mask position with numpy : 0.009882450103759766 nb_pixel_total : 647 time to create 1 rle with old method : 0.0007407665252685547 time for calcul the mask position with numpy : 0.009181737899780273 nb_pixel_total : 254 time to create 1 rle with old method : 0.00028061866760253906 time for calcul the mask position with numpy : 0.0060498714447021484 nb_pixel_total : 505 time to create 1 rle with old method : 0.0006351470947265625 time for calcul the mask position with numpy : 0.005975008010864258 nb_pixel_total : 2714 time to create 1 rle with old method : 0.0036225318908691406 time for calcul the mask position with numpy : 0.0065097808837890625 nb_pixel_total : 460 time to create 1 rle with old method : 0.0005538463592529297 time for calcul the mask position with numpy : 0.0063054561614990234 nb_pixel_total : 287 time to create 1 rle with old method : 0.00035190582275390625 time for calcul the mask position with numpy : 0.006705045700073242 nb_pixel_total : 1591 time to create 1 rle with old method : 0.0026504993438720703 time for calcul the mask position with numpy : 0.0065364837646484375 nb_pixel_total : 64 time to create 1 rle with old method : 0.00012612342834472656 time for calcul the mask position with numpy : 0.0064945220947265625 nb_pixel_total : 272 time to create 1 rle with old method : 0.00046133995056152344 time for calcul the mask position with numpy : 0.00670170783996582 nb_pixel_total : 279 time to create 1 rle with old method : 0.0004737377166748047 time for calcul the mask position with numpy : 0.0066356658935546875 nb_pixel_total : 301 time to create 1 rle with old method : 0.0005156993865966797 time for calcul the mask position with numpy : 0.00657200813293457 nb_pixel_total : 4 time to create 1 rle with old method : 8.678436279296875e-05 time for calcul the mask position with numpy : 0.0066986083984375 nb_pixel_total : 504 time to create 1 rle with old method : 0.0008363723754882812 time for calcul the mask position with numpy : 0.006844043731689453 nb_pixel_total : 20 time to create 1 rle with old method : 5.2928924560546875e-05 time for calcul the mask position with numpy : 0.006887197494506836 nb_pixel_total : 183 time to create 1 rle with old method : 0.0003247261047363281 time for calcul the mask position with numpy : 0.007057666778564453 nb_pixel_total : 199 time to create 1 rle with old method : 0.00034308433532714844 time for calcul the mask position with numpy : 0.007163286209106445 nb_pixel_total : 550 time to create 1 rle with old method : 0.000904083251953125 time for calcul the mask position with numpy : 0.00691986083984375 nb_pixel_total : 192 time to create 1 rle with old method : 0.0003371238708496094 create new chi : 1.155437707901001 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0015647411346435547 batch 1 Loaded 76 chid ids of type : 4230 Number RLEs to save : 7980 TO DO : save crop sub photo not yet done ! save time : 0.4716329574584961 nb_obj : 63 nb_hashtags : 6 time to prepare the origin masks : 1.1855268478393555 time for calcul the mask position with numpy : 0.0176393985748291 nb_pixel_total : 1809871 time to create 1 rle with new method : 0.030616044998168945 time for calcul the mask position with numpy : 0.005872964859008789 nb_pixel_total : 255 time to create 1 rle with old method : 0.0002994537353515625 time for calcul the mask position with numpy : 0.005710124969482422 nb_pixel_total : 516 time to create 1 rle with old method : 0.0005435943603515625 time for calcul the mask position with numpy : 0.005714893341064453 nb_pixel_total : 343 time to create 1 rle with old method : 0.00043892860412597656 time for calcul the mask position with numpy : 0.00571131706237793 nb_pixel_total : 26 time to create 1 rle with old method : 5.91278076171875e-05 time for calcul the mask position with numpy : 0.0057637691497802734 nb_pixel_total : 14719 time to create 1 rle with old method : 0.01567530632019043 time for calcul the mask position with numpy : 0.009059429168701172 nb_pixel_total : 472 time to create 1 rle with old method : 0.0005457401275634766 time for calcul the mask position with numpy : 0.005630970001220703 nb_pixel_total : 1991 time to create 1 rle with old method : 0.002155780792236328 time for calcul the mask position with numpy : 0.0055735111236572266 nb_pixel_total : 919 time to create 1 rle with old method : 0.0009500980377197266 time for calcul the mask position with numpy : 0.005728960037231445 nb_pixel_total : 721 time to create 1 rle with old method : 0.0007822513580322266 time for calcul the mask position with numpy : 0.005795955657958984 nb_pixel_total : 386 time to create 1 rle with old method : 0.0004229545593261719 time for calcul the mask position with numpy : 0.005682229995727539 nb_pixel_total : 2766 time to create 1 rle with old method : 0.002920389175415039 time for calcul the mask position with numpy : 0.006479501724243164 nb_pixel_total : 51314 time to create 1 rle with old method : 0.05324387550354004 time for calcul the mask position with numpy : 0.005763053894042969 nb_pixel_total : 47 time to create 1 rle with old method : 6.628036499023438e-05 time for calcul the mask position with numpy : 0.005644798278808594 nb_pixel_total : 1317 time to create 1 rle with old method : 0.001383066177368164 time for calcul the mask position with numpy : 0.005522727966308594 nb_pixel_total : 256 time to create 1 rle with old method : 0.00027871131896972656 time for calcul the mask position with numpy : 0.005532264709472656 nb_pixel_total : 2210 time to create 1 rle with old method : 0.0022268295288085938 time for calcul the mask position with numpy : 0.005511283874511719 nb_pixel_total : 4645 time to create 1 rle with old method : 0.004689693450927734 time for calcul the mask position with numpy : 0.00569462776184082 nb_pixel_total : 509 time to create 1 rle with old method : 0.0005273818969726562 time for calcul the mask position with numpy : 0.00557255744934082 nb_pixel_total : 56 time to create 1 rle with old method : 7.843971252441406e-05 time for calcul the mask position with numpy : 0.005652666091918945 nb_pixel_total : 446 time to create 1 rle with old method : 0.000484466552734375 time for calcul the mask position with numpy : 0.005475759506225586 nb_pixel_total : 25 time to create 1 rle with old method : 8.58306884765625e-05 time for calcul the mask position with numpy : 0.005589723587036133 nb_pixel_total : 1433 time to create 1 rle with old method : 0.0014760494232177734 time for calcul the mask position with numpy : 0.0057337284088134766 nb_pixel_total : 538 time to create 1 rle with old method : 0.0005707740783691406 time for calcul the mask position with numpy : 0.0057811737060546875 nb_pixel_total : 707 time to create 1 rle with old method : 0.0008599758148193359 time for calcul the mask position with numpy : 0.005782127380371094 nb_pixel_total : 802 time to create 1 rle with old method : 0.0009188652038574219 time for calcul the mask position with numpy : 0.005701541900634766 nb_pixel_total : 156 time to create 1 rle with old method : 0.00020265579223632812 time for calcul the mask position with numpy : 0.005713939666748047 nb_pixel_total : 216 time to create 1 rle with old method : 0.0002455711364746094 time for calcul the mask position with numpy : 0.005889415740966797 nb_pixel_total : 1297 time to create 1 rle with old method : 0.0014355182647705078 time for calcul the mask position with numpy : 0.0058155059814453125 nb_pixel_total : 108 time to create 1 rle with old method : 0.00013685226440429688 time for calcul the mask position with numpy : 0.005797147750854492 nb_pixel_total : 296 time to create 1 rle with old method : 0.00035190582275390625 time for calcul the mask position with numpy : 0.0056917667388916016 nb_pixel_total : 484 time to create 1 rle with old method : 0.0005676746368408203 time for calcul the mask position with numpy : 0.0057561397552490234 nb_pixel_total : 400 time to create 1 rle with old method : 0.00048232078552246094 time for calcul the mask position with numpy : 0.00589442253112793 nb_pixel_total : 1872 time to create 1 rle with old method : 0.001917123794555664 time for calcul the mask position with numpy : 0.005965232849121094 nb_pixel_total : 3749 time to create 1 rle with old method : 0.0037887096405029297 time for calcul the mask position with numpy : 0.006005048751831055 nb_pixel_total : 1941 time to create 1 rle with old method : 0.002266407012939453 time for calcul the mask position with numpy : 0.005903720855712891 nb_pixel_total : 509 time to create 1 rle with old method : 0.0005905628204345703 time for calcul the mask position with numpy : 0.005885124206542969 nb_pixel_total : 490 time to create 1 rle with old method : 0.0005123615264892578 time for calcul the mask position with numpy : 0.0058574676513671875 nb_pixel_total : 355 time to create 1 rle with old method : 0.00041484832763671875 time for calcul the mask position with numpy : 0.005832195281982422 nb_pixel_total : 188 time to create 1 rle with old method : 0.00021004676818847656 time for calcul the mask position with numpy : 0.0056836605072021484 nb_pixel_total : 2316 time to create 1 rle with old method : 0.002332448959350586 time for calcul the mask position with numpy : 0.005732536315917969 nb_pixel_total : 1271 time to create 1 rle with old method : 0.0013353824615478516 time for calcul the mask position with numpy : 0.005643367767333984 nb_pixel_total : 1 time to create 1 rle with old method : 2.09808349609375e-05 time for calcul the mask position with numpy : 0.006214618682861328 nb_pixel_total : 105260 time to create 1 rle with old method : 0.10830521583557129 time for calcul the mask position with numpy : 0.0059201717376708984 nb_pixel_total : 293 time to create 1 rle with old method : 0.000438690185546875 time for calcul the mask position with numpy : 0.006046295166015625 nb_pixel_total : 38260 time to create 1 rle with old method : 0.041358232498168945 time for calcul the mask position with numpy : 0.006131649017333984 nb_pixel_total : 475 time to create 1 rle with old method : 0.0005700588226318359 time for calcul the mask position with numpy : 0.006074666976928711 nb_pixel_total : 113 time to create 1 rle with old method : 0.0001513957977294922 time for calcul the mask position with numpy : 0.006009340286254883 nb_pixel_total : 1104 time to create 1 rle with old method : 0.0013208389282226562 time for calcul the mask position with numpy : 0.006191253662109375 nb_pixel_total : 2935 time to create 1 rle with old method : 0.0034110546112060547 time for calcul the mask position with numpy : 0.0061185359954833984 nb_pixel_total : 725 time to create 1 rle with old method : 0.0008363723754882812 time for calcul the mask position with numpy : 0.006165266036987305 nb_pixel_total : 177 time to create 1 rle with old method : 0.00022649765014648438 time for calcul the mask position with numpy : 0.006193876266479492 nb_pixel_total : 613 time to create 1 rle with old method : 0.0007193088531494141 time for calcul the mask position with numpy : 0.006015777587890625 nb_pixel_total : 256 time to create 1 rle with old method : 0.0003058910369873047 time for calcul the mask position with numpy : 0.006038665771484375 nb_pixel_total : 2922 time to create 1 rle with old method : 0.003334522247314453 time for calcul the mask position with numpy : 0.0060160160064697266 nb_pixel_total : 1645 time to create 1 rle with old method : 0.001859903335571289 time for calcul the mask position with numpy : 0.005852460861206055 nb_pixel_total : 304 time to create 1 rle with old method : 0.0003600120544433594 time for calcul the mask position with numpy : 0.005739688873291016 nb_pixel_total : 242 time to create 1 rle with old method : 0.0002655982971191406 time for calcul the mask position with numpy : 0.005937099456787109 nb_pixel_total : 262 time to create 1 rle with old method : 0.00031256675720214844 time for calcul the mask position with numpy : 0.005990028381347656 nb_pixel_total : 4473 time to create 1 rle with old method : 0.00487208366394043 time for calcul the mask position with numpy : 0.005787849426269531 nb_pixel_total : 18 time to create 1 rle with old method : 4.410743713378906e-05 time for calcul the mask position with numpy : 0.005781650543212891 nb_pixel_total : 179 time to create 1 rle with old method : 0.0002295970916748047 time for calcul the mask position with numpy : 0.0063169002532958984 nb_pixel_total : 211 time to create 1 rle with old method : 0.00023698806762695312 time for calcul the mask position with numpy : 0.009252786636352539 nb_pixel_total : 194 time to create 1 rle with old method : 0.00021982192993164062 create new chi : 0.7027556896209717 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0010454654693603516 batch 1 Loaded 64 chid ids of type : 4230 Number RLEs to save : 7594 TO DO : save crop sub photo not yet done ! save time : 0.47059082984924316 nb_obj : 73 nb_hashtags : 6 time to prepare the origin masks : 1.222498893737793 time for calcul the mask position with numpy : 0.33251023292541504 nb_pixel_total : 1866932 time to create 1 rle with new method : 0.08390021324157715 time for calcul the mask position with numpy : 0.006079196929931641 nb_pixel_total : 157 time to create 1 rle with old method : 0.0003376007080078125 time for calcul the mask position with numpy : 0.005803585052490234 nb_pixel_total : 242 time to create 1 rle with old method : 0.0003142356872558594 time for calcul the mask position with numpy : 0.0060482025146484375 nb_pixel_total : 497 time to create 1 rle with old method : 0.0006206035614013672 time for calcul the mask position with numpy : 0.005867719650268555 nb_pixel_total : 116 time to create 1 rle with old method : 0.00016307830810546875 time for calcul the mask position with numpy : 0.006122112274169922 nb_pixel_total : 48 time to create 1 rle with old method : 8.749961853027344e-05 time for calcul the mask position with numpy : 0.005770683288574219 nb_pixel_total : 288 time to create 1 rle with old method : 0.00035309791564941406 time for calcul the mask position with numpy : 0.0056874752044677734 nb_pixel_total : 155 time to create 1 rle with old method : 0.0002193450927734375 time for calcul the mask position with numpy : 0.0060274600982666016 nb_pixel_total : 416 time to create 1 rle with old method : 0.0004661083221435547 time for calcul the mask position with numpy : 0.005942344665527344 nb_pixel_total : 696 time to create 1 rle with old method : 0.0007760524749755859 time for calcul the mask position with numpy : 0.005964517593383789 nb_pixel_total : 342 time to create 1 rle with old method : 0.0003688335418701172 time for calcul the mask position with numpy : 0.005712985992431641 nb_pixel_total : 2238 time to create 1 rle with old method : 0.0025131702423095703 time for calcul the mask position with numpy : 0.005791187286376953 nb_pixel_total : 50 time to create 1 rle with old method : 7.104873657226562e-05 time for calcul the mask position with numpy : 0.00585627555847168 nb_pixel_total : 252 time to create 1 rle with old method : 0.00028061866760253906 time for calcul the mask position with numpy : 0.005675077438354492 nb_pixel_total : 631 time to create 1 rle with old method : 0.0007331371307373047 time for calcul the mask position with numpy : 0.0059320926666259766 nb_pixel_total : 2238 time to create 1 rle with old method : 0.002448558807373047 time for calcul the mask position with numpy : 0.005871295928955078 nb_pixel_total : 7 time to create 1 rle with old method : 2.6702880859375e-05 time for calcul the mask position with numpy : 0.005832672119140625 nb_pixel_total : 155 time to create 1 rle with old method : 0.00018930435180664062 time for calcul the mask position with numpy : 0.009521484375 nb_pixel_total : 4296 time to create 1 rle with old method : 0.004754066467285156 time for calcul the mask position with numpy : 0.009528160095214844 nb_pixel_total : 460 time to create 1 rle with old method : 0.0006363391876220703 time for calcul the mask position with numpy : 0.00693821907043457 nb_pixel_total : 474 time to create 1 rle with old method : 0.0005857944488525391 time for calcul the mask position with numpy : 0.005988359451293945 nb_pixel_total : 21 time to create 1 rle with old method : 7.104873657226562e-05 time for calcul the mask position with numpy : 0.006001949310302734 nb_pixel_total : 409 time to create 1 rle with old method : 0.0005114078521728516 time for calcul the mask position with numpy : 0.006094694137573242 nb_pixel_total : 342 time to create 1 rle with old method : 0.0004189014434814453 time for calcul the mask position with numpy : 0.006232500076293945 nb_pixel_total : 1693 time to create 1 rle with old method : 0.0018570423126220703 time for calcul the mask position with numpy : 0.006011962890625 nb_pixel_total : 537 time to create 1 rle with old method : 0.0006132125854492188 time for calcul the mask position with numpy : 0.005977153778076172 nb_pixel_total : 5500 time to create 1 rle with old method : 0.006192684173583984 time for calcul the mask position with numpy : 0.006073713302612305 nb_pixel_total : 694 time to create 1 rle with old method : 0.0007960796356201172 time for calcul the mask position with numpy : 0.005823373794555664 nb_pixel_total : 861 time to create 1 rle with old method : 0.0009062290191650391 time for calcul the mask position with numpy : 0.0057871341705322266 nb_pixel_total : 158 time to create 1 rle with old method : 0.00021338462829589844 time for calcul the mask position with numpy : 0.005916595458984375 nb_pixel_total : 216 time to create 1 rle with old method : 0.0002548694610595703 time for calcul the mask position with numpy : 0.006132841110229492 nb_pixel_total : 577 time to create 1 rle with old method : 0.000682830810546875 time for calcul the mask position with numpy : 0.006153583526611328 nb_pixel_total : 312 time to create 1 rle with old method : 0.0003666877746582031 time for calcul the mask position with numpy : 0.006242513656616211 nb_pixel_total : 756 time to create 1 rle with old method : 0.0008831024169921875 time for calcul the mask position with numpy : 0.006316184997558594 nb_pixel_total : 3937 time to create 1 rle with old method : 0.0045011043548583984 time for calcul the mask position with numpy : 0.0062215328216552734 nb_pixel_total : 1456 time to create 1 rle with old method : 0.0016736984252929688 time for calcul the mask position with numpy : 0.00652003288269043 nb_pixel_total : 487 time to create 1 rle with old method : 0.0006117820739746094 time for calcul the mask position with numpy : 0.0062291622161865234 nb_pixel_total : 1802 time to create 1 rle with old method : 0.0020678043365478516 time for calcul the mask position with numpy : 0.006139039993286133 nb_pixel_total : 545 time to create 1 rle with old method : 0.0006501674652099609 time for calcul the mask position with numpy : 0.006186962127685547 nb_pixel_total : 527 time to create 1 rle with old method : 0.0006284713745117188 time for calcul the mask position with numpy : 0.006775379180908203 nb_pixel_total : 615 time to create 1 rle with old method : 0.0011248588562011719 time for calcul the mask position with numpy : 0.007349967956542969 nb_pixel_total : 320 time to create 1 rle with old method : 0.0004303455352783203 time for calcul the mask position with numpy : 0.0063054561614990234 nb_pixel_total : 107 time to create 1 rle with old method : 0.0001513957977294922 time for calcul the mask position with numpy : 0.006242990493774414 nb_pixel_total : 2269 time to create 1 rle with old method : 0.002537965774536133 time for calcul the mask position with numpy : 0.006339550018310547 nb_pixel_total : 204 time to create 1 rle with old method : 0.00026988983154296875 time for calcul the mask position with numpy : 0.006641864776611328 nb_pixel_total : 1049 time to create 1 rle with old method : 0.001173257827758789 time for calcul the mask position with numpy : 0.0061032772064208984 nb_pixel_total : 564 time to create 1 rle with old method : 0.0006754398345947266 time for calcul the mask position with numpy : 0.0067138671875 nb_pixel_total : 103757 time to create 1 rle with old method : 0.11173653602600098 time for calcul the mask position with numpy : 0.006227731704711914 nb_pixel_total : 7429 time to create 1 rle with old method : 0.00833582878112793 time for calcul the mask position with numpy : 0.005842447280883789 nb_pixel_total : 455 time to create 1 rle with old method : 0.0005404949188232422 time for calcul the mask position with numpy : 0.005923032760620117 nb_pixel_total : 145 time to create 1 rle with old method : 0.000179290771484375 time for calcul the mask position with numpy : 0.0062487125396728516 nb_pixel_total : 38132 time to create 1 rle with old method : 0.04195380210876465 time for calcul the mask position with numpy : 0.006227254867553711 nb_pixel_total : 2888 time to create 1 rle with old method : 0.0038955211639404297 time for calcul the mask position with numpy : 0.006501197814941406 nb_pixel_total : 33 time to create 1 rle with old method : 0.00010204315185546875 time for calcul the mask position with numpy : 0.006651878356933594 nb_pixel_total : 575 time to create 1 rle with old method : 0.0006597042083740234 time for calcul the mask position with numpy : 0.0061511993408203125 nb_pixel_total : 174 time to create 1 rle with old method : 0.00021386146545410156 time for calcul the mask position with numpy : 0.006155729293823242 nb_pixel_total : 652 time to create 1 rle with old method : 0.0007584095001220703 time for calcul the mask position with numpy : 0.007827043533325195 nb_pixel_total : 290 time to create 1 rle with old method : 0.0003535747528076172 time for calcul the mask position with numpy : 0.007323026657104492 nb_pixel_total : 3909 time to create 1 rle with old method : 0.004441261291503906 time for calcul the mask position with numpy : 0.009633064270019531 nb_pixel_total : 273 time to create 1 rle with old method : 0.00032401084899902344 time for calcul the mask position with numpy : 0.009433507919311523 nb_pixel_total : 1599 time to create 1 rle with old method : 0.0017693042755126953 time for calcul the mask position with numpy : 0.009881258010864258 nb_pixel_total : 265 time to create 1 rle with old method : 0.00031280517578125 time for calcul the mask position with numpy : 0.010010242462158203 nb_pixel_total : 64 time to create 1 rle with old method : 8.940696716308594e-05 time for calcul the mask position with numpy : 0.00981593132019043 nb_pixel_total : 57 time to create 1 rle with old method : 8.893013000488281e-05 time for calcul the mask position with numpy : 0.009844064712524414 nb_pixel_total : 276 time to create 1 rle with old method : 0.0003192424774169922 time for calcul the mask position with numpy : 0.009573936462402344 nb_pixel_total : 228 time to create 1 rle with old method : 0.0002675056457519531 time for calcul the mask position with numpy : 0.009684562683105469 nb_pixel_total : 1 time to create 1 rle with old method : 1.8596649169921875e-05 time for calcul the mask position with numpy : 0.009830474853515625 nb_pixel_total : 3590 time to create 1 rle with old method : 0.004039287567138672 time for calcul the mask position with numpy : 0.009689569473266602 nb_pixel_total : 127 time to create 1 rle with old method : 0.00016188621520996094 time for calcul the mask position with numpy : 0.00971841812133789 nb_pixel_total : 209 time to create 1 rle with old method : 0.00023293495178222656 time for calcul the mask position with numpy : 0.009700298309326172 nb_pixel_total : 497 time to create 1 rle with old method : 0.0005822181701660156 time for calcul the mask position with numpy : 0.008143186569213867 nb_pixel_total : 1057 time to create 1 rle with old method : 0.0012040138244628906 time for calcul the mask position with numpy : 0.008479118347167969 nb_pixel_total : 205 time to create 1 rle with old method : 0.0002276897430419922 time for calcul the mask position with numpy : 0.008086681365966797 nb_pixel_total : 65 time to create 1 rle with old method : 7.557868957519531e-05 create new chi : 1.164475440979004 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0011227130889892578 batch 1 Loaded 74 chid ids of type : 4230 Number RLEs to save : 7429 TO DO : save crop sub photo not yet done ! save time : 0.6382012367248535 nb_obj : 71 nb_hashtags : 6 time to prepare the origin masks : 1.159050703048706 time for calcul the mask position with numpy : 0.018413782119750977 nb_pixel_total : 1875515 time to create 1 rle with new method : 0.39983272552490234 time for calcul the mask position with numpy : 0.006066560745239258 nb_pixel_total : 30 time to create 1 rle with old method : 6.29425048828125e-05 time for calcul the mask position with numpy : 0.008579730987548828 nb_pixel_total : 232 time to create 1 rle with old method : 0.0002624988555908203 time for calcul the mask position with numpy : 0.005832672119140625 nb_pixel_total : 515 time to create 1 rle with old method : 0.0005905628204345703 time for calcul the mask position with numpy : 0.005879402160644531 nb_pixel_total : 451 time to create 1 rle with old method : 0.00048279762268066406 time for calcul the mask position with numpy : 0.005762577056884766 nb_pixel_total : 190 time to create 1 rle with old method : 0.00024628639221191406 time for calcul the mask position with numpy : 0.005715131759643555 nb_pixel_total : 45 time to create 1 rle with old method : 8.392333984375e-05 time for calcul the mask position with numpy : 0.005873203277587891 nb_pixel_total : 622 time to create 1 rle with old method : 0.0006868839263916016 time for calcul the mask position with numpy : 0.0058765411376953125 nb_pixel_total : 1205 time to create 1 rle with old method : 0.0014035701751708984 time for calcul the mask position with numpy : 0.005759000778198242 nb_pixel_total : 2575 time to create 1 rle with old method : 0.0027539730072021484 time for calcul the mask position with numpy : 0.005722761154174805 nb_pixel_total : 4285 time to create 1 rle with old method : 0.004587411880493164 time for calcul the mask position with numpy : 0.005774736404418945 nb_pixel_total : 1321 time to create 1 rle with old method : 0.0013916492462158203 time for calcul the mask position with numpy : 0.005635261535644531 nb_pixel_total : 254 time to create 1 rle with old method : 0.0002796649932861328 time for calcul the mask position with numpy : 0.0064961910247802734 nb_pixel_total : 2271 time to create 1 rle with old method : 0.0037496089935302734 time for calcul the mask position with numpy : 0.006436824798583984 nb_pixel_total : 165 time to create 1 rle with old method : 0.0002987384796142578 time for calcul the mask position with numpy : 0.006565570831298828 nb_pixel_total : 188 time to create 1 rle with old method : 0.00033092498779296875 time for calcul the mask position with numpy : 0.006489992141723633 nb_pixel_total : 3258 time to create 1 rle with old method : 0.005356550216674805 time for calcul the mask position with numpy : 0.006440877914428711 nb_pixel_total : 531 time to create 1 rle with old method : 0.0009024143218994141 time for calcul the mask position with numpy : 0.006690502166748047 nb_pixel_total : 16 time to create 1 rle with old method : 9.107589721679688e-05 time for calcul the mask position with numpy : 0.006657838821411133 nb_pixel_total : 483 time to create 1 rle with old method : 0.0008399486541748047 time for calcul the mask position with numpy : 0.0065517425537109375 nb_pixel_total : 122 time to create 1 rle with old method : 0.00023102760314941406 time for calcul the mask position with numpy : 0.006476879119873047 nb_pixel_total : 541 time to create 1 rle with old method : 0.0009298324584960938 time for calcul the mask position with numpy : 0.006597042083740234 nb_pixel_total : 714 time to create 1 rle with old method : 0.0008215904235839844 time for calcul the mask position with numpy : 0.005967378616333008 nb_pixel_total : 69 time to create 1 rle with old method : 0.00011014938354492188 time for calcul the mask position with numpy : 0.006082057952880859 nb_pixel_total : 744 time to create 1 rle with old method : 0.0008485317230224609 time for calcul the mask position with numpy : 0.0060541629791259766 nb_pixel_total : 157 time to create 1 rle with old method : 0.0001926422119140625 time for calcul the mask position with numpy : 0.006456136703491211 nb_pixel_total : 193 time to create 1 rle with old method : 0.00022411346435546875 time for calcul the mask position with numpy : 0.008648395538330078 nb_pixel_total : 245 time to create 1 rle with old method : 0.0002987384796142578 time for calcul the mask position with numpy : 0.008625268936157227 nb_pixel_total : 1358 time to create 1 rle with old method : 0.0014088153839111328 time for calcul the mask position with numpy : 0.008434057235717773 nb_pixel_total : 739 time to create 1 rle with old method : 0.0008995532989501953 time for calcul the mask position with numpy : 0.008725404739379883 nb_pixel_total : 23 time to create 1 rle with old method : 5.984306335449219e-05 time for calcul the mask position with numpy : 0.009082794189453125 nb_pixel_total : 815 time to create 1 rle with old method : 0.0009262561798095703 time for calcul the mask position with numpy : 0.00892782211303711 nb_pixel_total : 778 time to create 1 rle with old method : 0.0008256435394287109 time for calcul the mask position with numpy : 0.009077787399291992 nb_pixel_total : 3832 time to create 1 rle with old method : 0.004070281982421875 time for calcul the mask position with numpy : 0.005704164505004883 nb_pixel_total : 264 time to create 1 rle with old method : 0.00034356117248535156 time for calcul the mask position with numpy : 0.005764961242675781 nb_pixel_total : 2035 time to create 1 rle with old method : 0.0022428035736083984 time for calcul the mask position with numpy : 0.0057964324951171875 nb_pixel_total : 362 time to create 1 rle with old method : 0.0004398822784423828 time for calcul the mask position with numpy : 0.005805253982543945 nb_pixel_total : 1870 time to create 1 rle with old method : 0.002039670944213867 time for calcul the mask position with numpy : 0.005646467208862305 nb_pixel_total : 553 time to create 1 rle with old method : 0.0006096363067626953 time for calcul the mask position with numpy : 0.005770444869995117 nb_pixel_total : 724 time to create 1 rle with old method : 0.0008103847503662109 time for calcul the mask position with numpy : 0.005737781524658203 nb_pixel_total : 1482 time to create 1 rle with old method : 0.0016956329345703125 time for calcul the mask position with numpy : 0.0060770511627197266 nb_pixel_total : 156 time to create 1 rle with old method : 0.0001971721649169922 time for calcul the mask position with numpy : 0.00636601448059082 nb_pixel_total : 2381 time to create 1 rle with old method : 0.0025985240936279297 time for calcul the mask position with numpy : 0.005980253219604492 nb_pixel_total : 1086 time to create 1 rle with old method : 0.001161813735961914 time for calcul the mask position with numpy : 0.0060198307037353516 nb_pixel_total : 755 time to create 1 rle with old method : 0.0008399486541748047 time for calcul the mask position with numpy : 0.005890607833862305 nb_pixel_total : 321 time to create 1 rle with old method : 0.000385284423828125 time for calcul the mask position with numpy : 0.0059833526611328125 nb_pixel_total : 126 time to create 1 rle with old method : 0.00015354156494140625 time for calcul the mask position with numpy : 0.0063970088958740234 nb_pixel_total : 103361 time to create 1 rle with old method : 0.11489272117614746 time for calcul the mask position with numpy : 0.006167173385620117 nb_pixel_total : 10 time to create 1 rle with old method : 2.9802322387695312e-05 time for calcul the mask position with numpy : 0.00603485107421875 nb_pixel_total : 448 time to create 1 rle with old method : 0.0005283355712890625 time for calcul the mask position with numpy : 0.006041049957275391 nb_pixel_total : 129 time to create 1 rle with old method : 0.0002079010009765625 time for calcul the mask position with numpy : 0.006605625152587891 nb_pixel_total : 38091 time to create 1 rle with old method : 0.04294586181640625 time for calcul the mask position with numpy : 0.0063474178314208984 nb_pixel_total : 3060 time to create 1 rle with old method : 0.0035495758056640625 time for calcul the mask position with numpy : 0.006234169006347656 nb_pixel_total : 692 time to create 1 rle with old method : 0.0008070468902587891 time for calcul the mask position with numpy : 0.006247997283935547 nb_pixel_total : 177 time to create 1 rle with old method : 0.0002238750457763672 time for calcul the mask position with numpy : 0.006134748458862305 nb_pixel_total : 3878 time to create 1 rle with old method : 0.004341840744018555 time for calcul the mask position with numpy : 0.006087064743041992 nb_pixel_total : 279 time to create 1 rle with old method : 0.0003190040588378906 time for calcul the mask position with numpy : 0.005819797515869141 nb_pixel_total : 514 time to create 1 rle with old method : 0.0005764961242675781 time for calcul the mask position with numpy : 0.005770683288574219 nb_pixel_total : 296 time to create 1 rle with old method : 0.00034308433532714844 time for calcul the mask position with numpy : 0.005867958068847656 nb_pixel_total : 1474 time to create 1 rle with old method : 0.001684427261352539 time for calcul the mask position with numpy : 0.005777120590209961 nb_pixel_total : 887 time to create 1 rle with old method : 0.0010030269622802734 time for calcul the mask position with numpy : 0.005868196487426758 nb_pixel_total : 208 time to create 1 rle with old method : 0.00023627281188964844 time for calcul the mask position with numpy : 0.006055355072021484 nb_pixel_total : 291 time to create 1 rle with old method : 0.0003833770751953125 time for calcul the mask position with numpy : 0.006066560745239258 nb_pixel_total : 277 time to create 1 rle with old method : 0.00034546852111816406 time for calcul the mask position with numpy : 0.0057294368743896484 nb_pixel_total : 8 time to create 1 rle with old method : 4.363059997558594e-05 time for calcul the mask position with numpy : 0.005631446838378906 nb_pixel_total : 17 time to create 1 rle with old method : 4.00543212890625e-05 time for calcul the mask position with numpy : 0.005812168121337891 nb_pixel_total : 218 time to create 1 rle with old method : 0.0002675056457519531 time for calcul the mask position with numpy : 0.0056192874908447266 nb_pixel_total : 1653 time to create 1 rle with old method : 0.0017011165618896484 time for calcul the mask position with numpy : 0.00556492805480957 nb_pixel_total : 495 time to create 1 rle with old method : 0.0005309581756591797 time for calcul the mask position with numpy : 0.0056874752044677734 nb_pixel_total : 330 time to create 1 rle with old method : 0.00035762786865234375 time for calcul the mask position with numpy : 0.006013393402099609 nb_pixel_total : 8 time to create 1 rle with old method : 2.6941299438476562e-05 time for calcul the mask position with numpy : 0.005892753601074219 nb_pixel_total : 202 time to create 1 rle with old method : 0.0002498626708984375 create new chi : 1.103081464767456 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0011179447174072266 batch 1 Loaded 72 chid ids of type : 4230 Number RLEs to save : 7649 TO DO : save crop sub photo not yet done ! save time : 2.4397268295288086 map_output_result : {1340529450: (0.0, 'Should be the crop_list due to order', 0.0), 1340529435: (0.0, 'Should be the crop_list due to order', 0.0), 1340529433: (0.0, 'Should be the crop_list due to order', 0.0), 1340529430: (0.0, 'Should be the crop_list due to order', 0.0), 1340529427: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1340529450, 1340529435, 1340529433, 1340529430, 1340529427] Looping around the photos to save general results len do output : 5 /1340529450.Didn't retrieve data . /1340529435.Didn't retrieve data . /1340529433.Didn't retrieve data . /1340529430.Didn't retrieve data . /1340529427.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529450', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529435', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529433', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529430', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529427', None, None, None, None, None, '2627702') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.013365507125854492 save_final save missing photos in datou_result : time spend for datou_step_exec : 16.516270875930786 time spend to save output : 0.013628244400024414 total time spend for step 4 : 16.52989912033081 step5:crop_condition Mon Mar 3 02:21:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 5 ! batch 1 Loaded 365 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 122 About to insert : list_path_to_insert length 122 new photo from crops ! About to upload 122 photos upload in portfolio : 4869462 init cache_photo without model_param we have 122 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740964886_3990467 we have uploaded 122 photos in the portfolio 4869462 time of upload the photos Elapsed time : 33.59282422065735 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 28 About to insert : list_path_to_insert length 28 new photo from crops ! About to upload 28 photos upload in portfolio : 4869462 init cache_photo without model_param we have 28 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740964920_3990467 we have uploaded 28 photos in the portfolio 4869462 time of upload the photos Elapsed time : 8.305249691009521 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 5 About to insert : list_path_to_insert length 5 new photo from crops ! About to upload 5 photos upload in portfolio : 4869462 init cache_photo without model_param we have 5 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740964928_3990467 we have uploaded 5 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.6347682476043701 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 11 About to insert : list_path_to_insert length 11 new photo from crops ! About to upload 11 photos upload in portfolio : 4869462 init cache_photo without model_param we have 11 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740964930_3990467 we have uploaded 11 photos in the portfolio 4869462 time of upload the photos Elapsed time : 3.3066632747650146 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 72 About to insert : list_path_to_insert length 72 new photo from crops ! About to upload 72 photos upload in portfolio : 4869462 init cache_photo without model_param we have 72 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1740964935_3990467 we have uploaded 72 photos in the portfolio 4869462 time of upload the photos Elapsed time : 17.621524333953857 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1340529450, 1340529435, 1340529433, 1340529430, 1340529427] Looping around the photos to save general results len do output : 238 /1340563155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563206Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1340563401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529450', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529435', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529433', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529430', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529427', None, None, None, None, None, '2627702') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 719 time used for this insertion : 0.041873931884765625 save_final save missing photos in datou_result : time spend for datou_step_exec : 69.01622819900513 time spend to save output : 0.048460960388183594 total time spend for step 5 : 69.06468915939331 step6:thcl Mon Mar 3 02:22:32 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.01674675941467285 time to convert the images to numpy array : 0.06227564811706543 time to import caffe and check if the image exist : 0.012553930282592773 time to convert the images to numpy array : 0.07281327247619629 time to import caffe and check if the image exist : 0.016338825225830078 time to convert the images to numpy array : 0.07751011848449707 time to import caffe and check if the image exist : 0.0169222354888916 time to convert the images to numpy array : 0.07909989356994629 time to import caffe and check if the image exist : 0.024189472198486328 time to convert the images to numpy array : 0.0747382640838623 time to import caffe and check if the image exist : 0.024923086166381836 time to convert the images to numpy array : 0.07587718963623047 time to import caffe and check if the image exist : 0.024904727935791016 time to convert the images to numpy array : 0.07594561576843262 time to import caffe and check if the image exist : 0.02749347686767578 time to convert the images to numpy array : 0.07444381713867188 time to import caffe and check if the image exist : 0.02196502685546875 time to convert the images to numpy array : 0.07913875579833984 time to import caffe and check if the image exist : 0.02580094337463379 time to convert the images to numpy array : 0.07679557800292969 total time to convert the images to numpy array : 0.4627077579498291 list photo_ids error: [] list photo_ids correct : [1340563380, 1340563381, 1340563382, 1340563383, 1340563384, 1340563385, 1340563386, 1340563387, 1340563388, 1340563389, 1340563390, 1340563391, 1340563392, 1340563393, 1340563394, 1340563395, 1340563396, 1340563397, 1340563398, 1340563399, 1340563400, 1340563401, 1340563155, 1340563156, 1340563157, 1340563158, 1340563159, 1340563160, 1340563161, 1340563162, 1340563163, 1340563164, 1340563165, 1340563166, 1340563167, 1340563168, 1340563169, 1340563170, 1340563171, 1340563172, 1340563173, 1340563174, 1340563175, 1340563176, 1340563177, 1340563178, 1340563203, 1340563204, 1340563205, 1340563206, 1340563207, 1340563208, 1340563210, 1340563211, 1340563212, 1340563213, 1340563214, 1340563215, 1340563216, 1340563217, 1340563218, 1340563219, 1340563220, 1340563221, 1340563222, 1340563223, 1340563224, 1340563225, 1340563226, 1340563227, 1340563179, 1340563180, 1340563181, 1340563182, 1340563183, 1340563184, 1340563185, 1340563186, 1340563187, 1340563188, 1340563189, 1340563190, 1340563191, 1340563192, 1340563193, 1340563194, 1340563195, 1340563196, 1340563197, 1340563198, 1340563199, 1340563200, 1340563201, 1340563202, 1340563301, 1340563302, 1340563303, 1340563304, 1340563305, 1340563306, 1340563308, 1340563309, 1340563310, 1340563311, 1340563312, 1340563313, 1340563314, 1340563315, 1340563316, 1340563317, 1340563318, 1340563319, 1340563320, 1340563321, 1340563322, 1340563323, 1340563329, 1340563330, 1340563252, 1340563253, 1340563254, 1340563255, 1340563256, 1340563257, 1340563258, 1340563259, 1340563260, 1340563261, 1340563262, 1340563263, 1340563264, 1340563265, 1340563266, 1340563267, 1340563268, 1340563269, 1340563271, 1340563272, 1340563273, 1340563274, 1340563275, 1340563276, 1340563277, 1340563278, 1340563279, 1340563280, 1340563281, 1340563282, 1340563283, 1340563284, 1340563285, 1340563286, 1340563287, 1340563288, 1340563289, 1340563290, 1340563291, 1340563292, 1340563293, 1340563294, 1340563295, 1340563296, 1340563297, 1340563298, 1340563299, 1340563300, 1340563228, 1340563229, 1340563230, 1340563231, 1340563232, 1340563233, 1340563234, 1340563235, 1340563236, 1340563237, 1340563238, 1340563239, 1340563240, 1340563241, 1340563242, 1340563243, 1340563244, 1340563245, 1340563246, 1340563247, 1340563248, 1340563249, 1340563250, 1340563251, 1340563356, 1340563357, 1340563358, 1340563359, 1340563360, 1340563361, 1340563362, 1340563363, 1340563364, 1340563365, 1340563366, 1340563367, 1340563368, 1340563369, 1340563370, 1340563371, 1340563372, 1340563373, 1340563374, 1340563375, 1340563376, 1340563377, 1340563378, 1340563379, 1340563331, 1340563332, 1340563333, 1340563334, 1340563335, 1340563336, 1340563337, 1340563338, 1340563340, 1340563341, 1340563342, 1340563343, 1340563344, 1340563345, 1340563346, 1340563347, 1340563348, 1340563349, 1340563350, 1340563351, 1340563352, 1340563353, 1340563354, 1340563355] number of photos to traite : 238 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 7037 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 6818 max_wait_temp : 1 max_wait : 0 dict_keys(['prob', 'pool5']) time used to do the prepocess of the images : 1.1390113830566406 time used to do the prediction : 0.9909975528717041 save descriptor for thcl : 3237 time to traite the descriptors : 1.3393006324768066 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1340563380 To insert : 1340563381 To insert : 1340563382 To insert : 1340563383 To insert : 1340563384 To insert : 1340563385 To insert : 1340563386 To insert : 1340563387 To insert : 1340563388 To insert : 1340563389 To insert : 1340563390 To insert : 1340563391 To insert : 1340563392 To insert : 1340563393 To insert : 1340563394 To insert : 1340563395 To insert : 1340563396 To insert : 1340563397 To insert : 1340563398 To insert : 1340563399 To insert : 1340563400 To insert : 1340563401 To insert : 1340563155 To insert : 1340563156 To insert : 1340563157 To insert : 1340563158 To insert : 1340563159 To insert : 1340563160 To insert : 1340563161 To insert : 1340563162 To insert : 1340563163 To insert : 1340563164 To insert : 1340563165 To insert : 1340563166 To insert : 1340563167 To insert : 1340563168 To insert : 1340563169 To insert : 1340563170 To insert : 1340563171 To insert : 1340563172 To insert : 1340563173 To insert : 1340563174 To insert : 1340563175 To insert : 1340563176 To insert : 1340563177 To insert : 1340563178 To insert : 1340563203 To insert : 1340563204 To insert : 1340563205 To insert : 1340563206 To insert : 1340563207 To insert : 1340563208 To insert : 1340563210 To insert : 1340563211 To insert : 1340563212 To insert : 1340563213 To insert : 1340563214 To insert : 1340563215 To insert : 1340563216 To insert : 1340563217 To insert : 1340563218 To insert : 1340563219 To insert : 1340563220 To insert : 1340563221 To insert : 1340563222 To insert : 1340563223 To insert : 1340563224 To insert : 1340563225 To insert : 1340563226 To insert : 1340563227 To insert : 1340563179 To insert : 1340563180 To insert : 1340563181 To insert : 1340563182 To insert : 1340563183 To insert : 1340563184 To insert : 1340563185 To insert : 1340563186 To insert : 1340563187 To insert : 1340563188 To insert : 1340563189 To insert : 1340563190 To insert : 1340563191 To insert : 1340563192 To insert : 1340563193 To insert : 1340563194 To insert : 1340563195 To insert : 1340563196 To insert : 1340563197 To insert : 1340563198 To insert : 1340563199 To insert : 1340563200 To insert : 1340563201 To insert : 1340563202 To insert : 1340563301 To insert : 1340563302 To insert : 1340563303 To insert : 1340563304 To insert : 1340563305 To insert : 1340563306 To insert : 1340563308 To insert : 1340563309 To insert : 1340563310 To insert : 1340563311 To insert : 1340563312 To insert : 1340563313 To insert : 1340563314 To insert : 1340563315 To insert : 1340563316 To insert : 1340563317 To insert : 1340563318 To insert : 1340563319 To insert : 1340563320 To insert : 1340563321 To insert : 1340563322 To insert : 1340563323 To insert : 1340563329 To insert : 1340563330 To insert : 1340563252 To insert : 1340563253 To insert : 1340563254 To insert : 1340563255 To insert : 1340563256 To insert : 1340563257 To insert : 1340563258 To insert : 1340563259 To insert : 1340563260 To insert : 1340563261 To insert : 1340563262 To insert : 1340563263 To insert : 1340563264 To insert : 1340563265 To insert : 1340563266 To insert : 1340563267 To insert : 1340563268 To insert : 1340563269 To insert : 1340563271 To insert : 1340563272 To insert : 1340563273 To insert : 1340563274 To insert : 1340563275 To insert : 1340563276 To insert : 1340563277 To insert : 1340563278 To insert : 1340563279 To insert : 1340563280 To insert : 1340563281 To insert : 1340563282 To insert : 1340563283 To insert : 1340563284 To insert : 1340563285 To insert : 1340563286 To insert : 1340563287 To insert : 1340563288 To insert : 1340563289 To insert : 1340563290 To insert : 1340563291 To insert : 1340563292 To insert : 1340563293 To insert : 1340563294 To insert : 1340563295 To insert : 1340563296 To insert : 1340563297 To insert : 1340563298 To insert : 1340563299 To insert : 1340563300 To insert : 1340563228 To insert : 1340563229 To insert : 1340563230 To insert : 1340563231 To insert : 1340563232 To insert : 1340563233 To insert : 1340563234 To insert : 1340563235 To insert : 1340563236 To insert : 1340563237 To insert : 1340563238 To insert : 1340563239 To insert : 1340563240 To insert : 1340563241 To insert : 1340563242 To insert : 1340563243 To insert : 1340563244 To insert : 1340563245 To insert : 1340563246 To insert : 1340563247 To insert : 1340563248 To insert : 1340563249 To insert : 1340563250 To insert : 1340563251 To insert : 1340563356 To insert : 1340563357 To insert : 1340563358 To insert : 1340563359 To insert : 1340563360 To insert : 1340563361 To insert : 1340563362 To insert : 1340563363 To insert : 1340563364 To insert : 1340563365 To insert : 1340563366 To insert : 1340563367 To insert : 1340563368 To insert : 1340563369 To insert : 1340563370 To insert : 1340563371 To insert : 1340563372 To insert : 1340563373 To insert : 1340563374 To insert : 1340563375 To insert : 1340563376 To insert : 1340563377 To insert : 1340563378 To insert : 1340563379 To insert : 1340563331 To insert : 1340563332 To insert : 1340563333 To insert : 1340563334 To insert : 1340563335 To insert : 1340563336 To insert : 1340563337 To insert : 1340563338 To insert : 1340563340 To insert : 1340563341 To insert : 1340563342 To insert : 1340563343 To insert : 1340563344 To insert : 1340563345 To insert : 1340563346 To insert : 1340563347 To insert : 1340563348 To insert : 1340563349 To insert : 1340563350 To insert : 1340563351 To insert : 1340563352 To insert : 1340563353 To insert : 1340563354 To insert : 1340563355 time to insert the descriptors : 49.15160775184631 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 368 time used for this insertion : 0.02691054344177246 save missing photos in datou_result : time spend for datou_step_exec : 56.91354727745056 time spend to save output : 0.07780146598815918 total time spend for step 6 : 56.99134874343872 step7:ventilate_hashtags_in_portfolio Mon Mar 3 02:23:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20957641 get user id for portfolio 20957641 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957641 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','PEHD','carton','refus','metal','pet_clair','pehd','pet_fonce','environnement','mal_croppe','flou','Carton','Film_plastique','Papier','Tetrapak','PET_clair','papier','PET_fonce')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957641 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','PEHD','carton','refus','metal','pet_clair','pehd','pet_fonce','environnement','mal_croppe','flou','Carton','Film_plastique','Papier','Tetrapak','PET_clair','papier','PET_fonce')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957641 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','PEHD','carton','refus','metal','pet_clair','pehd','pet_fonce','environnement','mal_croppe','flou','Carton','Film_plastique','Papier','Tetrapak','PET_clair','papier','PET_fonce')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957641 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('autre','PEHD','carton','refus','metal','pet_clair','pehd','pet_fonce','environnement','mal_croppe','flou','Carton','Film_plastique','Papier','Tetrapak','PET_clair','papier','PET_fonce')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20958544,20958550,20958555,20958547,20958548,20958559,20958561,20958552,20958553,20958554,20958556,20958560,20958558?tags=autre,pehd,carton,refus,metal,pet_clair,pet_fonce,environnement,mal_croppe,flou,film_plastique,papier,tetrapak&datou_id_consolidate=4235&port_consolidate=20957641 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1340529450, 1340529435, 1340529433, 1340529430, 1340529427] Looping around the photos to save general results len do output : 1 /20957641. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529450', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529435', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529433', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529430', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529427', None, None, None, None, None, '2627702') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.014436960220336914 save_final save missing photos in datou_result : time spend for datou_step_exec : 3.5270700454711914 time spend to save output : 0.014728307723999023 total time spend for step 7 : 3.5417983531951904 step8:final Mon Mar 3 02:23:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1340529450: ('0.16060888698167589',), 1340529435: ('0.16060888698167589',), 1340529433: ('0.16060888698167589',), 1340529430: ('0.16060888698167589',), 1340529427: ('0.16060888698167589',)} new output for save of step final : {1340529450: ('0.16060888698167589',), 1340529435: ('0.16060888698167589',), 1340529433: ('0.16060888698167589',), 1340529430: ('0.16060888698167589',), 1340529427: ('0.16060888698167589',)} [1340529450, 1340529435, 1340529433, 1340529430, 1340529427] Looping around the photos to save general results len do output : 5 /1340529450.Didn't retrieve data . /1340529435.Didn't retrieve data . /1340529433.Didn't retrieve data . /1340529430.Didn't retrieve data . /1340529427.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529450', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529435', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529433', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529430', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529427', None, None, None, None, None, '2627702') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 15 time used for this insertion : 0.013628482818603516 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12411665916442871 time spend to save output : 0.013931512832641602 total time spend for step 8 : 0.1380481719970703 step9:velours_tree Mon Mar 3 02:23:33 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20958544,20958550,20958555,20958547,20958548,20958559,20958561,20958552,20958553,20958554,20958556,20958560,20958558 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20958544 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20958550 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20958555 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20958547 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20958548 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20958559 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20958561 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20958552 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20958553 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20958554 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20958556 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20958560 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20958558 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 238 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [4 2 0 0 0 1 5 0 3 5 4 5 5 5 5 5 3 4 5 2 2 3 0 5 4 4 3 0 0 1 0 5 3 0 5 4 5 5 4 5 5 3 4 2 2 2 3 0 5 4 5 2 3 0 0 0 0 0 5 3 4 5 0 5 4 5 5 5 4 2 2 3 0 2 5 4 5 2 3 0 0 0 1 5 0 0 3 5 5 4 5 5 5 3 2 4 2 2 2 3 0 5 4 5 0 0 1 0 4 0 5 4 5 5 5 4 2 2 3 0 5 4 1 1 0 5 4 1 4 4 1 1 5 1 1 4 1 1 1 1 4 4 1 1 4 4 1 5 5 4 5 5 3 5 3 0 5 0 3 5 3 0 2 0 0 0 1 1 1 1 0 0 4 2 2 4 2 1 0 4 4 4 4 1 1 0 0 2 2 4 5 2 1 0 4 4 4 1 1 0 0 2 2 4 5 1 0 4 4 4 1 1 1 0 0 4 2 4 4 5 2 1 4 4 4 1 1 0 0 5 2 2 4 5 2 1 2 4] Elapsed time: 0.03557229042053223 graph_id used : 81085 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20958544,20958550,20958555,20958547,20958548,20958559,20958561,20958552,20958553,20958554,20958556,20958560,20958558?tags=autre,pehd,carton,refus,metal,pet_clair,pet_fonce,environnement,mal_croppe,flou,film_plastique,papier,tetrapak&datou_id_consolidate=4235&port_consolidate=20957641&tree_id=81085 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1340529450, 1340529435, 1340529433, 1340529430, 1340529427] Looping around the photos to save general results len do output : 1 /20957641Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529450', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529435', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529433', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529430', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529427', None, None, None, None, None, '2627702') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.013684511184692383 save_final save missing photos in datou_result : time spend for datou_step_exec : 19.020968914031982 time spend to save output : 0.013996601104736328 total time spend for step 9 : 19.03496551513672 step10:send_mail_cod Mon Mar 3 02:23:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20957641_03-03-2025_02_23_52.pdf 20958526 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209585261740965032 20958532 imagette209585321740965033 20958537 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209585371740965033 20958529 imagette209585291740965034 20958530 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209585301740965034 20958541 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209585411740965034 20958543 imagette209585431740965035 20958535 imagette209585351740965035 20958536 imagette209585361740965035 20958538 imagette209585381740965035 20958542 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette209585421740965035 20958540 imagette209585401740965036 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20957641 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20958544,20958550,20958555,20958547,20958548,20958559,20958561,20958552,20958553,20958554,20958556,20958560,20958558?tags=autre,pehd,carton,refus,metal,pet_clair,pet_fonce,environnement,mal_croppe,flou,film_plastique,papier,tetrapak&datou_id_consolidate=4235&port_consolidate=20957641&tree_id=81085 your option no_mail is active, we will not send the real mail to your client args[1340529450] : ((1340529450, -7.518526137338691, 492609224), (1340529450, -0.4757070008428001, 496442774), '0.16060888698167589') We are sending mail with results at cod@fotonower.com args[1340529435] : ((1340529435, -7.513963407904754, 492609224), (1340529435, -0.472800441257126, 496442774), '0.16060888698167589') We are sending mail with results at cod@fotonower.com args[1340529433] : ((1340529433, -7.508022309889931, 492609224), (1340529433, -0.4713553806655997, 496442774), '0.16060888698167589') We are sending mail with results at cod@fotonower.com args[1340529430] : ((1340529430, -7.5141342490402065, 492609224), (1340529430, -0.4706342453993569, 496442774), '0.16060888698167589') We are sending mail with results at cod@fotonower.com args[1340529427] : ((1340529427, -7.511953827761876, 492609224), (1340529427, -0.4680470431081079, 496442774), '0.16060888698167589') We are sending mail with results at cod@fotonower.com refus_total : 0.16060888698167589 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20957641 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957641_03-03-2025_02_23_52.pdf results_Qualipapia_P20957641_03-03-2025_02_23_52.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957641_03-03-2025_02_23_52.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20957641','results_Qualipapia_P20957641_03-03-2025_02_23_52.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957641_03-03-2025_02_23_52.pdf','pdf','','0.17','0.16060888698167589') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1340529450, 1340529435, 1340529433, 1340529430, 1340529427] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529450', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529435', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529433', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529430', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529427', None, None, None, None, None, '2627702') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.013435840606689453 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.7961745262146 time spend to save output : 0.013600349426269531 total time spend for step 10 : 4.809774875640869 step11:split_time_score Mon Mar 3 02:23:57 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 23),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 02032025 20957641 Nombre de photos uploadées : 23 / 23040 (0%) 02032025 20957641 Nombre de photos taguées (types de déchets): 23 / 23 (100%) 02032025 20957641 Nombre de photos taguées (volume) : 0 / 23 (0%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 6.67572021484375e-06 ??????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0012636184692382812 elapsed_time : insert_dashboard_record_day_entry 0.024465560913085938 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957601 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957602 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957603 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957604 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957605 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957606 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957607 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957608 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957609 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957610 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957611 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957612 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957613 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957614 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957615 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957616 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957617 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957618 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957619 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957620 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957621 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957622 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957623 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957624 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957625 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957626 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957627 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957628 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957629 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957630 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957631 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957632 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957633 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957634 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957635 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957636 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957637 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957638 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957639 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957640 order by id desc limit 1 Qualite : 0.16060888698167589 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957641_03-03-2025_02_23_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957641 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957641 AND mptpi.`type`=4230 To do Qualite : 0.16844320161035617 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957642_03-03-2025_01_57_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957642 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957642 AND mptpi.`type`=4230 To do Qualite : 0.192882259433865 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957643_03-03-2025_01_50_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957643 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957643 AND mptpi.`type`=4230 To do Qualite : 0.19586536514647981 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957644_03-03-2025_01_45_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957644 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957644 AND mptpi.`type`=4230 To do Qualite : 0.2092123416974779 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957645_03-03-2025_01_33_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957645 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957645 AND mptpi.`type`=4230 To do Qualite : 0.20638085550742077 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957646_03-03-2025_01_22_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957646 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957646 AND mptpi.`type`=4230 To do Qualite : 0.22146667136123907 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957647_03-03-2025_01_16_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957647 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957647 AND mptpi.`type`=4230 To do Qualite : 0.19152548119984242 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957648_03-03-2025_00_51_08.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957648 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957648 AND mptpi.`type`=4230 To do Qualite : 0.22877186881093695 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957649_03-03-2025_00_48_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957649 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957649 AND mptpi.`type`=4230 To do Qualite : 0.23421457348364924 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957650_03-03-2025_00_52_25.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957650 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957650 AND mptpi.`type`=4230 To do Qualite : 0.2245714344163915 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957651_03-03-2025_00_34_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957651 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957651 AND mptpi.`type`=4230 To do Qualite : 0.22212740105907633 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957652_03-03-2025_00_32_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957652 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957652 AND mptpi.`type`=4230 To do Qualite : 0.21121739094852754 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957653_03-03-2025_00_18_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957653 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957653 AND mptpi.`type`=4230 To do Qualite : 0.22036621398782735 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957654_03-03-2025_00_12_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957654 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957654 AND mptpi.`type`=4230 To do Qualite : 0.20524542589930503 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20957655_03-03-2025_00_17_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20957655 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20957655 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'02032025': {'nb_upload': 23, 'nb_taggue_class': 23, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1340529450, 1340529435, 1340529433, 1340529430, 1340529427] Looping around the photos to save general results len do output : 1 /20957641Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529450', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529435', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529433', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529430', None, None, None, None, None, '2627702') ('4234', None, None, None, None, None, None, None, '2627702') ('4234', '20957641', '1340529427', None, None, None, None, None, '2627702') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.014636993408203125 save_final save missing photos in datou_result : time spend for datou_step_exec : 34.227423429489136 time spend to save output : 0.01481008529663086 total time spend for step 11 : 34.24223351478577 caffe_path_current : About to save ! 2 After save, about to update current ! update_current_state 50.79user 32.25system 4:07.48elapsed 33%CPU (0avgtext+0avgdata 2536724maxresident)k 915128inputs+17800outputs (1078major+2339192minor)pagefaults 0swaps