python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2133718 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2588801'] with mtr_portfolio_ids : ['20568607'] and first list_photo_ids : [] new path : /proc/2133718/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 2 ; length of list_pids : 2 ; length of list_args : 2 time to download the photos : 0.29163575172424316 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Fri Feb 14 20:20:28 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10774 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-14 20:20:31.245351: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-14 20:20:31.271049: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-14 20:20:31.272995: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f239c000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-14 20:20:31.273051: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-14 20:20:31.277138: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-14 20:20:31.516928: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x306e45d0 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-14 20:20:31.516983: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-14 20:20:31.518409: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-14 20:20:31.518826: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-14 20:20:31.521796: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-14 20:20:31.524766: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-14 20:20:31.525262: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-14 20:20:31.528272: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-14 20:20:31.529342: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-14 20:20:31.534185: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-14 20:20:31.535741: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-14 20:20:31.535833: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-14 20:20:31.536635: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-14 20:20:31.536652: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-14 20:20:31.536661: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-14 20:20:31.538039: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-14 20:20:31.819547: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-14 20:20:31.819679: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-14 20:20:31.819707: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-14 20:20:31.819734: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-14 20:20:31.819759: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-14 20:20:31.819784: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-14 20:20:31.819809: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-14 20:20:31.819834: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-14 20:20:31.821266: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-14 20:20:31.822551: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-14 20:20:31.822621: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-14 20:20:31.822638: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-14 20:20:31.822652: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-14 20:20:31.822667: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-14 20:20:31.822682: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-14 20:20:31.822696: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-14 20:20:31.822711: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-14 20:20:31.824094: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-14 20:20:31.824142: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-14 20:20:31.824151: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-14 20:20:31.824160: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-14 20:20:31.825518: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-14 20:20:41.812800: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-14 20:20:42.055778: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 2 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.57109 max: 145.24062 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 0.00010609626770019531 nb_pixel_total : 963 time to create 1 rle with old method : 0.0018508434295654297 length of segment : 43 time for calcul the mask position with numpy : 0.0005266666412353516 nb_pixel_total : 17481 time to create 1 rle with old method : 0.05400419235229492 length of segment : 186 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 34 time to create 1 rle with old method : 9.298324584960938e-05 length of segment : 14 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 18 time to create 1 rle with old method : 8.535385131835938e-05 length of segment : 1 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 80 time to create 1 rle with old method : 0.00012540817260742188 length of segment : 29 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 1752 time to create 1 rle with old method : 0.0024344921112060547 length of segment : 55 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.0001900196075439453 length of segment : 32 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.55938 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 9.560585021972656e-05 nb_pixel_total : 208 time to create 1 rle with old method : 0.0005364418029785156 length of segment : 16 time for calcul the mask position with numpy : 0.00010323524475097656 nb_pixel_total : 1164 time to create 1 rle with old method : 0.005932807922363281 length of segment : 31 time for calcul the mask position with numpy : 0.00020456314086914062 nb_pixel_total : 2205 time to create 1 rle with old method : 0.006784200668334961 length of segment : 45 time for calcul the mask position with numpy : 0.00015425682067871094 nb_pixel_total : 4774 time to create 1 rle with old method : 0.006250858306884766 length of segment : 168 time for calcul the mask position with numpy : 8.487701416015625e-05 nb_pixel_total : 456 time to create 1 rle with old method : 0.0006628036499023438 length of segment : 40 time for calcul the mask position with numpy : 0.00011658668518066406 nb_pixel_total : 1336 time to create 1 rle with old method : 0.001918792724609375 length of segment : 120 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 530 time to create 1 rle with old method : 0.0009613037109375 length of segment : 49 time for calcul the mask position with numpy : 0.00010418891906738281 nb_pixel_total : 42 time to create 1 rle with old method : 0.00022840499877929688 length of segment : 7 time for calcul the mask position with numpy : 0.00020694732666015625 nb_pixel_total : 1668 time to create 1 rle with old method : 0.0031557083129882812 length of segment : 65 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.0003421306610107422 length of segment : 24 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 483 time to create 1 rle with old method : 0.0006568431854248047 length of segment : 29 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -105.38750 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.00018072128295898438 nb_pixel_total : 5686 time to create 1 rle with old method : 0.010061979293823242 length of segment : 122 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 260 time to create 1 rle with old method : 0.0006024837493896484 length of segment : 11 time for calcul the mask position with numpy : 0.00012683868408203125 nb_pixel_total : 89 time to create 1 rle with old method : 0.0005834102630615234 length of segment : 28 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 541 time to create 1 rle with old method : 0.0007839202880859375 length of segment : 24 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 829 time to create 1 rle with old method : 0.0011670589447021484 length of segment : 40 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 480 time to create 1 rle with old method : 0.0010402202606201172 length of segment : 24 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -103.90000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 242 time to create 1 rle with old method : 0.00037288665771484375 length of segment : 17 time for calcul the mask position with numpy : 0.0001666545867919922 nb_pixel_total : 8594 time to create 1 rle with old method : 0.01285862922668457 length of segment : 135 time for calcul the mask position with numpy : 0.00011682510375976562 nb_pixel_total : 999 time to create 1 rle with old method : 0.0019681453704833984 length of segment : 50 time for calcul the mask position with numpy : 8.296966552734375e-05 nb_pixel_total : 462 time to create 1 rle with old method : 0.0008389949798583984 length of segment : 27 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 970 time to create 1 rle with old method : 0.001392364501953125 length of segment : 20 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 258 time to create 1 rle with old method : 0.00037097930908203125 length of segment : 54 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 412 time to create 1 rle with old method : 0.0007245540618896484 length of segment : 22 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 142.75625 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 427 time to create 1 rle with old method : 0.0006384849548339844 length of segment : 16 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 1382 time to create 1 rle with old method : 0.0017621517181396484 length of segment : 40 Processing 1 images image shape: (400, 400, 3) min: 6.00000 max: 212.00000 molded_images shape: (1, 640, 640, 3) min: -85.41094 max: 84.11406 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -96.55156 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 0.00011301040649414062 nb_pixel_total : 2607 time to create 1 rle with old method : 0.004889965057373047 length of segment : 47 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 167 time to create 1 rle with old method : 0.0003421306610107422 length of segment : 23 time for calcul the mask position with numpy : 0.00027298927307128906 nb_pixel_total : 11957 time to create 1 rle with old method : 0.020210981369018555 length of segment : 200 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 108 time to create 1 rle with old method : 0.00017786026000976562 length of segment : 13 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 1710 time to create 1 rle with old method : 0.002159595489501953 length of segment : 38 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 199 time to create 1 rle with old method : 0.00026869773864746094 length of segment : 20 time for calcul the mask position with numpy : 7.772445678710938e-05 nb_pixel_total : 2709 time to create 1 rle with old method : 0.003312826156616211 length of segment : 99 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 203 time to create 1 rle with old method : 0.0002932548522949219 length of segment : 21 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.39922 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 7.963180541992188e-05 nb_pixel_total : 770 time to create 1 rle with old method : 0.0014734268188476562 length of segment : 56 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 628 time to create 1 rle with old method : 0.0012638568878173828 length of segment : 21 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 90 time to create 1 rle with old method : 0.0002243518829345703 length of segment : 15 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 841 time to create 1 rle with old method : 0.001832723617553711 length of segment : 16 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 362 time to create 1 rle with old method : 0.0005497932434082031 length of segment : 19 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 469 time to create 1 rle with old method : 0.0007388591766357422 length of segment : 19 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 512 time to create 1 rle with old method : 0.0006918907165527344 length of segment : 26 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -109.73516 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 0.0005424022674560547 nb_pixel_total : 32920 time to create 1 rle with old method : 0.043457746505737305 length of segment : 360 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.0003161430358886719 length of segment : 15 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 871 time to create 1 rle with old method : 0.0013027191162109375 length of segment : 35 time for calcul the mask position with numpy : 0.00013494491577148438 nb_pixel_total : 713 time to create 1 rle with old method : 0.0010428428649902344 length of segment : 143 time for calcul the mask position with numpy : 8.416175842285156e-05 nb_pixel_total : 935 time to create 1 rle with old method : 0.0013124942779541016 length of segment : 26 time for calcul the mask position with numpy : 0.00024437904357910156 nb_pixel_total : 1535 time to create 1 rle with old method : 0.0023980140686035156 length of segment : 100 time for calcul the mask position with numpy : 0.00025200843811035156 nb_pixel_total : 8247 time to create 1 rle with old method : 0.010167837142944336 length of segment : 143 time for calcul the mask position with numpy : 0.00023889541625976562 nb_pixel_total : 5757 time to create 1 rle with old method : 0.007157564163208008 length of segment : 148 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 267 time to create 1 rle with old method : 0.00040984153747558594 length of segment : 31 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 956 time to create 1 rle with old method : 0.0013606548309326172 length of segment : 27 time for calcul the mask position with numpy : 0.00025463104248046875 nb_pixel_total : 4923 time to create 1 rle with old method : 0.00603175163269043 length of segment : 202 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 1312 time to create 1 rle with old method : 0.0016219615936279297 length of segment : 42 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 1441 time to create 1 rle with old method : 0.0018205642700195312 length of segment : 43 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 715 time to create 1 rle with old method : 0.0009253025054931641 length of segment : 35 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.40469 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 0.0001220703125 nb_pixel_total : 4874 time to create 1 rle with old method : 0.006501197814941406 length of segment : 279 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 1741 time to create 1 rle with old method : 0.0021839141845703125 length of segment : 58 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 1828 time to create 1 rle with old method : 0.002389192581176758 length of segment : 86 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 1632 time to create 1 rle with old method : 0.002160787582397461 length of segment : 37 time for calcul the mask position with numpy : 0.00026726722717285156 nb_pixel_total : 2674 time to create 1 rle with old method : 0.003999233245849609 length of segment : 156 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 1009 time to create 1 rle with old method : 0.0014033317565917969 length of segment : 57 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 628 time to create 1 rle with old method : 0.0008890628814697266 length of segment : 54 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 751 time to create 1 rle with old method : 0.0010421276092529297 length of segment : 51 time for calcul the mask position with numpy : 0.0002415180206298828 nb_pixel_total : 2817 time to create 1 rle with old method : 0.003573179244995117 length of segment : 144 time for calcul the mask position with numpy : 0.0002608299255371094 nb_pixel_total : 2668 time to create 1 rle with old method : 0.00397801399230957 length of segment : 143 Processing 1 images image shape: (280, 400, 3) min: 3.00000 max: 199.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 72.99297 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0010745525360107422 nb_pixel_total : 105834 time to create 1 rle with old method : 0.12957453727722168 length of segment : 282 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.57266 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 7.843971252441406e-05 nb_pixel_total : 871 time to create 1 rle with old method : 0.0014934539794921875 length of segment : 49 time for calcul the mask position with numpy : 8.988380432128906e-05 nb_pixel_total : 1950 time to create 1 rle with old method : 0.003801107406616211 length of segment : 60 time for calcul the mask position with numpy : 0.00010609626770019531 nb_pixel_total : 3474 time to create 1 rle with old method : 0.00472569465637207 length of segment : 58 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 403 time to create 1 rle with old method : 0.0007281303405761719 length of segment : 25 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 148 time to create 1 rle with old method : 0.00026035308837890625 length of segment : 18 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 563 time to create 1 rle with old method : 0.0008883476257324219 length of segment : 20 time for calcul the mask position with numpy : 9.918212890625e-05 nb_pixel_total : 1588 time to create 1 rle with old method : 0.002276897430419922 length of segment : 52 time for calcul the mask position with numpy : 9.226799011230469e-05 nb_pixel_total : 892 time to create 1 rle with old method : 0.0018661022186279297 length of segment : 25 time for calcul the mask position with numpy : 0.00010395050048828125 nb_pixel_total : 1765 time to create 1 rle with old method : 0.003818988800048828 length of segment : 82 time for calcul the mask position with numpy : 0.00010466575622558594 nb_pixel_total : 831 time to create 1 rle with old method : 0.0015995502471923828 length of segment : 66 time for calcul the mask position with numpy : 7.009506225585938e-05 nb_pixel_total : 994 time to create 1 rle with old method : 0.0019099712371826172 length of segment : 36 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 377 time to create 1 rle with old method : 0.0007083415985107422 length of segment : 22 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 219 time to create 1 rle with old method : 0.0004456043243408203 length of segment : 18 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.00024962425231933594 length of segment : 14 time for calcul the mask position with numpy : 8.821487426757812e-05 nb_pixel_total : 1867 time to create 1 rle with old method : 0.003597736358642578 length of segment : 76 time for calcul the mask position with numpy : 8.153915405273438e-05 nb_pixel_total : 558 time to create 1 rle with old method : 0.0012068748474121094 length of segment : 38 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 412 time to create 1 rle with old method : 0.0008752346038818359 length of segment : 20 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.06875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 42 time for calcul the mask position with numpy : 7.891654968261719e-05 nb_pixel_total : 356 time to create 1 rle with old method : 0.0005829334259033203 length of segment : 31 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 500 time to create 1 rle with old method : 0.0007622241973876953 length of segment : 39 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.00047135353088378906 length of segment : 16 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.0002715587615966797 length of segment : 12 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.0003910064697265625 length of segment : 16 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 434 time to create 1 rle with old method : 0.0006415843963623047 length of segment : 25 time for calcul the mask position with numpy : 7.939338684082031e-05 nb_pixel_total : 2116 time to create 1 rle with old method : 0.0029268264770507812 length of segment : 42 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.00046753883361816406 length of segment : 18 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 496 time to create 1 rle with old method : 0.0007853507995605469 length of segment : 32 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 133 time to create 1 rle with old method : 0.00021386146545410156 length of segment : 17 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 908 time to create 1 rle with old method : 0.0012712478637695312 length of segment : 51 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 205 time to create 1 rle with old method : 0.000331878662109375 length of segment : 27 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 169 time to create 1 rle with old method : 0.00032019615173339844 length of segment : 19 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 94 time to create 1 rle with old method : 0.00016021728515625 length of segment : 11 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 508 time to create 1 rle with old method : 0.0007200241088867188 length of segment : 28 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 385 time to create 1 rle with old method : 0.0006108283996582031 length of segment : 28 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.0002238750457763672 length of segment : 18 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 1686 time to create 1 rle with old method : 0.0023534297943115234 length of segment : 90 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.0003638267517089844 length of segment : 13 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 298 time to create 1 rle with old method : 0.0004248619079589844 length of segment : 28 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 368 time to create 1 rle with old method : 0.0005478858947753906 length of segment : 23 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 667 time to create 1 rle with old method : 0.0009388923645019531 length of segment : 30 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.00033092498779296875 length of segment : 19 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 621 time to create 1 rle with old method : 0.0010128021240234375 length of segment : 37 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 1161 time to create 1 rle with old method : 0.0015864372253417969 length of segment : 41 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 160 time to create 1 rle with old method : 0.0003421306610107422 length of segment : 15 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.0002162456512451172 length of segment : 13 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003712177276611328 length of segment : 20 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 83 time to create 1 rle with old method : 0.00015592575073242188 length of segment : 14 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 181 time to create 1 rle with old method : 0.000354766845703125 length of segment : 12 time for calcul the mask position with numpy : 8.559226989746094e-05 nb_pixel_total : 825 time to create 1 rle with old method : 0.0013766288757324219 length of segment : 59 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.00046706199645996094 length of segment : 19 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 826 time to create 1 rle with old method : 0.0012774467468261719 length of segment : 33 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 922 time to create 1 rle with old method : 0.0014679431915283203 length of segment : 36 time for calcul the mask position with numpy : 9.965896606445312e-05 nb_pixel_total : 1634 time to create 1 rle with old method : 0.0023293495178222656 length of segment : 59 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 512 time to create 1 rle with old method : 0.0007371902465820312 length of segment : 33 time for calcul the mask position with numpy : 7.748603820800781e-05 nb_pixel_total : 564 time to create 1 rle with old method : 0.0012922286987304688 length of segment : 27 time for calcul the mask position with numpy : 9.584426879882812e-05 nb_pixel_total : 1220 time to create 1 rle with old method : 0.002601146697998047 length of segment : 39 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.00035190582275390625 length of segment : 9 time for calcul the mask position with numpy : 0.00010704994201660156 nb_pixel_total : 702 time to create 1 rle with old method : 0.0012254714965820312 length of segment : 60 time for calcul the mask position with numpy : 8.0108642578125e-05 nb_pixel_total : 1574 time to create 1 rle with old method : 0.002304553985595703 length of segment : 58 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 509 time to create 1 rle with old method : 0.0007681846618652344 length of segment : 28 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.51406 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 1870 time to create 1 rle with old method : 0.0023217201232910156 length of segment : 66 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 148 time to create 1 rle with old method : 0.00023126602172851562 length of segment : 21 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 242 time to create 1 rle with old method : 0.00035881996154785156 length of segment : 20 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 67 time to create 1 rle with old method : 0.00015044212341308594 length of segment : 19 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 242 time to create 1 rle with old method : 0.0003674030303955078 length of segment : 26 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 912 time to create 1 rle with old method : 0.0012822151184082031 length of segment : 36 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 805 time to create 1 rle with old method : 0.0011394023895263672 length of segment : 33 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 91 time to create 1 rle with old method : 0.0001728534698486328 length of segment : 8 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 166 time to create 1 rle with old method : 0.00024080276489257812 length of segment : 23 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 133.91250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.00048732757568359375 nb_pixel_total : 31841 time to create 1 rle with old method : 0.038674116134643555 length of segment : 246 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 15 time to create 1 rle with old method : 5.650520324707031e-05 length of segment : 3 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.38359 max: 148.29922 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 8.869171142578125e-05 nb_pixel_total : 936 time to create 1 rle with old method : 0.0013585090637207031 length of segment : 42 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.00019812583923339844 length of segment : 33 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 222 time to create 1 rle with old method : 0.00040459632873535156 length of segment : 10 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 34 time to create 1 rle with old method : 7.224082946777344e-05 length of segment : 17 time for calcul the mask position with numpy : 0.0002956390380859375 nb_pixel_total : 8481 time to create 1 rle with old method : 0.010491132736206055 length of segment : 190 time for calcul the mask position with numpy : 0.00030684471130371094 nb_pixel_total : 7538 time to create 1 rle with old method : 0.010349512100219727 length of segment : 241 time for calcul the mask position with numpy : 0.00013637542724609375 nb_pixel_total : 1094 time to create 1 rle with old method : 0.0018639564514160156 length of segment : 68 length of segment : 0 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 96 time to create 1 rle with old method : 0.00019168853759765625 length of segment : 33 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 819 time to create 1 rle with old method : 0.0012621879577636719 length of segment : 32 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.30156 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 1660 time to create 1 rle with old method : 0.0025854110717773438 length of segment : 41 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 1100 time to create 1 rle with old method : 0.001539468765258789 length of segment : 38 time for calcul the mask position with numpy : 0.0001475811004638672 nb_pixel_total : 3424 time to create 1 rle with old method : 0.004679441452026367 length of segment : 134 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 669 time to create 1 rle with old method : 0.0011394023895263672 length of segment : 46 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 1379 time to create 1 rle with old method : 0.0019512176513671875 length of segment : 52 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 143 time to create 1 rle with old method : 0.00026726722717285156 length of segment : 13 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 876 time to create 1 rle with old method : 0.0012629032135009766 length of segment : 32 time for calcul the mask position with numpy : 9.918212890625e-05 nb_pixel_total : 2053 time to create 1 rle with old method : 0.003074169158935547 length of segment : 66 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.00026702880859375 length of segment : 12 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 536 time to create 1 rle with old method : 0.0008063316345214844 length of segment : 33 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 606 time to create 1 rle with old method : 0.0010273456573486328 length of segment : 42 time for calcul the mask position with numpy : 9.417533874511719e-05 nb_pixel_total : 1565 time to create 1 rle with old method : 0.002382516860961914 length of segment : 53 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 121 time to create 1 rle with old method : 0.0002307891845703125 length of segment : 20 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 301 time to create 1 rle with old method : 0.0005176067352294922 length of segment : 25 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 991 time to create 1 rle with old method : 0.0013072490692138672 length of segment : 44 time for calcul the mask position with numpy : 0.00010466575622558594 nb_pixel_total : 1820 time to create 1 rle with old method : 0.002633333206176758 length of segment : 73 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -106.84063 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 0.00010013580322265625 nb_pixel_total : 5811 time to create 1 rle with old method : 0.007299900054931641 length of segment : 118 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 1523 time to create 1 rle with old method : 0.0021402835845947266 length of segment : 24 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 836 time to create 1 rle with old method : 0.001247406005859375 length of segment : 34 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 264 time to create 1 rle with old method : 0.00046181678771972656 length of segment : 13 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 559 time to create 1 rle with old method : 0.0007889270782470703 length of segment : 22 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 606 time to create 1 rle with old method : 0.0008676052093505859 length of segment : 23 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -103.90000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.00039768218994140625 length of segment : 18 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 916 time to create 1 rle with old method : 0.0012655258178710938 length of segment : 56 time for calcul the mask position with numpy : 0.00020623207092285156 nb_pixel_total : 8845 time to create 1 rle with old method : 0.011479616165161133 length of segment : 132 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 444 time to create 1 rle with old method : 0.0006811618804931641 length of segment : 26 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 205 time to create 1 rle with old method : 0.0002779960632324219 length of segment : 16 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 718 time to create 1 rle with old method : 0.0009126663208007812 length of segment : 59 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 466 time to create 1 rle with old method : 0.0007886886596679688 length of segment : 25 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.55703 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 7.390975952148438e-05 nb_pixel_total : 879 time to create 1 rle with old method : 0.0011444091796875 length of segment : 134 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 342 time to create 1 rle with old method : 0.0005197525024414062 length of segment : 16 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 436 time to create 1 rle with old method : 0.0006139278411865234 length of segment : 29 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 860 time to create 1 rle with old method : 0.001142740249633789 length of segment : 49 time for calcul the mask position with numpy : 0.00011658668518066406 nb_pixel_total : 6406 time to create 1 rle with old method : 0.008167743682861328 length of segment : 63 Processing 1 images image shape: (400, 400, 3) min: 10.00000 max: 213.00000 molded_images shape: (1, 640, 640, 3) min: -82.87188 max: 78.14141 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -103.38750 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 7.557868957519531e-05 nb_pixel_total : 3030 time to create 1 rle with old method : 0.003866434097290039 length of segment : 51 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 175 time to create 1 rle with old method : 0.00024580955505371094 length of segment : 23 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 1425 time to create 1 rle with old method : 0.0019974708557128906 length of segment : 35 time for calcul the mask position with numpy : 0.0001842975616455078 nb_pixel_total : 7102 time to create 1 rle with old method : 0.008888483047485352 length of segment : 115 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.27422 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 1201 time to create 1 rle with old method : 0.001501321792602539 length of segment : 52 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 1092 time to create 1 rle with old method : 0.0016179084777832031 length of segment : 19 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 563 time to create 1 rle with old method : 0.0007812976837158203 length of segment : 18 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 585 time to create 1 rle with old method : 0.0008165836334228516 length of segment : 25 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 363 time to create 1 rle with old method : 0.0005500316619873047 length of segment : 19 time for calcul the mask position with numpy : 7.557868957519531e-05 nb_pixel_total : 728 time to create 1 rle with old method : 0.0009551048278808594 length of segment : 31 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 616 time to create 1 rle with old method : 0.0008542537689208984 length of segment : 27 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.03203 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 0.0005030632019042969 nb_pixel_total : 32511 time to create 1 rle with old method : 0.038281917572021484 length of segment : 235 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 856 time to create 1 rle with old method : 0.0012516975402832031 length of segment : 37 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.0003094673156738281 length of segment : 16 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 171 time to create 1 rle with old method : 0.00038242340087890625 length of segment : 18 time for calcul the mask position with numpy : 9.489059448242188e-05 nb_pixel_total : 742 time to create 1 rle with old method : 0.0010585784912109375 length of segment : 137 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 848 time to create 1 rle with old method : 0.0017800331115722656 length of segment : 26 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 1351 time to create 1 rle with old method : 0.00244903564453125 length of segment : 42 time for calcul the mask position with numpy : 0.0002307891845703125 nb_pixel_total : 8415 time to create 1 rle with old method : 0.016284465789794922 length of segment : 173 time for calcul the mask position with numpy : 9.179115295410156e-05 nb_pixel_total : 731 time to create 1 rle with old method : 0.0015115737915039062 length of segment : 35 time for calcul the mask position with numpy : 0.00017118453979492188 nb_pixel_total : 5551 time to create 1 rle with old method : 0.0068666934967041016 length of segment : 141 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 143.85391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 7.414817810058594e-05 nb_pixel_total : 430 time to create 1 rle with old method : 0.0006525516510009766 length of segment : 49 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 1236 time to create 1 rle with old method : 0.0015103816986083984 length of segment : 48 time for calcul the mask position with numpy : 0.00021648406982421875 nb_pixel_total : 2775 time to create 1 rle with old method : 0.003591299057006836 length of segment : 174 time for calcul the mask position with numpy : 9.179115295410156e-05 nb_pixel_total : 578 time to create 1 rle with old method : 0.0008108615875244141 length of segment : 38 time for calcul the mask position with numpy : 0.0004868507385253906 nb_pixel_total : 25487 time to create 1 rle with old method : 0.03215765953063965 length of segment : 383 Processing 1 images image shape: (280, 400, 3) min: 8.00000 max: 210.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 77.47344 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009152889251708984 nb_pixel_total : 106692 time to create 1 rle with old method : 0.13591790199279785 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.25625 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 8.249282836914062e-05 nb_pixel_total : 3494 time to create 1 rle with old method : 0.004792213439941406 length of segment : 60 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 865 time to create 1 rle with old method : 0.001140594482421875 length of segment : 50 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 2072 time to create 1 rle with old method : 0.0027077198028564453 length of segment : 74 time for calcul the mask position with numpy : 9.34600830078125e-05 nb_pixel_total : 1648 time to create 1 rle with old method : 0.002232074737548828 length of segment : 85 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 954 time to create 1 rle with old method : 0.001234292984008789 length of segment : 34 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 387 time to create 1 rle with old method : 0.0006835460662841797 length of segment : 25 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 875 time to create 1 rle with old method : 0.001153707504272461 length of segment : 58 time for calcul the mask position with numpy : 8.416175842285156e-05 nb_pixel_total : 1491 time to create 1 rle with old method : 0.0020759105682373047 length of segment : 48 time for calcul the mask position with numpy : 8.869171142578125e-05 nb_pixel_total : 1481 time to create 1 rle with old method : 0.0019488334655761719 length of segment : 58 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 1776 time to create 1 rle with old method : 0.0023720264434814453 length of segment : 81 time for calcul the mask position with numpy : 0.00023174285888671875 nb_pixel_total : 12912 time to create 1 rle with old method : 0.015238523483276367 length of segment : 181 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 210 time to create 1 rle with old method : 0.0002872943878173828 length of segment : 17 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.06875 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 36 time for calcul the mask position with numpy : 0.00010418891906738281 nb_pixel_total : 511 time to create 1 rle with old method : 0.0010602474212646484 length of segment : 37 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 342 time to create 1 rle with old method : 0.0006928443908691406 length of segment : 32 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 403 time to create 1 rle with old method : 0.0008718967437744141 length of segment : 24 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 2016 time to create 1 rle with old method : 0.0026519298553466797 length of segment : 42 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 1012 time to create 1 rle with old method : 0.0013682842254638672 length of segment : 55 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 161 time to create 1 rle with old method : 0.0002560615539550781 length of segment : 18 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 290 time to create 1 rle with old method : 0.0004334449768066406 length of segment : 17 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 471 time to create 1 rle with old method : 0.0006384849548339844 length of segment : 26 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 258 time to create 1 rle with old method : 0.00036835670471191406 length of segment : 16 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 343 time to create 1 rle with old method : 0.0005376338958740234 length of segment : 20 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.0003266334533691406 length of segment : 18 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003705024719238281 length of segment : 17 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 508 time to create 1 rle with old method : 0.0007090568542480469 length of segment : 29 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 139 time to create 1 rle with old method : 0.0002474784851074219 length of segment : 12 time for calcul the mask position with numpy : 7.2479248046875e-05 nb_pixel_total : 1805 time to create 1 rle with old method : 0.002299785614013672 length of segment : 82 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 1134 time to create 1 rle with old method : 0.001520395278930664 length of segment : 43 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 320 time to create 1 rle with old method : 0.0004532337188720703 length of segment : 33 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 503 time to create 1 rle with old method : 0.0006840229034423828 length of segment : 27 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 1146 time to create 1 rle with old method : 0.001505136489868164 length of segment : 38 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 455 time to create 1 rle with old method : 0.0006368160247802734 length of segment : 25 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 678 time to create 1 rle with old method : 0.0009152889251708984 length of segment : 29 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 180 time to create 1 rle with old method : 0.0002646446228027344 length of segment : 19 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 1654 time to create 1 rle with old method : 0.0021131038665771484 length of segment : 57 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 477 time to create 1 rle with old method : 0.0006785392761230469 length of segment : 32 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 762 time to create 1 rle with old method : 0.0010485649108886719 length of segment : 32 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 94 time to create 1 rle with old method : 0.00021147727966308594 length of segment : 13 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.0004451274871826172 length of segment : 23 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 104 time to create 1 rle with old method : 0.00016379356384277344 length of segment : 13 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 495 time to create 1 rle with old method : 0.0007033348083496094 length of segment : 43 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 297 time to create 1 rle with old method : 0.000423431396484375 length of segment : 26 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 964 time to create 1 rle with old method : 0.0012638568878173828 length of segment : 37 time for calcul the mask position with numpy : 8.606910705566406e-05 nb_pixel_total : 1235 time to create 1 rle with old method : 0.0016121864318847656 length of segment : 65 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 116 time to create 1 rle with old method : 0.00019860267639160156 length of segment : 14 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 698 time to create 1 rle with old method : 0.000843048095703125 length of segment : 27 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 422 time to create 1 rle with old method : 0.000537872314453125 length of segment : 28 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 1624 time to create 1 rle with old method : 0.0020799636840820312 length of segment : 70 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.98672 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 599 time to create 1 rle with old method : 0.0008749961853027344 length of segment : 48 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 139 time to create 1 rle with old method : 0.0002295970916748047 length of segment : 9 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 867 time to create 1 rle with old method : 0.0012140274047851562 length of segment : 34 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 139 time to create 1 rle with old method : 0.00020885467529296875 length of segment : 21 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 274 time to create 1 rle with old method : 0.00038743019104003906 length of segment : 23 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 721 time to create 1 rle with old method : 0.0009446144104003906 length of segment : 34 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.00024199485778808594 length of segment : 24 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 137 time to create 1 rle with old method : 0.00019741058349609375 length of segment : 24 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 277 time to create 1 rle with old method : 0.0005517005920410156 length of segment : 23 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 134.60000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 15 time to create 1 rle with old method : 0.0001704692840576172 length of segment : 3 time for calcul the mask position with numpy : 0.0007669925689697266 nb_pixel_total : 33413 time to create 1 rle with old method : 0.05613112449645996 length of segment : 283 Detection mask done ! Trying to reset tf kernel 2134258 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 196 tf kernel not reseted sub process len(results) : 273 len(list_Values) 273 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 273 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5485 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 273 chid ids of type : 4228 Number RLEs to save : 14269 save missing photos in datou_result : time spend for datou_step_exec : 28.12905192375183 time spend to save output : 6.466965436935425 total time spend for step 1 : 34.596017360687256 step2:brightness Fri Feb 14 20:21:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1739560828_2133718_1337679446_0d9e4ab12736ab718dbb4a3c927461b5.jpg treat image : temp/1739560828_2133718_1337679263_f809f08edb7aecfda35bffa13355f0ed.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.012035846710205078 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.011250734329223633 save missing photos in datou_result : time spend for datou_step_exec : 0.5704944133758545 time spend to save output : 0.027379274368286133 total time spend for step 2 : 0.5978736877441406 step3:blur_detection Fri Feb 14 20:21:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1739560828_2133718_1337679446_0d9e4ab12736ab718dbb4a3c927461b5.jpg resize: (1080, 1920) 1337679446 -7.644287577401136 treat image : temp/1739560828_2133718_1337679263_f809f08edb7aecfda35bffa13355f0ed.jpg resize: (1080, 1920) 1337679263 -7.612192803036224 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 2 time used for this insertion : 0.16710352897644043 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 2 time used for this insertion : 0.01407313346862793 save missing photos in datou_result : time spend for datou_step_exec : 2.3774569034576416 time spend to save output : 0.18571877479553223 total time spend for step 3 : 2.563175678253174 step4:rle_unique_nms_with_priority Fri Feb 14 20:21:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 273 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 143 nb_hashtags : 8 time to prepare the origin masks : 1.1427748203277588 time for calcul the mask position with numpy : 0.06328749656677246 nb_pixel_total : 1756797 time to create 1 rle with new method : 0.24072027206420898 time for calcul the mask position with numpy : 0.008208036422729492 nb_pixel_total : 829 time to create 1 rle with old method : 0.0010099411010742188 time for calcul the mask position with numpy : 0.008177757263183594 nb_pixel_total : 89 time to create 1 rle with old method : 0.00018334388732910156 time for calcul the mask position with numpy : 0.008190631866455078 nb_pixel_total : 963 time to create 1 rle with old method : 0.0012011528015136719 time for calcul the mask position with numpy : 0.008075475692749023 nb_pixel_total : 34 time to create 1 rle with old method : 4.6253204345703125e-05 time for calcul the mask position with numpy : 0.008213520050048828 nb_pixel_total : 80 time to create 1 rle with old method : 0.00010275840759277344 time for calcul the mask position with numpy : 0.008078575134277344 nb_pixel_total : 530 time to create 1 rle with old method : 0.0006656646728515625 time for calcul the mask position with numpy : 0.008316278457641602 nb_pixel_total : 1752 time to create 1 rle with old method : 0.002037525177001953 time for calcul the mask position with numpy : 0.008147478103637695 nb_pixel_total : 1164 time to create 1 rle with old method : 0.0013535022735595703 time for calcul the mask position with numpy : 0.00788736343383789 nb_pixel_total : 33 time to create 1 rle with old method : 5.7697296142578125e-05 time for calcul the mask position with numpy : 0.007787466049194336 nb_pixel_total : 26 time to create 1 rle with old method : 4.220008850097656e-05 time for calcul the mask position with numpy : 0.007871150970458984 nb_pixel_total : 27 time to create 1 rle with old method : 4.1961669921875e-05 time for calcul the mask position with numpy : 0.008298635482788086 nb_pixel_total : 18 time to create 1 rle with old method : 2.9087066650390625e-05 time for calcul the mask position with numpy : 0.008205175399780273 nb_pixel_total : 2205 time to create 1 rle with old method : 0.002668619155883789 time for calcul the mask position with numpy : 0.008270025253295898 nb_pixel_total : 42 time to create 1 rle with old method : 5.14984130859375e-05 time for calcul the mask position with numpy : 0.00812673568725586 nb_pixel_total : 208 time to create 1 rle with old method : 0.0002410411834716797 time for calcul the mask position with numpy : 0.00812673568725586 nb_pixel_total : 17481 time to create 1 rle with old method : 0.02007126808166504 time for calcul the mask position with numpy : 0.008253812789916992 nb_pixel_total : 480 time to create 1 rle with old method : 0.0006055831909179688 time for calcul the mask position with numpy : 0.008196353912353516 nb_pixel_total : 991 time to create 1 rle with old method : 0.0011920928955078125 time for calcul the mask position with numpy : 0.008387327194213867 nb_pixel_total : 258 time to create 1 rle with old method : 0.0002770423889160156 time for calcul the mask position with numpy : 0.008103609085083008 nb_pixel_total : 242 time to create 1 rle with old method : 0.0002989768981933594 time for calcul the mask position with numpy : 0.008090019226074219 nb_pixel_total : 483 time to create 1 rle with old method : 0.0005834102630615234 time for calcul the mask position with numpy : 0.008331775665283203 nb_pixel_total : 260 time to create 1 rle with old method : 0.000301361083984375 time for calcul the mask position with numpy : 0.008026838302612305 nb_pixel_total : 541 time to create 1 rle with old method : 0.0006155967712402344 time for calcul the mask position with numpy : 0.008022785186767578 nb_pixel_total : 462 time to create 1 rle with old method : 0.0005970001220703125 time for calcul the mask position with numpy : 0.008293390274047852 nb_pixel_total : 36 time to create 1 rle with old method : 9.441375732421875e-05 time for calcul the mask position with numpy : 0.008366107940673828 nb_pixel_total : 163 time to create 1 rle with old method : 0.0002529621124267578 time for calcul the mask position with numpy : 0.008378744125366211 nb_pixel_total : 4774 time to create 1 rle with old method : 0.005738735198974609 time for calcul the mask position with numpy : 0.008353948593139648 nb_pixel_total : 987 time to create 1 rle with old method : 0.0012655258178710938 time for calcul the mask position with numpy : 0.008171558380126953 nb_pixel_total : 5686 time to create 1 rle with old method : 0.0067179203033447266 time for calcul the mask position with numpy : 0.00831294059753418 nb_pixel_total : 8594 time to create 1 rle with old method : 0.010203123092651367 time for calcul the mask position with numpy : 0.008295774459838867 nb_pixel_total : 1382 time to create 1 rle with old method : 0.0016400814056396484 time for calcul the mask position with numpy : 0.008337259292602539 nb_pixel_total : 427 time to create 1 rle with old method : 0.0005240440368652344 time for calcul the mask position with numpy : 0.008275508880615234 nb_pixel_total : 970 time to create 1 rle with old method : 0.0011029243469238281 time for calcul the mask position with numpy : 0.008166790008544922 nb_pixel_total : 8247 time to create 1 rle with old method : 0.009428977966308594 time for calcul the mask position with numpy : 0.008103370666503906 nb_pixel_total : 469 time to create 1 rle with old method : 0.0005729198455810547 time for calcul the mask position with numpy : 0.007947921752929688 nb_pixel_total : 3482 time to create 1 rle with old method : 0.00412440299987793 time for calcul the mask position with numpy : 0.007954835891723633 nb_pixel_total : 1535 time to create 1 rle with old method : 0.0018939971923828125 time for calcul the mask position with numpy : 0.007979154586791992 nb_pixel_total : 715 time to create 1 rle with old method : 0.0007898807525634766 time for calcul the mask position with numpy : 0.00824117660522461 nb_pixel_total : 1 time to create 1 rle with old method : 8.344650268554688e-06 time for calcul the mask position with numpy : 0.008196115493774414 nb_pixel_total : 841 time to create 1 rle with old method : 0.0009603500366210938 time for calcul the mask position with numpy : 0.008080720901489258 nb_pixel_total : 129 time to create 1 rle with old method : 0.000164031982421875 time for calcul the mask position with numpy : 0.008149385452270508 nb_pixel_total : 1312 time to create 1 rle with old method : 0.0015683174133300781 time for calcul the mask position with numpy : 0.008249521255493164 nb_pixel_total : 32920 time to create 1 rle with old method : 0.05337929725646973 time for calcul the mask position with numpy : 0.009641885757446289 nb_pixel_total : 267 time to create 1 rle with old method : 0.0005221366882324219 time for calcul the mask position with numpy : 0.009651899337768555 nb_pixel_total : 1632 time to create 1 rle with old method : 0.0027489662170410156 time for calcul the mask position with numpy : 0.009618520736694336 nb_pixel_total : 11957 time to create 1 rle with old method : 0.015256643295288086 time for calcul the mask position with numpy : 0.008131265640258789 nb_pixel_total : 41 time to create 1 rle with old method : 8.20159912109375e-05 time for calcul the mask position with numpy : 0.008175849914550781 nb_pixel_total : 1009 time to create 1 rle with old method : 0.0012478828430175781 time for calcul the mask position with numpy : 0.008066177368164062 nb_pixel_total : 2674 time to create 1 rle with old method : 0.0030591487884521484 time for calcul the mask position with numpy : 0.008089542388916016 nb_pixel_total : 628 time to create 1 rle with old method : 0.0007319450378417969 time for calcul the mask position with numpy : 0.008214235305786133 nb_pixel_total : 211 time to create 1 rle with old method : 0.0002684593200683594 time for calcul the mask position with numpy : 0.008017301559448242 nb_pixel_total : 713 time to create 1 rle with old method : 0.0009281635284423828 time for calcul the mask position with numpy : 0.008141040802001953 nb_pixel_total : 121 time to create 1 rle with old method : 0.0001983642578125 time for calcul the mask position with numpy : 0.007943868637084961 nb_pixel_total : 4874 time to create 1 rle with old method : 0.005388975143432617 time for calcul the mask position with numpy : 0.00795292854309082 nb_pixel_total : 770 time to create 1 rle with old method : 0.0009407997131347656 time for calcul the mask position with numpy : 0.008117437362670898 nb_pixel_total : 289 time to create 1 rle with old method : 0.0003695487976074219 time for calcul the mask position with numpy : 0.008047103881835938 nb_pixel_total : 1741 time to create 1 rle with old method : 0.001918792724609375 time for calcul the mask position with numpy : 0.008309364318847656 nb_pixel_total : 90 time to create 1 rle with old method : 0.00011897087097167969 time for calcul the mask position with numpy : 0.008059024810791016 nb_pixel_total : 9 time to create 1 rle with old method : 2.5272369384765625e-05 time for calcul the mask position with numpy : 0.008425474166870117 nb_pixel_total : 362 time to create 1 rle with old method : 0.0004239082336425781 time for calcul the mask position with numpy : 0.008139848709106445 nb_pixel_total : 199 time to create 1 rle with old method : 0.00021958351135253906 time for calcul the mask position with numpy : 0.008300065994262695 nb_pixel_total : 2607 time to create 1 rle with old method : 0.003164529800415039 time for calcul the mask position with numpy : 0.008222103118896484 nb_pixel_total : 380 time to create 1 rle with old method : 0.0004956722259521484 time for calcul the mask position with numpy : 0.00815129280090332 nb_pixel_total : 2709 time to create 1 rle with old method : 0.0031392574310302734 time for calcul the mask position with numpy : 0.008409500122070312 nb_pixel_total : 1828 time to create 1 rle with old method : 0.0021386146545410156 time for calcul the mask position with numpy : 0.008346319198608398 nb_pixel_total : 628 time to create 1 rle with old method : 0.0007619857788085938 time for calcul the mask position with numpy : 0.008305549621582031 nb_pixel_total : 108 time to create 1 rle with old method : 0.00013971328735351562 time for calcul the mask position with numpy : 0.0082244873046875 nb_pixel_total : 1710 time to create 1 rle with old method : 0.001954793930053711 time for calcul the mask position with numpy : 0.008280515670776367 nb_pixel_total : 935 time to create 1 rle with old method : 0.0010726451873779297 time for calcul the mask position with numpy : 0.007972478866577148 nb_pixel_total : 45 time to create 1 rle with old method : 0.00011301040649414062 time for calcul the mask position with numpy : 0.0080108642578125 nb_pixel_total : 512 time to create 1 rle with old method : 0.0005712509155273438 time for calcul the mask position with numpy : 0.008145332336425781 nb_pixel_total : 167 time to create 1 rle with old method : 0.00020265579223632812 time for calcul the mask position with numpy : 0.008789539337158203 nb_pixel_total : 105834 time to create 1 rle with old method : 0.12246465682983398 time for calcul the mask position with numpy : 0.008322715759277344 nb_pixel_total : 190 time to create 1 rle with old method : 0.0002589225769042969 time for calcul the mask position with numpy : 0.008098602294921875 nb_pixel_total : 3474 time to create 1 rle with old method : 0.004216432571411133 time for calcul the mask position with numpy : 0.008177995681762695 nb_pixel_total : 558 time to create 1 rle with old method : 0.0008175373077392578 time for calcul the mask position with numpy : 0.009640693664550781 nb_pixel_total : 31841 time to create 1 rle with old method : 0.042577505111694336 time for calcul the mask position with numpy : 0.009449958801269531 nb_pixel_total : 994 time to create 1 rle with old method : 0.001219034194946289 time for calcul the mask position with numpy : 0.008012771606445312 nb_pixel_total : 288 time to create 1 rle with old method : 0.0003807544708251953 time for calcul the mask position with numpy : 0.008094072341918945 nb_pixel_total : 667 time to create 1 rle with old method : 0.0008261203765869141 time for calcul the mask position with numpy : 0.00836944580078125 nb_pixel_total : 563 time to create 1 rle with old method : 0.0007104873657226562 time for calcul the mask position with numpy : 0.008359432220458984 nb_pixel_total : 403 time to create 1 rle with old method : 0.0004968643188476562 time for calcul the mask position with numpy : 0.008220672607421875 nb_pixel_total : 412 time to create 1 rle with old method : 0.0005280971527099609 time for calcul the mask position with numpy : 0.008182287216186523 nb_pixel_total : 226 time to create 1 rle with old method : 0.0003154277801513672 time for calcul the mask position with numpy : 0.008365631103515625 nb_pixel_total : 254 time to create 1 rle with old method : 0.00032019615173339844 time for calcul the mask position with numpy : 0.008176326751708984 nb_pixel_total : 871 time to create 1 rle with old method : 0.0009882450103759766 time for calcul the mask position with numpy : 0.007992982864379883 nb_pixel_total : 1950 time to create 1 rle with old method : 0.002333402633666992 time for calcul the mask position with numpy : 0.008109092712402344 nb_pixel_total : 1634 time to create 1 rle with old method : 0.0019567012786865234 time for calcul the mask position with numpy : 0.008043766021728516 nb_pixel_total : 33 time to create 1 rle with old method : 4.935264587402344e-05 time for calcul the mask position with numpy : 0.008179187774658203 nb_pixel_total : 273 time to create 1 rle with old method : 0.00032210350036621094 time for calcul the mask position with numpy : 0.008050203323364258 nb_pixel_total : 826 time to create 1 rle with old method : 0.0009343624114990234 time for calcul the mask position with numpy : 0.008279561996459961 nb_pixel_total : 169 time to create 1 rle with old method : 0.0002186298370361328 time for calcul the mask position with numpy : 0.008116960525512695 nb_pixel_total : 730 time to create 1 rle with old method : 0.0008373260498046875 time for calcul the mask position with numpy : 0.007987022399902344 nb_pixel_total : 500 time to create 1 rle with old method : 0.0005462169647216797 time for calcul the mask position with numpy : 0.008295297622680664 nb_pixel_total : 67 time to create 1 rle with old method : 8.726119995117188e-05 time for calcul the mask position with numpy : 0.007971525192260742 nb_pixel_total : 294 time to create 1 rle with old method : 0.0004303455352783203 time for calcul the mask position with numpy : 0.007949113845825195 nb_pixel_total : 1588 time to create 1 rle with old method : 0.0018966197967529297 time for calcul the mask position with numpy : 0.008033990859985352 nb_pixel_total : 1765 time to create 1 rle with old method : 0.0021872520446777344 time for calcul the mask position with numpy : 0.008156776428222656 nb_pixel_total : 112 time to create 1 rle with old method : 0.00015687942504882812 time for calcul the mask position with numpy : 0.00810551643371582 nb_pixel_total : 164 time to create 1 rle with old method : 0.0002524852752685547 time for calcul the mask position with numpy : 0.008121013641357422 nb_pixel_total : 83 time to create 1 rle with old method : 0.00015044212341308594 time for calcul the mask position with numpy : 0.008336305618286133 nb_pixel_total : 821 time to create 1 rle with old method : 0.0010237693786621094 time for calcul the mask position with numpy : 0.008205652236938477 nb_pixel_total : 219 time to create 1 rle with old method : 0.0002522468566894531 time for calcul the mask position with numpy : 0.008259057998657227 nb_pixel_total : 242 time to create 1 rle with old method : 0.00029730796813964844 time for calcul the mask position with numpy : 0.008274078369140625 nb_pixel_total : 148 time to create 1 rle with old method : 0.00019121170043945312 time for calcul the mask position with numpy : 0.00826120376586914 nb_pixel_total : 298 time to create 1 rle with old method : 0.0003948211669921875 time for calcul the mask position with numpy : 0.008047342300415039 nb_pixel_total : 356 time to create 1 rle with old method : 0.00044465065002441406 time for calcul the mask position with numpy : 0.008129358291625977 nb_pixel_total : 160 time to create 1 rle with old method : 0.0002067089080810547 time for calcul the mask position with numpy : 0.008111000061035156 nb_pixel_total : 242 time to create 1 rle with old method : 0.0002837181091308594 time for calcul the mask position with numpy : 0.007974386215209961 nb_pixel_total : 831 time to create 1 rle with old method : 0.0010209083557128906 time for calcul the mask position with numpy : 0.008342742919921875 nb_pixel_total : 7 time to create 1 rle with old method : 2.2649765014648438e-05 time for calcul the mask position with numpy : 0.008312702178955078 nb_pixel_total : 564 time to create 1 rle with old method : 0.0006971359252929688 time for calcul the mask position with numpy : 0.008356809616088867 nb_pixel_total : 148 time to create 1 rle with old method : 0.00019216537475585938 time for calcul the mask position with numpy : 0.008358240127563477 nb_pixel_total : 94 time to create 1 rle with old method : 0.00012373924255371094 time for calcul the mask position with numpy : 0.008201837539672852 nb_pixel_total : 1686 time to create 1 rle with old method : 0.001924276351928711 time for calcul the mask position with numpy : 0.008230924606323242 nb_pixel_total : 512 time to create 1 rle with old method : 0.00061798095703125 time for calcul the mask position with numpy : 0.008198738098144531 nb_pixel_total : 368 time to create 1 rle with old method : 0.0004470348358154297 time for calcul the mask position with numpy : 0.008211135864257812 nb_pixel_total : 621 time to create 1 rle with old method : 0.0007684230804443359 time for calcul the mask position with numpy : 0.008406639099121094 nb_pixel_total : 15 time to create 1 rle with old method : 3.2901763916015625e-05 time for calcul the mask position with numpy : 0.008469104766845703 nb_pixel_total : 1870 time to create 1 rle with old method : 0.002323150634765625 time for calcul the mask position with numpy : 0.008549213409423828 nb_pixel_total : 114 time to create 1 rle with old method : 0.0001785755157470703 time for calcul the mask position with numpy : 0.00862884521484375 nb_pixel_total : 275 time to create 1 rle with old method : 0.0005087852478027344 time for calcul the mask position with numpy : 0.008551836013793945 nb_pixel_total : 14 time to create 1 rle with old method : 6.532669067382812e-05 time for calcul the mask position with numpy : 0.008618593215942383 nb_pixel_total : 508 time to create 1 rle with old method : 0.0006635189056396484 time for calcul the mask position with numpy : 0.00855565071105957 nb_pixel_total : 29 time to create 1 rle with old method : 8.416175842285156e-05 time for calcul the mask position with numpy : 0.008563756942749023 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003342628479003906 time for calcul the mask position with numpy : 0.008556127548217773 nb_pixel_total : 496 time to create 1 rle with old method : 0.0006356239318847656 time for calcul the mask position with numpy : 0.008575677871704102 nb_pixel_total : 886 time to create 1 rle with old method : 0.001111745834350586 time for calcul the mask position with numpy : 0.008540153503417969 nb_pixel_total : 114 time to create 1 rle with old method : 0.00018548965454101562 time for calcul the mask position with numpy : 0.008548736572265625 nb_pixel_total : 912 time to create 1 rle with old method : 0.0011434555053710938 time for calcul the mask position with numpy : 0.00853729248046875 nb_pixel_total : 377 time to create 1 rle with old method : 0.00048351287841796875 time for calcul the mask position with numpy : 0.008452653884887695 nb_pixel_total : 1161 time to create 1 rle with old method : 0.0015230178833007812 time for calcul the mask position with numpy : 0.008704900741577148 nb_pixel_total : 133 time to create 1 rle with old method : 0.00018405914306640625 time for calcul the mask position with numpy : 0.008549213409423828 nb_pixel_total : 205 time to create 1 rle with old method : 0.0002732276916503906 time for calcul the mask position with numpy : 0.008561849594116211 nb_pixel_total : 434 time to create 1 rle with old method : 0.0005462169647216797 time for calcul the mask position with numpy : 0.00888824462890625 nb_pixel_total : 2116 time to create 1 rle with old method : 0.0026845932006835938 time for calcul the mask position with numpy : 0.008733749389648438 nb_pixel_total : 805 time to create 1 rle with old method : 0.0014677047729492188 time for calcul the mask position with numpy : 0.010555744171142578 nb_pixel_total : 94 time to create 1 rle with old method : 0.0002319812774658203 time for calcul the mask position with numpy : 0.009023904800415039 nb_pixel_total : 385 time to create 1 rle with old method : 0.0005214214324951172 time for calcul the mask position with numpy : 0.008975744247436523 nb_pixel_total : 182 time to create 1 rle with old method : 0.0002288818359375 time for calcul the mask position with numpy : 0.008776664733886719 nb_pixel_total : 159 time to create 1 rle with old method : 0.0002193450927734375 time for calcul the mask position with numpy : 0.008995294570922852 nb_pixel_total : 91 time to create 1 rle with old method : 0.00012993812561035156 time for calcul the mask position with numpy : 0.008550405502319336 nb_pixel_total : 16 time to create 1 rle with old method : 4.076957702636719e-05 create new chi : 1.9037261009216309 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.006483316421508789 batch 1 Loaded 144 chid ids of type : 4230 Number RLEs to save : 13999 TO DO : save crop sub photo not yet done ! save time : 0.9831428527832031 nb_obj : 129 nb_hashtags : 8 time to prepare the origin masks : 2.390693187713623 time for calcul the mask position with numpy : 0.03256082534790039 nb_pixel_total : 1740158 time to create 1 rle with new method : 0.07810735702514648 time for calcul the mask position with numpy : 0.01160883903503418 nb_pixel_total : 2053 time to create 1 rle with old method : 0.0025398731231689453 time for calcul the mask position with numpy : 0.006006717681884766 nb_pixel_total : 836 time to create 1 rle with old method : 0.0010023117065429688 time for calcul the mask position with numpy : 0.005986690521240234 nb_pixel_total : 879 time to create 1 rle with old method : 0.0010373592376708984 time for calcul the mask position with numpy : 0.005932807922363281 nb_pixel_total : 1100 time to create 1 rle with old method : 0.0013468265533447266 time for calcul the mask position with numpy : 0.00600123405456543 nb_pixel_total : 106 time to create 1 rle with old method : 0.00020742416381835938 time for calcul the mask position with numpy : 0.006060600280761719 nb_pixel_total : 936 time to create 1 rle with old method : 0.0011556148529052734 time for calcul the mask position with numpy : 0.006013154983520508 nb_pixel_total : 34 time to create 1 rle with old method : 6.031990051269531e-05 time for calcul the mask position with numpy : 0.01063990592956543 nb_pixel_total : 1094 time to create 1 rle with old method : 0.0013256072998046875 time for calcul the mask position with numpy : 0.009999990463256836 nb_pixel_total : 121 time to create 1 rle with old method : 0.0001747608184814453 time for calcul the mask position with numpy : 0.010592937469482422 nb_pixel_total : 20 time to create 1 rle with old method : 5.030632019042969e-05 time for calcul the mask position with numpy : 0.010106801986694336 nb_pixel_total : 24 time to create 1 rle with old method : 8.58306884765625e-05 time for calcul the mask position with numpy : 0.010172843933105469 nb_pixel_total : 40 time to create 1 rle with old method : 9.584426879882812e-05 time for calcul the mask position with numpy : 0.010217905044555664 nb_pixel_total : 1660 time to create 1 rle with old method : 0.0020592212677001953 time for calcul the mask position with numpy : 0.010599374771118164 nb_pixel_total : 134 time to create 1 rle with old method : 0.00018286705017089844 time for calcul the mask position with numpy : 0.0106201171875 nb_pixel_total : 146 time to create 1 rle with old method : 0.00019502639770507812 time for calcul the mask position with numpy : 0.010290384292602539 nb_pixel_total : 8291 time to create 1 rle with old method : 0.00962686538696289 time for calcul the mask position with numpy : 0.009134769439697266 nb_pixel_total : 222 time to create 1 rle with old method : 0.0002846717834472656 time for calcul the mask position with numpy : 0.005843639373779297 nb_pixel_total : 1286 time to create 1 rle with old method : 0.0017254352569580078 time for calcul the mask position with numpy : 0.006836891174316406 nb_pixel_total : 870 time to create 1 rle with old method : 0.0010640621185302734 time for calcul the mask position with numpy : 0.006303310394287109 nb_pixel_total : 876 time to create 1 rle with old method : 0.0010592937469482422 time for calcul the mask position with numpy : 0.0064220428466796875 nb_pixel_total : 257 time to create 1 rle with old method : 0.0003380775451660156 time for calcul the mask position with numpy : 0.0067195892333984375 nb_pixel_total : 536 time to create 1 rle with old method : 0.0006661415100097656 time for calcul the mask position with numpy : 0.006098508834838867 nb_pixel_total : 537 time to create 1 rle with old method : 0.0006873607635498047 time for calcul the mask position with numpy : 0.005976200103759766 nb_pixel_total : 264 time to create 1 rle with old method : 0.0003523826599121094 time for calcul the mask position with numpy : 0.005974292755126953 nb_pixel_total : 991 time to create 1 rle with old method : 0.0011146068572998047 time for calcul the mask position with numpy : 0.006070137023925781 nb_pixel_total : 559 time to create 1 rle with old method : 0.0007138252258300781 time for calcul the mask position with numpy : 0.005900144577026367 nb_pixel_total : 48 time to create 1 rle with old method : 9.226799011230469e-05 time for calcul the mask position with numpy : 0.005978822708129883 nb_pixel_total : 205 time to create 1 rle with old method : 0.00024580955505371094 time for calcul the mask position with numpy : 0.0058705806732177734 nb_pixel_total : 444 time to create 1 rle with old method : 0.0005922317504882812 time for calcul the mask position with numpy : 0.00580286979675293 nb_pixel_total : 48 time to create 1 rle with old method : 0.00011444091796875 time for calcul the mask position with numpy : 0.0058934688568115234 nb_pixel_total : 35 time to create 1 rle with old method : 0.00010585784912109375 time for calcul the mask position with numpy : 0.00609588623046875 nb_pixel_total : 3424 time to create 1 rle with old method : 0.004024505615234375 time for calcul the mask position with numpy : 0.006560802459716797 nb_pixel_total : 33 time to create 1 rle with old method : 0.00014972686767578125 time for calcul the mask position with numpy : 0.006365776062011719 nb_pixel_total : 6406 time to create 1 rle with old method : 0.007595539093017578 time for calcul the mask position with numpy : 0.006083250045776367 nb_pixel_total : 1523 time to create 1 rle with old method : 0.001966238021850586 time for calcul the mask position with numpy : 0.006237983703613281 nb_pixel_total : 1339 time to create 1 rle with old method : 0.0016341209411621094 time for calcul the mask position with numpy : 0.006202220916748047 nb_pixel_total : 606 time to create 1 rle with old method : 0.0007755756378173828 time for calcul the mask position with numpy : 0.006105661392211914 nb_pixel_total : 669 time to create 1 rle with old method : 0.0008535385131835938 time for calcul the mask position with numpy : 0.006142854690551758 nb_pixel_total : 5811 time to create 1 rle with old method : 0.006949663162231445 time for calcul the mask position with numpy : 0.006222963333129883 nb_pixel_total : 8845 time to create 1 rle with old method : 0.010234594345092773 time for calcul the mask position with numpy : 0.0064356327056884766 nb_pixel_total : 436 time to create 1 rle with old method : 0.0005438327789306641 time for calcul the mask position with numpy : 0.006533622741699219 nb_pixel_total : 860 time to create 1 rle with old method : 0.0011005401611328125 time for calcul the mask position with numpy : 0.006634235382080078 nb_pixel_total : 342 time to create 1 rle with old method : 0.00044655799865722656 time for calcul the mask position with numpy : 0.00653386116027832 nb_pixel_total : 8415 time to create 1 rle with old method : 0.00954747200012207 time for calcul the mask position with numpy : 0.006026029586791992 nb_pixel_total : 728 time to create 1 rle with old method : 0.0008842945098876953 time for calcul the mask position with numpy : 0.006180524826049805 nb_pixel_total : 25479 time to create 1 rle with old method : 0.028858423233032227 time for calcul the mask position with numpy : 0.0059926509857177734 nb_pixel_total : 731 time to create 1 rle with old method : 0.0008881092071533203 time for calcul the mask position with numpy : 0.005795001983642578 nb_pixel_total : 3 time to create 1 rle with old method : 4.482269287109375e-05 time for calcul the mask position with numpy : 0.005890607833862305 nb_pixel_total : 1092 time to create 1 rle with old method : 0.0013773441314697266 time for calcul the mask position with numpy : 0.006216287612915039 nb_pixel_total : 1351 time to create 1 rle with old method : 0.0016787052154541016 time for calcul the mask position with numpy : 0.0060923099517822266 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002338886260986328 time for calcul the mask position with numpy : 0.0060577392578125 nb_pixel_total : 7102 time to create 1 rle with old method : 0.008480072021484375 time for calcul the mask position with numpy : 0.006626605987548828 nb_pixel_total : 430 time to create 1 rle with old method : 0.0005726814270019531 time for calcul the mask position with numpy : 0.006692171096801758 nb_pixel_total : 32511 time to create 1 rle with old method : 0.042824745178222656 time for calcul the mask position with numpy : 0.006098747253417969 nb_pixel_total : 2775 time to create 1 rle with old method : 0.003366708755493164 time for calcul the mask position with numpy : 0.006402492523193359 nb_pixel_total : 91 time to create 1 rle with old method : 0.0001380443572998047 time for calcul the mask position with numpy : 0.006123065948486328 nb_pixel_total : 742 time to create 1 rle with old method : 0.0009531974792480469 time for calcul the mask position with numpy : 0.006189107894897461 nb_pixel_total : 1201 time to create 1 rle with old method : 0.0014870166778564453 time for calcul the mask position with numpy : 0.006064176559448242 nb_pixel_total : 63 time to create 1 rle with old method : 0.00010943412780761719 time for calcul the mask position with numpy : 0.005913257598876953 nb_pixel_total : 1236 time to create 1 rle with old method : 0.0015499591827392578 time for calcul the mask position with numpy : 0.0058405399322509766 nb_pixel_total : 363 time to create 1 rle with old method : 0.00044465065002441406 time for calcul the mask position with numpy : 0.006097316741943359 nb_pixel_total : 3030 time to create 1 rle with old method : 0.004278659820556641 time for calcul the mask position with numpy : 0.006182193756103516 nb_pixel_total : 292 time to create 1 rle with old method : 0.00043201446533203125 time for calcul the mask position with numpy : 0.006123781204223633 nb_pixel_total : 563 time to create 1 rle with old method : 0.0006580352783203125 time for calcul the mask position with numpy : 0.0063364505767822266 nb_pixel_total : 1425 time to create 1 rle with old method : 0.0017571449279785156 time for calcul the mask position with numpy : 0.006257295608520508 nb_pixel_total : 848 time to create 1 rle with old method : 0.0010600090026855469 time for calcul the mask position with numpy : 0.006018400192260742 nb_pixel_total : 46 time to create 1 rle with old method : 0.00010323524475097656 time for calcul the mask position with numpy : 0.0062122344970703125 nb_pixel_total : 175 time to create 1 rle with old method : 0.00023365020751953125 time for calcul the mask position with numpy : 0.006241798400878906 nb_pixel_total : 585 time to create 1 rle with old method : 0.0006990432739257812 time for calcul the mask position with numpy : 0.006620645523071289 nb_pixel_total : 106692 time to create 1 rle with old method : 0.11870312690734863 time for calcul the mask position with numpy : 0.00740504264831543 nb_pixel_total : 3494 time to create 1 rle with old method : 0.0041656494140625 time for calcul the mask position with numpy : 0.009710073471069336 nb_pixel_total : 1481 time to create 1 rle with old method : 0.0017976760864257812 time for calcul the mask position with numpy : 0.009947776794433594 nb_pixel_total : 495 time to create 1 rle with old method : 0.0006175041198730469 time for calcul the mask position with numpy : 0.009773969650268555 nb_pixel_total : 320 time to create 1 rle with old method : 0.00040984153747558594 time for calcul the mask position with numpy : 0.006096363067626953 nb_pixel_total : 954 time to create 1 rle with old method : 0.0011737346649169922 time for calcul the mask position with numpy : 0.006079912185668945 nb_pixel_total : 290 time to create 1 rle with old method : 0.0003845691680908203 time for calcul the mask position with numpy : 0.006204128265380859 nb_pixel_total : 33413 time to create 1 rle with old method : 0.03748679161071777 time for calcul the mask position with numpy : 0.006031513214111328 nb_pixel_total : 678 time to create 1 rle with old method : 0.0008156299591064453 time for calcul the mask position with numpy : 0.00602412223815918 nb_pixel_total : 12525 time to create 1 rle with old method : 0.013919591903686523 time for calcul the mask position with numpy : 0.005885601043701172 nb_pixel_total : 387 time to create 1 rle with old method : 0.00046443939208984375 time for calcul the mask position with numpy : 0.005914926528930664 nb_pixel_total : 211 time to create 1 rle with old method : 0.00027751922607421875 time for calcul the mask position with numpy : 0.006197690963745117 nb_pixel_total : 865 time to create 1 rle with old method : 0.0010302066802978516 time for calcul the mask position with numpy : 0.0058667659759521484 nb_pixel_total : 258 time to create 1 rle with old method : 0.00029468536376953125 time for calcul the mask position with numpy : 0.005984067916870117 nb_pixel_total : 2072 time to create 1 rle with old method : 0.002545595169067383 time for calcul the mask position with numpy : 0.005879402160644531 nb_pixel_total : 39 time to create 1 rle with old method : 9.179115295410156e-05 time for calcul the mask position with numpy : 0.005819082260131836 nb_pixel_total : 1654 time to create 1 rle with old method : 0.0019109249114990234 time for calcul the mask position with numpy : 0.005866527557373047 nb_pixel_total : 290 time to create 1 rle with old method : 0.0003485679626464844 time for calcul the mask position with numpy : 0.005917787551879883 nb_pixel_total : 762 time to create 1 rle with old method : 0.0009396076202392578 time for calcul the mask position with numpy : 0.006089687347412109 nb_pixel_total : 161 time to create 1 rle with old method : 0.00019812583923339844 time for calcul the mask position with numpy : 0.006006002426147461 nb_pixel_total : 17 time to create 1 rle with old method : 4.363059997558594e-05 time for calcul the mask position with numpy : 0.006201505661010742 nb_pixel_total : 511 time to create 1 rle with old method : 0.00064849853515625 time for calcul the mask position with numpy : 0.006237983703613281 nb_pixel_total : 298 time to create 1 rle with old method : 0.00043654441833496094 time for calcul the mask position with numpy : 0.0064411163330078125 nb_pixel_total : 1648 time to create 1 rle with old method : 0.002034425735473633 time for calcul the mask position with numpy : 0.006178379058837891 nb_pixel_total : 1491 time to create 1 rle with old method : 0.002677440643310547 time for calcul the mask position with numpy : 0.006548166275024414 nb_pixel_total : 1230 time to create 1 rle with old method : 0.0022134780883789062 time for calcul the mask position with numpy : 0.006448030471801758 nb_pixel_total : 210 time to create 1 rle with old method : 0.0003809928894042969 time for calcul the mask position with numpy : 0.006543159484863281 nb_pixel_total : 13 time to create 1 rle with old method : 6.151199340820312e-05 time for calcul the mask position with numpy : 0.006544589996337891 nb_pixel_total : 274 time to create 1 rle with old method : 0.0005018711090087891 time for calcul the mask position with numpy : 0.006514787673950195 nb_pixel_total : 297 time to create 1 rle with old method : 0.0005481243133544922 time for calcul the mask position with numpy : 0.006455898284912109 nb_pixel_total : 342 time to create 1 rle with old method : 0.0006787776947021484 time for calcul the mask position with numpy : 0.007281303405761719 nb_pixel_total : 296 time to create 1 rle with old method : 0.0005674362182617188 time for calcul the mask position with numpy : 0.007124185562133789 nb_pixel_total : 159 time to create 1 rle with old method : 0.0003077983856201172 time for calcul the mask position with numpy : 0.006516456604003906 nb_pixel_total : 875 time to create 1 rle with old method : 0.0015637874603271484 time for calcul the mask position with numpy : 0.0064640045166015625 nb_pixel_total : 16 time to create 1 rle with old method : 4.4345855712890625e-05 time for calcul the mask position with numpy : 0.006012916564941406 nb_pixel_total : 139 time to create 1 rle with old method : 0.0001888275146484375 time for calcul the mask position with numpy : 0.005931854248046875 nb_pixel_total : 1805 time to create 1 rle with old method : 0.002187967300415039 time for calcul the mask position with numpy : 0.005899190902709961 nb_pixel_total : 422 time to create 1 rle with old method : 0.0005407333374023438 time for calcul the mask position with numpy : 0.005925893783569336 nb_pixel_total : 477 time to create 1 rle with old method : 0.0006041526794433594 time for calcul the mask position with numpy : 0.005995035171508789 nb_pixel_total : 15 time to create 1 rle with old method : 4.887580871582031e-05 time for calcul the mask position with numpy : 0.00600123405456543 nb_pixel_total : 599 time to create 1 rle with old method : 0.0007052421569824219 time for calcul the mask position with numpy : 0.006067991256713867 nb_pixel_total : 343 time to create 1 rle with old method : 0.00044155120849609375 time for calcul the mask position with numpy : 0.006159782409667969 nb_pixel_total : 508 time to create 1 rle with old method : 0.0006353855133056641 time for calcul the mask position with numpy : 0.006136417388916016 nb_pixel_total : 17 time to create 1 rle with old method : 6.008148193359375e-05 time for calcul the mask position with numpy : 0.006074666976928711 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003771781921386719 time for calcul the mask position with numpy : 0.006220340728759766 nb_pixel_total : 1012 time to create 1 rle with old method : 0.001188039779663086 time for calcul the mask position with numpy : 0.0061147212982177734 nb_pixel_total : 94 time to create 1 rle with old method : 0.0001494884490966797 time for calcul the mask position with numpy : 0.006139516830444336 nb_pixel_total : 455 time to create 1 rle with old method : 0.0005383491516113281 time for calcul the mask position with numpy : 0.006064414978027344 nb_pixel_total : 867 time to create 1 rle with old method : 0.0011258125305175781 time for calcul the mask position with numpy : 0.0061092376708984375 nb_pixel_total : 721 time to create 1 rle with old method : 0.0008840560913085938 time for calcul the mask position with numpy : 0.006288290023803711 nb_pixel_total : 1127 time to create 1 rle with old method : 0.0014140605926513672 time for calcul the mask position with numpy : 0.0063991546630859375 nb_pixel_total : 180 time to create 1 rle with old method : 0.0002372264862060547 time for calcul the mask position with numpy : 0.006490230560302734 nb_pixel_total : 403 time to create 1 rle with old method : 0.0005030632019042969 time for calcul the mask position with numpy : 0.006251096725463867 nb_pixel_total : 113 time to create 1 rle with old method : 0.00017833709716796875 time for calcul the mask position with numpy : 0.006277561187744141 nb_pixel_total : 2016 time to create 1 rle with old method : 0.002422332763671875 time for calcul the mask position with numpy : 0.0065517425537109375 nb_pixel_total : 471 time to create 1 rle with old method : 0.000579833984375 time for calcul the mask position with numpy : 0.006308317184448242 nb_pixel_total : 104 time to create 1 rle with old method : 0.00015497207641601562 time for calcul the mask position with numpy : 0.0062863826751708984 nb_pixel_total : 13 time to create 1 rle with old method : 6.914138793945312e-05 time for calcul the mask position with numpy : 0.006554603576660156 nb_pixel_total : 139 time to create 1 rle with old method : 0.0001876354217529297 time for calcul the mask position with numpy : 0.006597042083740234 nb_pixel_total : 42 time to create 1 rle with old method : 8.177757263183594e-05 create new chi : 1.3674516677856445 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0016715526580810547 batch 1 Loaded 130 chid ids of type : 4230 Number RLEs to save : 13295 TO DO : save crop sub photo not yet done ! save time : 0.9775323867797852 map_output_result : {1337679446: (0.0, 'Should be the crop_list due to order', 0.0), 1337679263: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1337679446, 1337679263] Looping around the photos to save general results len do output : 2 /1337679446.Didn't retrieve data . /1337679263.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588801') ('4234', '20568607', '1337679446', None, None, None, None, None, '2588801') ('4234', None, None, None, None, None, None, None, '2588801') ('4234', '20568607', '1337679263', None, None, None, None, None, '2588801') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.09831905364990234 save_final save missing photos in datou_result : time spend for datou_step_exec : 9.235660076141357 time spend to save output : 0.0985572338104248 total time spend for step 4 : 9.334217309951782 step5:crop_condition Fri Feb 14 20:21:15 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 2 ! batch 1 Loaded 274 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 83 About to insert : list_path_to_insert length 83 new photo from crops ! About to upload 83 photos upload in portfolio : 4869462 init cache_photo without model_param we have 83 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739560877_2133718 we have uploaded 83 photos in the portfolio 4869462 time of upload the photos Elapsed time : 22.125667810440063 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 23 About to insert : list_path_to_insert length 23 new photo from crops ! About to upload 23 photos upload in portfolio : 4869462 init cache_photo without model_param we have 23 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739560900_2133718 we have uploaded 23 photos in the portfolio 4869462 time of upload the photos Elapsed time : 6.606860160827637 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 4 About to insert : list_path_to_insert length 4 new photo from crops ! About to upload 4 photos upload in portfolio : 4869462 init cache_photo without model_param we have 4 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739560906_2133718 we have uploaded 4 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.1068089008331299 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 13 About to insert : list_path_to_insert length 13 new photo from crops ! About to upload 13 photos upload in portfolio : 4869462 init cache_photo without model_param we have 13 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739560908_2133718 we have uploaded 13 photos in the portfolio 4869462 time of upload the photos Elapsed time : 3.072324275970459 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 42 About to insert : list_path_to_insert length 42 new photo from crops ! About to upload 42 photos upload in portfolio : 4869462 init cache_photo without model_param we have 42 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739560912_2133718 we have uploaded 42 photos in the portfolio 4869462 time of upload the photos Elapsed time : 14.109334230422974 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739560926_2133718 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.5785868167877197 we have finished the crop for the class : pehd begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1337679446, 1337679263] Looping around the photos to save general results len do output : 166 /1337704259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704418Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704492Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704494Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704495Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704497Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704498Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704499Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704500Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704501Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704502Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704503Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704504Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704505Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704506Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704507Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704508Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704509Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704511Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704512Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704513Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704514Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704515Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704516Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704517Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704518Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704519Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704520Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704521Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704522Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704524Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704525Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704526Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1337704529Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588801') ('4234', '20568607', '1337679446', None, None, None, None, None, '2588801') ('4234', None, None, None, None, None, None, None, '2588801') ('4234', '20568607', '1337679263', None, None, None, None, None, '2588801') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 500 time used for this insertion : 0.03941607475280762 save_final save missing photos in datou_result : time spend for datou_step_exec : 51.42802548408508 time spend to save output : 0.04540443420410156 total time spend for step 5 : 51.473429918289185 step6:thcl Fri Feb 14 20:22:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.011181116104125977 time to convert the images to numpy array : 0.03352618217468262 time to import caffe and check if the image exist : 0.010881662368774414 time to convert the images to numpy array : 0.03748512268066406 time to import caffe and check if the image exist : 0.013167858123779297 time to convert the images to numpy array : 0.03755688667297363 time to import caffe and check if the image exist : 0.012027502059936523 time to convert the images to numpy array : 0.03961181640625 time to import caffe and check if the image exist : 0.008131027221679688 time to convert the images to numpy array : 0.04801535606384277 time to import caffe and check if the image exist : 0.017655134201049805 time to convert the images to numpy array : 0.04028940200805664 time to import caffe and check if the image exist : 0.012583017349243164 time to convert the images to numpy array : 0.045159339904785156 time to import caffe and check if the image exist : 0.02478504180908203 time to convert the images to numpy array : 0.0339810848236084 time to import caffe and check if the image exist : 0.017331361770629883 time to convert the images to numpy array : 0.0430757999420166 time to import caffe and check if the image exist : 0.021454334259033203 time to convert the images to numpy array : 0.03922629356384277 total time to convert the images to numpy array : 0.29551196098327637 list photo_ids error: [] list photo_ids correct : [1337704285, 1337704286, 1337704287, 1337704288, 1337704290, 1337704291, 1337704292, 1337704293, 1337704294, 1337704295, 1337704296, 1337704297, 1337704298, 1337704299, 1337704300, 1337704301, 1337704302, 1337704514, 1337704515, 1337704516, 1337704517, 1337704518, 1337704519, 1337704520, 1337704521, 1337704522, 1337704524, 1337704525, 1337704526, 1337704529, 1337704320, 1337704322, 1337704323, 1337704324, 1337704325, 1337704326, 1337704327, 1337704328, 1337704329, 1337704330, 1337704331, 1337704332, 1337704333, 1337704334, 1337704335, 1337704336, 1337704337, 1337704495, 1337704497, 1337704498, 1337704499, 1337704500, 1337704501, 1337704502, 1337704503, 1337704504, 1337704505, 1337704506, 1337704507, 1337704508, 1337704509, 1337704511, 1337704512, 1337704513, 1337704259, 1337704261, 1337704263, 1337704265, 1337704267, 1337704269, 1337704271, 1337704273, 1337704275, 1337704277, 1337704278, 1337704279, 1337704280, 1337704281, 1337704282, 1337704283, 1337704284, 1337704418, 1337704420, 1337704422, 1337704423, 1337704426, 1337704427, 1337704428, 1337704429, 1337704442, 1337704443, 1337704444, 1337704445, 1337704446, 1337704447, 1337704448, 1337704449, 1337704450, 1337704338, 1337704339, 1337704340, 1337704341, 1337704342, 1337704343, 1337704344, 1337704345, 1337704346, 1337704347, 1337704348, 1337704349, 1337704350, 1337704351, 1337704352, 1337704379, 1337704381, 1337704451, 1337704452, 1337704453, 1337704454, 1337704482, 1337704483, 1337704484, 1337704485, 1337704486, 1337704487, 1337704488, 1337704489, 1337704490, 1337704491, 1337704492, 1337704493, 1337704494, 1337704303, 1337704304, 1337704305, 1337704306, 1337704307, 1337704308, 1337704309, 1337704310, 1337704311, 1337704312, 1337704313, 1337704314, 1337704315, 1337704316, 1337704317, 1337704318, 1337704319, 1337704383, 1337704385, 1337704388, 1337704390, 1337704392, 1337704394, 1337704396, 1337704398, 1337704400, 1337704402, 1337704404, 1337704406, 1337704408, 1337704410, 1337704412, 1337704414, 1337704416] number of photos to traite : 166 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10553 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10334 max_wait_temp : 1 max_wait : 0 dict_keys(['prob', 'pool5']) time used to do the prepocess of the images : 0.7788271903991699 time used to do the prediction : 0.640939474105835 save descriptor for thcl : 3237 time to traite the descriptors : 0.9850177764892578 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1337704285 To insert : 1337704286 To insert : 1337704287 To insert : 1337704288 To insert : 1337704290 To insert : 1337704291 To insert : 1337704292 To insert : 1337704293 To insert : 1337704294 To insert : 1337704295 To insert : 1337704296 To insert : 1337704297 To insert : 1337704298 To insert : 1337704299 To insert : 1337704300 To insert : 1337704301 To insert : 1337704302 To insert : 1337704514 To insert : 1337704515 To insert : 1337704516 To insert : 1337704517 To insert : 1337704518 To insert : 1337704519 To insert : 1337704520 To insert : 1337704521 To insert : 1337704522 To insert : 1337704524 To insert : 1337704525 To insert : 1337704526 To insert : 1337704529 To insert : 1337704320 To insert : 1337704322 To insert : 1337704323 To insert : 1337704324 To insert : 1337704325 To insert : 1337704326 To insert : 1337704327 To insert : 1337704328 To insert : 1337704329 To insert : 1337704330 To insert : 1337704331 To insert : 1337704332 To insert : 1337704333 To insert : 1337704334 To insert : 1337704335 To insert : 1337704336 To insert : 1337704337 To insert : 1337704495 To insert : 1337704497 To insert : 1337704498 To insert : 1337704499 To insert : 1337704500 To insert : 1337704501 To insert : 1337704502 To insert : 1337704503 To insert : 1337704504 To insert : 1337704505 To insert : 1337704506 To insert : 1337704507 To insert : 1337704508 To insert : 1337704509 To insert : 1337704511 To insert : 1337704512 To insert : 1337704513 To insert : 1337704259 To insert : 1337704261 To insert : 1337704263 To insert : 1337704265 To insert : 1337704267 To insert : 1337704269 To insert : 1337704271 To insert : 1337704273 To insert : 1337704275 To insert : 1337704277 To insert : 1337704278 To insert : 1337704279 To insert : 1337704280 To insert : 1337704281 To insert : 1337704282 To insert : 1337704283 To insert : 1337704284 To insert : 1337704418 To insert : 1337704420 To insert : 1337704422 To insert : 1337704423 To insert : 1337704426 To insert : 1337704427 To insert : 1337704428 To insert : 1337704429 To insert : 1337704442 To insert : 1337704443 To insert : 1337704444 To insert : 1337704445 To insert : 1337704446 To insert : 1337704447 To insert : 1337704448 To insert : 1337704449 To insert : 1337704450 To insert : 1337704338 To insert : 1337704339 To insert : 1337704340 To insert : 1337704341 To insert : 1337704342 To insert : 1337704343 To insert : 1337704344 To insert : 1337704345 To insert : 1337704346 To insert : 1337704347 To insert : 1337704348 To insert : 1337704349 To insert : 1337704350 To insert : 1337704351 To insert : 1337704352 To insert : 1337704379 To insert : 1337704381 To insert : 1337704451 To insert : 1337704452 To insert : 1337704453 To insert : 1337704454 To insert : 1337704482 To insert : 1337704483 To insert : 1337704484 To insert : 1337704485 To insert : 1337704486 To insert : 1337704487 To insert : 1337704488 To insert : 1337704489 To insert : 1337704490 To insert : 1337704491 To insert : 1337704492 To insert : 1337704493 To insert : 1337704494 To insert : 1337704303 To insert : 1337704304 To insert : 1337704305 To insert : 1337704306 To insert : 1337704307 To insert : 1337704308 To insert : 1337704309 To insert : 1337704310 To insert : 1337704311 To insert : 1337704312 To insert : 1337704313 To insert : 1337704314 To insert : 1337704315 To insert : 1337704316 To insert : 1337704317 To insert : 1337704318 To insert : 1337704319 To insert : 1337704383 To insert : 1337704385 To insert : 1337704388 To insert : 1337704390 To insert : 1337704392 To insert : 1337704394 To insert : 1337704396 To insert : 1337704398 To insert : 1337704400 To insert : 1337704402 To insert : 1337704404 To insert : 1337704406 To insert : 1337704408 To insert : 1337704410 To insert : 1337704412 To insert : 1337704414 To insert : 1337704416 time to insert the descriptors : 28.30382537841797 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 273 time used for this insertion : 0.8884317874908447 save missing photos in datou_result : time spend for datou_step_exec : 34.80875825881958 time spend to save output : 0.9360377788543701 total time spend for step 6 : 35.74479603767395 step7:ventilate_hashtags_in_portfolio Fri Feb 14 20:22:42 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20568607 get user id for portfolio 20568607 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568607 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PEHD','pet_clair','mal_croppe','PET_clair','papier','metal','PET_fonce','Film_plastique','environnement','pehd','refus','carton','Carton','flou','pet_fonce','Papier','Tetrapak','autre')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568607 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PEHD','pet_clair','mal_croppe','PET_clair','papier','metal','PET_fonce','Film_plastique','environnement','pehd','refus','carton','Carton','flou','pet_fonce','Papier','Tetrapak','autre')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568607 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PEHD','pet_clair','mal_croppe','PET_clair','papier','metal','PET_fonce','Film_plastique','environnement','pehd','refus','carton','Carton','flou','pet_fonce','Papier','Tetrapak','autre')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568607 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('PEHD','pet_clair','mal_croppe','PET_clair','papier','metal','PET_fonce','Film_plastique','environnement','pehd','refus','carton','Carton','flou','pet_fonce','Papier','Tetrapak','autre')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20574455,20574449,20574448,20574461,20574451,20574460,20574453,20574454,20574456,20574458,20574459,20574462,20574463?tags=pehd,pet_clair,mal_croppe,papier,metal,pet_fonce,film_plastique,environnement,refus,carton,flou,tetrapak,autre&datou_id_consolidate=4235&port_consolidate=20568607 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1337679446, 1337679263] Looping around the photos to save general results len do output : 1 /20568607. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588801') ('4234', '20568607', '1337679446', None, None, None, None, None, '2588801') ('4234', None, None, None, None, None, None, None, '2588801') ('4234', '20568607', '1337679263', None, None, None, None, None, '2588801') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.015165567398071289 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.188669443130493 time spend to save output : 0.015445232391357422 total time spend for step 7 : 5.204114675521851 step8:final Fri Feb 14 20:22:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1337679446: ('0.25440762275141415',), 1337679263: ('0.25440762275141415',)} new output for save of step final : {1337679446: ('0.25440762275141415',), 1337679263: ('0.25440762275141415',)} [1337679446, 1337679263] Looping around the photos to save general results len do output : 2 /1337679446.Didn't retrieve data . /1337679263.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588801') ('4234', '20568607', '1337679446', None, None, None, None, None, '2588801') ('4234', None, None, None, None, None, None, None, '2588801') ('4234', '20568607', '1337679263', None, None, None, None, None, '2588801') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 6 time used for this insertion : 0.01691460609436035 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.11660146713256836 time spend to save output : 0.01718878746032715 total time spend for step 8 : 0.1337902545928955 step9:velours_tree Fri Feb 14 20:22:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20574455,20574449,20574448,20574461,20574451,20574460,20574453,20574454,20574456,20574458,20574459,20574462,20574463 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20574455 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20574449 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20574448 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20574461 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20574451 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20574460 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20574453 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20574454 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20574456 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20574458 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20574459 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20574462 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20574463 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 166 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [0 4 4 1 2 1 1 0 1 0 1 3 2 4 0 2 4 3 0 2 2 2 4 0 0 2 2 0 4 2 2 2 1 1 4 0 0 4 1 2 0 2 1 0 0 0 1 0 4 1 1 0 1 1 1 0 3 2 0 2 4 3 2 1 0 0 0 2 4 1 4 1 1 4 0 0 2 0 0 1 0 1 1 5 5 1 0 0 2 2 2 1 1 5 1 0 2 4 2 2 1 1 1 0 2 1 2 0 0 2 1 1 1 0 4 4 1 1 1 1 0 0 4 4 1 4 5 2 4 1 4 0 4 0 1 2 0 0 1 4 0 1 0 2 0 0 0 4 1 4 1 4 1 4 0 0 0 2 2 4 0 0 1 0 0 1] Elapsed time: 0.023374557495117188 graph_id used : 78658 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20574455,20574449,20574448,20574461,20574451,20574460,20574453,20574454,20574456,20574458,20574459,20574462,20574463?tags=pehd,pet_clair,mal_croppe,papier,metal,pet_fonce,film_plastique,environnement,refus,carton,flou,tetrapak,autre&datou_id_consolidate=4235&port_consolidate=20568607&tree_id=78658 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1337679446, 1337679263] Looping around the photos to save general results len do output : 1 /20568607Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588801') ('4234', '20568607', '1337679446', None, None, None, None, None, '2588801') ('4234', None, None, None, None, None, None, None, '2588801') ('4234', '20568607', '1337679263', None, None, None, None, None, '2588801') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.012170076370239258 save_final save missing photos in datou_result : time spend for datou_step_exec : 18.4106764793396 time spend to save output : 0.012511968612670898 total time spend for step 9 : 18.42318844795227 step10:send_mail_cod Fri Feb 14 20:23:06 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20568607_14-02-2025_20_23_06.pdf 20574436 change filename to text .imagette205744361739560986 20574430 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205744301739560986 20574429 imagette205744291739560987 20574442 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205744421739560987 20574432 change filename to text .change filename to text .change filename to text .change filename to text .imagette205744321739560988 20574441 imagette205744411739560988 20574434 imagette205744341739560988 20574437 imagette205744371739560988 20574439 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205744391739560988 20574440 imagette205744401739560989 20574443 imagette205744431739560989 20574444 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette205744441739560989 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20568607 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20574455,20574449,20574448,20574461,20574451,20574460,20574453,20574454,20574456,20574458,20574459,20574462,20574463?tags=pehd,pet_clair,mal_croppe,papier,metal,pet_fonce,film_plastique,environnement,refus,carton,flou,tetrapak,autre&datou_id_consolidate=4235&port_consolidate=20568607&tree_id=78658 your option no_mail is active, we will not send the real mail to your client args[1337679446] : ((1337679446, -7.644287577401136, 492609224), (1337679446, -0.34261254035081634, 496442774), '0.25440762275141415') apple ((1337679446, -7.644287577401136, 492609224), (1337679446, -0.34261254035081634, 496442774), '0.25440762275141415') We are sending mail with results at cod@fotonower.com args[1337679263] : ((1337679263, -7.612192803036224, 492609224), (1337679263, -0.34194200266984937, 496442774), '0.25440762275141415') apple ((1337679263, -7.612192803036224, 492609224), (1337679263, -0.34194200266984937, 496442774), '0.25440762275141415') We are sending mail with results at cod@fotonower.com refus_total : 0.25440762275141415 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20568607 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568607_14-02-2025_20_23_06.pdf results_Qualipapia_P20568607_14-02-2025_20_23_06.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568607_14-02-2025_20_23_06.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20568607','results_Qualipapia_P20568607_14-02-2025_20_23_06.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568607_14-02-2025_20_23_06.pdf','pdf','','0.16','0.25440762275141415') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1337679446, 1337679263] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588801') ('4234', '20568607', '1337679446', None, None, None, None, None, '2588801') ('4234', None, None, None, None, None, None, None, '2588801') ('4234', '20568607', '1337679263', None, None, None, None, None, '2588801') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.013556718826293945 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.466578483581543 time spend to save output : 0.013719797134399414 total time spend for step 10 : 4.480298280715942 step11:split_time_score Fri Feb 14 20:23:10 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 2),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 14022025 20568607 Nombre de photos uploadées : 2 / 23040 (0%) 14022025 20568607 Nombre de photos taguées (types de déchets): 2 / 2 (100%) 14022025 20568607 Nombre de photos taguées (volume) : 0 / 2 (0%) elapsed_time : load_data_split_time_score 1.430511474609375e-06 elapsed_time : order_list_meta_photo_and_scores 5.245208740234375e-06 ?? elapsed_time : fill_and_build_computed_from_old_data 0.00020575523376464844 elapsed_time : insert_dashboard_record_day_entry 0.02491927146911621 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.14080265003567735 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20557267_14-02-2025_13_16_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20557267 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20557267 AND mptpi.`type`=4230 To do Qualite : 0.16283505865355488 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20557268_14-02-2025_13_06_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20557268 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20557268 AND mptpi.`type`=4230 To do Qualite : 0.17080943635979126 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20561437_14-02-2025_16_47_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20561437 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20561437 AND mptpi.`type`=4230 To do Qualite : 0.15705737530364391 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20561438_14-02-2025_16_22_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20561438 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20561438 AND mptpi.`type`=4230 To do Qualite : 0.24123338678301143 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20561439_14-02-2025_16_36_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20561439 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20561439 AND mptpi.`type`=4230 To do Qualite : 0.2278315065084019 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20561440_14-02-2025_15_49_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20561440 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20561440 AND mptpi.`type`=4230 To do Qualite : 0.21228317775297423 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20565004_14-02-2025_17_33_07.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20565004 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20565004 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20565005 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20565006 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20565007 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568568 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568570 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568571 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568572 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568575 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568587 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568601 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568602 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567453 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567454 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567455 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567456 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567457 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567458 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567459 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567460 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567461 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567462 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567463 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567464 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567465 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567466 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567467 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567468 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567469 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567470 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567471 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567472 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567473 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567474 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567475 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567476 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567477 order by id desc limit 1 Qualite : 0.23699891677009535 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567478_14-02-2025_18_34_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567478 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567478 AND mptpi.`type`=4230 To do Qualite : 0.2659324169831625 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567479_14-02-2025_18_20_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567479 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567479 AND mptpi.`type`=4230 To do Qualite : 0.23264297907652698 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20567480_14-02-2025_18_23_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20567480 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20567480 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568604 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568605 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568606 order by id desc limit 1 Qualite : 0.25440762275141415 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568607_14-02-2025_20_23_06.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568607 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568607 AND mptpi.`type`=4230 To do Qualite : 0.23908227128633877 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568608_14-02-2025_20_21_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568608 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568608 AND mptpi.`type`=4230 To do Qualite : 0.25379507447780547 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568609_14-02-2025_18_47_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568609 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568609 AND mptpi.`type`=4230 To do Qualite : 0.255508684248806 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568610_14-02-2025_19_35_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568610 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568610 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568611 order by id desc limit 1 Qualite : 0.2428419785256863 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20568612_14-02-2025_18_37_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20568612 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20568612 AND mptpi.`type`=4230 To do Qualite : 0.2477337637088999 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20571465_14-02-2025_19_47_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20571465 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20571465 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'14022025': {'nb_upload': 2, 'nb_taggue_class': 2, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1337679446, 1337679263] Looping around the photos to save general results len do output : 1 /20568607Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2588801') ('4234', '20568607', '1337679446', None, None, None, None, None, '2588801') ('4234', None, None, None, None, None, None, None, '2588801') ('4234', '20568607', '1337679263', None, None, None, None, None, '2588801') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.01251363754272461 save_final save missing photos in datou_result : time spend for datou_step_exec : 32.22190499305725 time spend to save output : 0.012672901153564453 total time spend for step 11 : 32.234577894210815 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 2 set_done_treatment 37.60user 25.52system 3:17.97elapsed 31%CPU (0avgtext+0avgdata 2620920maxresident)k 413312inputs+13520outputs (126major+2500189minor)pagefaults 0swaps