python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2286560 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2535886'] with mtr_portfolio_ids : ['20127306'] and first list_photo_ids : [] new path : /proc/2286560/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 4 ; length of list_pids : 4 ; length of list_args : 4 time to download the photos : 0.5611968040466309 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Sat Feb 1 00:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3687 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-01 00:20:33.847765: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-01 00:20:33.879473: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493020000 Hz 2025-02-01 00:20:33.881626: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f0108000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-01 00:20:33.881686: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-01 00:20:33.887025: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-01 00:20:34.150407: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x40967250 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-01 00:20:34.150496: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-01 00:20:34.152099: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 00:20:34.153863: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 00:20:34.185126: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 00:20:34.203688: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 00:20:34.207969: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 00:20:34.239503: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 00:20:34.244337: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 00:20:34.299416: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 00:20:34.300802: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 00:20:34.301260: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 00:20:34.302724: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-01 00:20:34.302746: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-01 00:20:34.302758: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-01 00:20:34.304352: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3235 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-01 00:20:34.791738: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 00:20:34.791850: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 00:20:34.791867: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 00:20:34.791881: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 00:20:34.791895: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 00:20:34.791907: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 00:20:34.791920: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 00:20:34.791934: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 00:20:34.792798: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 00:20:34.793860: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 00:20:34.793894: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 00:20:34.793915: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 00:20:34.793932: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 00:20:34.793950: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 00:20:34.793964: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 00:20:34.793978: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 00:20:34.793995: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 00:20:34.794937: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 00:20:34.794994: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-01 00:20:34.795007: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-01 00:20:34.795018: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-01 00:20:34.796193: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 3235 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-01 00:20:43.215872: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 00:20:43.562157: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 00:20:45.465965: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.466622: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.39G (2571514624 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.467245: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.16G (2314363136 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.467271: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 00:20:45.467940: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.467960: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 00:20:45.475192: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.475225: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 00:20:45.475832: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.475852: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 00:20:45.482884: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.482924: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 00:20:45.483841: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.483866: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 466.56MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 00:20:45.515513: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.515565: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 00:20:45.516148: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.516164: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 2.06GiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 00:20:45.522034: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.522055: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 00:20:45.522631: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.522647: W tensorflow/core/common_runtime/bfc_allocator.cc:245] Allocator (GPU_0_bfc) ran out of memory trying to allocate 243.25MiB with freed_by_count=0. The caller indicates that this is not a failure, but may mean that there could be performance gains if more memory were available. 2025-02-01 00:20:45.556704: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.557300: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.559179: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.559794: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.603765: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.604356: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.606593: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.607174: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.637725: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.638318: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.640046: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.640632: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.648592: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.649195: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.651095: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.651687: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.658406: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.658990: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.660724: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.661288: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.691974: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.692577: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.693153: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.693685: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.697542: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.698082: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.714620: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.715220: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.715844: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.716437: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.729866: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.730846: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.731771: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.732773: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.738011: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.738911: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.743722: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.744316: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.756508: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.757118: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.761541: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.762447: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.763359: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.764265: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.765415: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.766322: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.776469: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.777010: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.777603: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.778181: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.778721: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.779253: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.793908: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.794487: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.857077: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.857960: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.866447: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.867322: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.893167: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.894055: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.894970: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.895828: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.900180: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.901031: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.901871: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.902710: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.904453: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.904476: W tensorflow/core/kernels/gpu_utils.cc:49] Failed to allocate memory for convolution redzone checking; skipping this check. This is benign and only means that we won't check cudnn for out-of-bounds reads and writes. This message will only be printed once. 2025-02-01 00:20:45.913841: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.914437: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.923602: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.924217: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.924811: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.925391: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.925980: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory 2025-02-01 00:20:45.926559: I tensorflow/stream_executor/cuda/cuda_driver.cc:763] failed to allocate 2.66G (2857238528 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 4 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.23516 max: 150.03750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 7.2479248046875e-05 nb_pixel_total : 23 time to create 1 rle with old method : 0.0001499652862548828 length of segment : 10 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 429 time to create 1 rle with old method : 0.0008361339569091797 length of segment : 69 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 100 time to create 1 rle with old method : 0.00021576881408691406 length of segment : 22 time for calcul the mask position with numpy : 8.821487426757812e-05 nb_pixel_total : 432 time to create 1 rle with old method : 0.0008113384246826172 length of segment : 30 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 100 time to create 1 rle with old method : 0.0002300739288330078 length of segment : 21 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.92266 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 332 time to create 1 rle with old method : 0.0005421638488769531 length of segment : 19 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 1173 time to create 1 rle with old method : 0.0017633438110351562 length of segment : 49 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 203 time to create 1 rle with old method : 0.00037384033203125 length of segment : 24 time for calcul the mask position with numpy : 0.0007109642028808594 nb_pixel_total : 15691 time to create 1 rle with old method : 0.02246570587158203 length of segment : 347 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 443 time to create 1 rle with old method : 0.0006124973297119141 length of segment : 67 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 330 time to create 1 rle with old method : 0.0004584789276123047 length of segment : 38 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 79 time to create 1 rle with old method : 0.000152587890625 length of segment : 13 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.00030040740966796875 length of segment : 16 time for calcul the mask position with numpy : 7.772445678710938e-05 nb_pixel_total : 2832 time to create 1 rle with old method : 0.0036389827728271484 length of segment : 56 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.12188 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 20 time to create 1 rle with old method : 0.00022530555725097656 length of segment : 10 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.55156 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.0001766681671142578 nb_pixel_total : 6208 time to create 1 rle with old method : 0.01162862777709961 length of segment : 80 time for calcul the mask position with numpy : 7.796287536621094e-05 nb_pixel_total : 218 time to create 1 rle with old method : 0.000476837158203125 length of segment : 18 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 314 time to create 1 rle with old method : 0.0005772113800048828 length of segment : 31 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.07266 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 85 time to create 1 rle with old method : 0.00019812583923339844 length of segment : 9 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 499 time to create 1 rle with old method : 0.0007154941558837891 length of segment : 23 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 648 time to create 1 rle with old method : 0.0008866786956787109 length of segment : 62 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 437 time to create 1 rle with old method : 0.0005633831024169922 length of segment : 80 time for calcul the mask position with numpy : 0.0001373291015625 nb_pixel_total : 1334 time to create 1 rle with old method : 0.0023877620697021484 length of segment : 35 time for calcul the mask position with numpy : 0.0006628036499023438 nb_pixel_total : 47383 time to create 1 rle with old method : 0.07212972640991211 length of segment : 253 time for calcul the mask position with numpy : 0.0003025531768798828 nb_pixel_total : 3496 time to create 1 rle with old method : 0.00711512565612793 length of segment : 105 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 17 time to create 1 rle with old method : 0.0001461505889892578 length of segment : 8 time for calcul the mask position with numpy : 0.0007789134979248047 nb_pixel_total : 43932 time to create 1 rle with old method : 0.07553529739379883 length of segment : 263 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 533 time to create 1 rle with old method : 0.009071826934814453 length of segment : 20 time for calcul the mask position with numpy : 0.0009183883666992188 nb_pixel_total : 62761 time to create 1 rle with old method : 0.07765936851501465 length of segment : 358 Processing 1 images image shape: (400, 400, 3) min: 29.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -75.76250 max: 117.01641 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -102.87969 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 336 time to create 1 rle with old method : 0.0005660057067871094 length of segment : 20 time for calcul the mask position with numpy : 7.700920104980469e-05 nb_pixel_total : 3356 time to create 1 rle with old method : 0.004379749298095703 length of segment : 43 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 331 time to create 1 rle with old method : 0.0004951953887939453 length of segment : 22 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.35625 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 294 time to create 1 rle with old method : 0.0004467964172363281 length of segment : 42 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 329 time to create 1 rle with old method : 0.0004954338073730469 length of segment : 21 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.0001976490020751953 length of segment : 11 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 148 time to create 1 rle with old method : 0.00023984909057617188 length of segment : 11 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 187 time to create 1 rle with old method : 0.0002961158752441406 length of segment : 19 time for calcul the mask position with numpy : 0.00014472007751464844 nb_pixel_total : 4784 time to create 1 rle with old method : 0.005988597869873047 length of segment : 184 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.0002579689025878906 length of segment : 17 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.00020694732666015625 length of segment : 8 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 1452 time to create 1 rle with old method : 0.0020105838775634766 length of segment : 35 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 813 time to create 1 rle with old method : 0.0016298294067382812 length of segment : 36 time for calcul the mask position with numpy : 7.987022399902344e-05 nb_pixel_total : 344 time to create 1 rle with old method : 0.0009868144989013672 length of segment : 23 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 130 time to create 1 rle with old method : 0.0003788471221923828 length of segment : 11 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 133 time to create 1 rle with old method : 0.00021791458129882812 length of segment : 12 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 857 time to create 1 rle with old method : 0.0011382102966308594 length of segment : 40 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 124 time to create 1 rle with old method : 0.00020503997802734375 length of segment : 11 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.55156 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 184 time to create 1 rle with old method : 0.0004315376281738281 length of segment : 18 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 584 time to create 1 rle with old method : 0.0010833740234375 length of segment : 26 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 197 time to create 1 rle with old method : 0.00042319297790527344 length of segment : 11 time for calcul the mask position with numpy : 7.748603820800781e-05 nb_pixel_total : 862 time to create 1 rle with old method : 0.0015535354614257812 length of segment : 65 time for calcul the mask position with numpy : 0.00022792816162109375 nb_pixel_total : 9577 time to create 1 rle with old method : 0.015994787216186523 length of segment : 162 time for calcul the mask position with numpy : 0.00026702880859375 nb_pixel_total : 12851 time to create 1 rle with old method : 0.015644073486328125 length of segment : 133 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 1471 time to create 1 rle with old method : 0.0017971992492675781 length of segment : 43 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 266 time to create 1 rle with old method : 0.00040841102600097656 length of segment : 24 time for calcul the mask position with numpy : 0.0001811981201171875 nb_pixel_total : 9599 time to create 1 rle with old method : 0.011501789093017578 length of segment : 149 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 366 time to create 1 rle with old method : 0.0005538463592529297 length of segment : 19 time for calcul the mask position with numpy : 0.00019025802612304688 nb_pixel_total : 9339 time to create 1 rle with old method : 0.011504411697387695 length of segment : 136 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 166 time to create 1 rle with old method : 0.00023889541625976562 length of segment : 58 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 2274 time to create 1 rle with old method : 0.0027930736541748047 length of segment : 48 time for calcul the mask position with numpy : 0.00023865699768066406 nb_pixel_total : 10536 time to create 1 rle with old method : 0.01733684539794922 length of segment : 172 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 877 time to create 1 rle with old method : 0.0012035369873046875 length of segment : 28 time for calcul the mask position with numpy : 0.00024080276489257812 nb_pixel_total : 4656 time to create 1 rle with old method : 0.005774736404418945 length of segment : 215 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.0001964569091796875 length of segment : 14 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 82 time to create 1 rle with old method : 0.00015163421630859375 length of segment : 16 time for calcul the mask position with numpy : 5.6743621826171875e-05 nb_pixel_total : 1226 time to create 1 rle with old method : 0.0015938282012939453 length of segment : 54 time for calcul the mask position with numpy : 0.00011134147644042969 nb_pixel_total : 1661 time to create 1 rle with old method : 0.0026717185974121094 length of segment : 85 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 776 time to create 1 rle with old method : 0.0010492801666259766 length of segment : 45 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 195 time to create 1 rle with old method : 0.0003230571746826172 length of segment : 18 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 1008 time to create 1 rle with old method : 0.0014336109161376953 length of segment : 33 Processing 1 images image shape: (280, 400, 3) min: 21.00000 max: 226.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 102.26797 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 253 time to create 1 rle with old method : 0.0003910064697265625 length of segment : 16 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 629 time to create 1 rle with old method : 0.0008285045623779297 length of segment : 54 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 496 time to create 1 rle with old method : 0.0007109642028808594 length of segment : 29 time for calcul the mask position with numpy : 7.462501525878906e-05 nb_pixel_total : 1523 time to create 1 rle with old method : 0.0020012855529785156 length of segment : 81 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 1262 time to create 1 rle with old method : 0.0017337799072265625 length of segment : 40 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.0003275871276855469 length of segment : 15 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.0002758502960205078 length of segment : 15 time for calcul the mask position with numpy : 0.00012183189392089844 nb_pixel_total : 4311 time to create 1 rle with old method : 0.005579948425292969 length of segment : 67 time for calcul the mask position with numpy : 9.870529174804688e-05 nb_pixel_total : 949 time to create 1 rle with old method : 0.0013310909271240234 length of segment : 48 time for calcul the mask position with numpy : 0.00012230873107910156 nb_pixel_total : 3035 time to create 1 rle with old method : 0.003882884979248047 length of segment : 99 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 357 time to create 1 rle with old method : 0.0005125999450683594 length of segment : 20 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 452 time to create 1 rle with old method : 0.0006661415100097656 length of segment : 35 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 1307 time to create 1 rle with old method : 0.0017762184143066406 length of segment : 41 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 23 time for calcul the mask position with numpy : 6.604194641113281e-05 nb_pixel_total : 494 time to create 1 rle with old method : 0.0007076263427734375 length of segment : 24 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 396 time to create 1 rle with old method : 0.0005671977996826172 length of segment : 30 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 471 time to create 1 rle with old method : 0.0006515979766845703 length of segment : 28 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 733 time to create 1 rle with old method : 0.0009913444519042969 length of segment : 46 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 704 time to create 1 rle with old method : 0.0009860992431640625 length of segment : 33 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.0003285408020019531 length of segment : 21 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 710 time to create 1 rle with old method : 0.0009410381317138672 length of segment : 39 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 764 time to create 1 rle with old method : 0.001100778579711914 length of segment : 29 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 289 time to create 1 rle with old method : 0.00042700767517089844 length of segment : 25 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 602 time to create 1 rle with old method : 0.0008685588836669922 length of segment : 27 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.0003325939178466797 length of segment : 13 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 358 time to create 1 rle with old method : 0.0005044937133789062 length of segment : 26 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 178 time to create 1 rle with old method : 0.00028395652770996094 length of segment : 12 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 78 time to create 1 rle with old method : 0.00013828277587890625 length of segment : 13 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 527 time to create 1 rle with old method : 0.0007214546203613281 length of segment : 37 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 116 time to create 1 rle with old method : 0.00022101402282714844 length of segment : 9 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 2137 time to create 1 rle with old method : 0.0029325485229492188 length of segment : 68 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 405 time to create 1 rle with old method : 0.0005645751953125 length of segment : 32 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 346 time to create 1 rle with old method : 0.0004901885986328125 length of segment : 25 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 464 time to create 1 rle with old method : 0.0006415843963623047 length of segment : 26 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 61 time to create 1 rle with old method : 0.00012421607971191406 length of segment : 8 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 46 time to create 1 rle with old method : 0.00010275840759277344 length of segment : 7 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 746 time to create 1 rle with old method : 0.0010411739349365234 length of segment : 32 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 117 time to create 1 rle with old method : 0.0002148151397705078 length of segment : 28 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 203 time to create 1 rle with old method : 0.0002865791320800781 length of segment : 22 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 394 time to create 1 rle with old method : 0.0005736351013183594 length of segment : 45 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 4 time to create 1 rle with old method : 3.1948089599609375e-05 length of segment : 4 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 1132 time to create 1 rle with old method : 0.0015654563903808594 length of segment : 41 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 290 time to create 1 rle with old method : 0.0004475116729736328 length of segment : 26 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 301 time to create 1 rle with old method : 0.0005719661712646484 length of segment : 41 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 730 time to create 1 rle with old method : 0.0014116764068603516 length of segment : 43 time for calcul the mask position with numpy : 0.0001347064971923828 nb_pixel_total : 3731 time to create 1 rle with old method : 0.006505489349365234 length of segment : 89 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.00077056884765625 length of segment : 23 time for calcul the mask position with numpy : 9.560585021972656e-05 nb_pixel_total : 2235 time to create 1 rle with old method : 0.0046842098236083984 length of segment : 25 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 147.16250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 1657 time to create 1 rle with old method : 0.0022110939025878906 length of segment : 52 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 413 time to create 1 rle with old method : 0.0006325244903564453 length of segment : 27 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.0004191398620605469 length of segment : 18 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 219 time to create 1 rle with old method : 0.00035071372985839844 length of segment : 18 time for calcul the mask position with numpy : 7.796287536621094e-05 nb_pixel_total : 10 time to create 1 rle with old method : 3.981590270996094e-05 length of segment : 5 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 90 time to create 1 rle with old method : 0.00016641616821289062 length of segment : 10 time for calcul the mask position with numpy : 8.225440979003906e-05 nb_pixel_total : 216 time to create 1 rle with old method : 0.00034499168395996094 length of segment : 18 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.04766 max: 150.03750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 29 time to create 1 rle with old method : 7.724761962890625e-05 length of segment : 11 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 421 time to create 1 rle with old method : 0.0005807876586914062 length of segment : 29 time for calcul the mask position with numpy : 0.00010585784912109375 nb_pixel_total : 1428 time to create 1 rle with old method : 0.001924276351928711 length of segment : 78 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 55 time to create 1 rle with old method : 0.000110626220703125 length of segment : 14 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 1381 time to create 1 rle with old method : 0.001989126205444336 length of segment : 58 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.44219 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 330 time to create 1 rle with old method : 0.0005278587341308594 length of segment : 18 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 1111 time to create 1 rle with old method : 0.001600027084350586 length of segment : 25 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.48125 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 7.987022399902344e-05 nb_pixel_total : 5 time to create 1 rle with old method : 6.246566772460938e-05 length of segment : 2 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.86016 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.00014090538024902344 nb_pixel_total : 5945 time to create 1 rle with old method : 0.007621049880981445 length of segment : 79 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.13516 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 78 time to create 1 rle with old method : 0.0002048015594482422 length of segment : 8 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 512 time to create 1 rle with old method : 0.0009419918060302734 length of segment : 19 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 498 time to create 1 rle with old method : 0.0007441043853759766 length of segment : 22 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 789 time to create 1 rle with old method : 0.001039743423461914 length of segment : 76 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 1098 time to create 1 rle with old method : 0.0014336109161376953 length of segment : 40 time for calcul the mask position with numpy : 0.0005998611450195312 nb_pixel_total : 51816 time to create 1 rle with old method : 0.061760902404785156 length of segment : 248 time for calcul the mask position with numpy : 0.0007722377777099609 nb_pixel_total : 50547 time to create 1 rle with old method : 0.08377432823181152 length of segment : 232 Processing 1 images image shape: (400, 400, 3) min: 28.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -78.96172 max: 117.12188 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -104.55547 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 7.462501525878906e-05 nb_pixel_total : 1196 time to create 1 rle with old method : 0.001753091812133789 length of segment : 34 time for calcul the mask position with numpy : 7.414817810058594e-05 nb_pixel_total : 677 time to create 1 rle with old method : 0.0009648799896240234 length of segment : 28 time for calcul the mask position with numpy : 0.0003337860107421875 nb_pixel_total : 20277 time to create 1 rle with old method : 0.024552345275878906 length of segment : 129 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 478 time to create 1 rle with old method : 0.0007348060607910156 length of segment : 36 time for calcul the mask position with numpy : 8.082389831542969e-05 nb_pixel_total : 1624 time to create 1 rle with old method : 0.0022096633911132812 length of segment : 54 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.91875 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 303 time to create 1 rle with old method : 0.000457763671875 length of segment : 42 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 122 time to create 1 rle with old method : 0.00019788742065429688 length of segment : 12 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 153 time to create 1 rle with old method : 0.0002493858337402344 length of segment : 11 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 475 time to create 1 rle with old method : 0.0008053779602050781 length of segment : 13 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 235 time to create 1 rle with old method : 0.00036978721618652344 length of segment : 16 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 156 time to create 1 rle with old method : 0.0002574920654296875 length of segment : 16 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.00039768218994140625 length of segment : 17 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 858 time to create 1 rle with old method : 0.0011758804321289062 length of segment : 40 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.0003910064697265625 length of segment : 18 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 171 time to create 1 rle with old method : 0.00030493736267089844 length of segment : 19 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 134 time to create 1 rle with old method : 0.0002238750457763672 length of segment : 12 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.99688 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 8.368492126464844e-05 nb_pixel_total : 1410 time to create 1 rle with old method : 0.0017578601837158203 length of segment : 42 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 184 time to create 1 rle with old method : 0.0003082752227783203 length of segment : 18 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 479 time to create 1 rle with old method : 0.0007035732269287109 length of segment : 25 time for calcul the mask position with numpy : 0.00016689300537109375 nb_pixel_total : 9327 time to create 1 rle with old method : 0.011331319808959961 length of segment : 139 time for calcul the mask position with numpy : 0.00024056434631347656 nb_pixel_total : 13059 time to create 1 rle with old method : 0.01605987548828125 length of segment : 141 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 280 time to create 1 rle with old method : 0.0004355907440185547 length of segment : 22 time for calcul the mask position with numpy : 9.107589721679688e-05 nb_pixel_total : 845 time to create 1 rle with old method : 0.0015404224395751953 length of segment : 66 time for calcul the mask position with numpy : 0.00016808509826660156 nb_pixel_total : 2595 time to create 1 rle with old method : 0.00461268424987793 length of segment : 99 time for calcul the mask position with numpy : 0.00038313865661621094 nb_pixel_total : 10732 time to create 1 rle with old method : 0.015191078186035156 length of segment : 229 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 154 time to create 1 rle with old method : 0.0002758502960205078 length of segment : 10 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 531 time to create 1 rle with old method : 0.0007483959197998047 length of segment : 44 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 1052 time to create 1 rle with old method : 0.001424551010131836 length of segment : 31 time for calcul the mask position with numpy : 0.00020241737365722656 nb_pixel_total : 4948 time to create 1 rle with old method : 0.0060024261474609375 length of segment : 224 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 73 time to create 1 rle with old method : 0.00013208389282226562 length of segment : 14 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 109 time to create 1 rle with old method : 0.00022149085998535156 length of segment : 14 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 775 time to create 1 rle with old method : 0.000993490219116211 length of segment : 50 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 1620 time to create 1 rle with old method : 0.002110719680786133 length of segment : 82 Processing 1 images image shape: (280, 400, 3) min: 22.00000 max: 229.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 98.84844 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 572 time to create 1 rle with old method : 0.0008025169372558594 length of segment : 66 time for calcul the mask position with numpy : 0.0010046958923339844 nb_pixel_total : 105993 time to create 1 rle with old method : 0.1252150535583496 length of segment : 283 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 453 time to create 1 rle with old method : 0.0008258819580078125 length of segment : 29 time for calcul the mask position with numpy : 8.463859558105469e-05 nb_pixel_total : 1495 time to create 1 rle with old method : 0.0024614334106445312 length of segment : 81 time for calcul the mask position with numpy : 0.0001621246337890625 nb_pixel_total : 4243 time to create 1 rle with old method : 0.007149934768676758 length of segment : 91 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 175 time to create 1 rle with old method : 0.00047397613525390625 length of segment : 15 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 1093 time to create 1 rle with old method : 0.0021965503692626953 length of segment : 34 time for calcul the mask position with numpy : 8.487701416015625e-05 nb_pixel_total : 307 time to create 1 rle with old method : 0.0007767677307128906 length of segment : 37 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.00033736228942871094 length of segment : 15 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 299 time to create 1 rle with old method : 0.0005409717559814453 length of segment : 37 time for calcul the mask position with numpy : 7.271766662597656e-05 nb_pixel_total : 155 time to create 1 rle with old method : 0.0005834102630615234 length of segment : 13 time for calcul the mask position with numpy : 8.368492126464844e-05 nb_pixel_total : 1227 time to create 1 rle with old method : 0.0023365020751953125 length of segment : 39 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 27 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 376 time to create 1 rle with old method : 0.0005373954772949219 length of segment : 29 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 547 time to create 1 rle with old method : 0.000762939453125 length of segment : 32 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 680 time to create 1 rle with old method : 0.0009484291076660156 length of segment : 35 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 711 time to create 1 rle with old method : 0.0009655952453613281 length of segment : 39 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 210 time to create 1 rle with old method : 0.00031447410583496094 length of segment : 20 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.00021409988403320312 length of segment : 9 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 181 time to create 1 rle with old method : 0.0003001689910888672 length of segment : 13 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 772 time to create 1 rle with old method : 0.001508474349975586 length of segment : 28 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 194 time to create 1 rle with old method : 0.0004017353057861328 length of segment : 12 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 558 time to create 1 rle with old method : 0.0010960102081298828 length of segment : 21 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 50 time to create 1 rle with old method : 0.00013947486877441406 length of segment : 7 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 265 time to create 1 rle with old method : 0.0004992485046386719 length of segment : 23 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 319 time to create 1 rle with old method : 0.0006363391876220703 length of segment : 23 time for calcul the mask position with numpy : 9.489059448242188e-05 nb_pixel_total : 2113 time to create 1 rle with old method : 0.003885507583618164 length of segment : 72 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 730 time to create 1 rle with old method : 0.001346588134765625 length of segment : 39 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 1012 time to create 1 rle with old method : 0.0018229484558105469 length of segment : 46 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 555 time to create 1 rle with old method : 0.0010662078857421875 length of segment : 29 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 475 time to create 1 rle with old method : 0.0008831024169921875 length of segment : 29 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.0005123615264892578 length of segment : 32 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 452 time to create 1 rle with old method : 0.0008535385131835938 length of segment : 28 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 87 time to create 1 rle with old method : 0.000202178955078125 length of segment : 14 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 461 time to create 1 rle with old method : 0.0008175373077392578 length of segment : 31 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 505 time to create 1 rle with old method : 0.0006847381591796875 length of segment : 27 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 457 time to create 1 rle with old method : 0.0006368160247802734 length of segment : 27 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 186 time to create 1 rle with old method : 0.0002994537353515625 length of segment : 14 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 287 time to create 1 rle with old method : 0.0004420280456542969 length of segment : 17 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 758 time to create 1 rle with old method : 0.0010073184967041016 length of segment : 40 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 170 time to create 1 rle with old method : 0.0003008842468261719 length of segment : 20 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 468 time to create 1 rle with old method : 0.0006916522979736328 length of segment : 56 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 25 time to create 1 rle with old method : 9.775161743164062e-05 length of segment : 14 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 153 time to create 1 rle with old method : 0.00022125244140625 length of segment : 21 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 147 time to create 1 rle with old method : 0.00022840499877929688 length of segment : 17 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 260 time to create 1 rle with old method : 0.0004019737243652344 length of segment : 19 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 44 time to create 1 rle with old method : 0.0001354217529296875 length of segment : 11 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 144 time to create 1 rle with old method : 0.00033974647521972656 length of segment : 18 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 2103 time to create 1 rle with old method : 0.0029811859130859375 length of segment : 25 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 382 time to create 1 rle with old method : 0.0005381107330322266 length of segment : 27 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 387 time to create 1 rle with old method : 0.0005488395690917969 length of segment : 23 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 58 time to create 1 rle with old method : 9.512901306152344e-05 length of segment : 25 time for calcul the mask position with numpy : 8.106231689453125e-05 nb_pixel_total : 1189 time to create 1 rle with old method : 0.002334117889404297 length of segment : 72 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 217 time to create 1 rle with old method : 0.0003066062927246094 length of segment : 24 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 391 time to create 1 rle with old method : 0.0006268024444580078 length of segment : 24 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 144.72500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 515 time to create 1 rle with old method : 0.0007166862487792969 length of segment : 37 time for calcul the mask position with numpy : 7.581710815429688e-05 nb_pixel_total : 1618 time to create 1 rle with old method : 0.0022971630096435547 length of segment : 48 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 130 time to create 1 rle with old method : 0.00030684471130371094 length of segment : 35 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 168 time to create 1 rle with old method : 0.0002951622009277344 length of segment : 54 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 81 time to create 1 rle with old method : 0.000156402587890625 length of segment : 10 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 84 time to create 1 rle with old method : 0.0001571178436279297 length of segment : 10 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 212 time to create 1 rle with old method : 0.00033664703369140625 length of segment : 18 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.33281 max: 150.03750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 56 time to create 1 rle with old method : 0.00011396408081054688 length of segment : 18 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.0001544952392578125 length of segment : 26 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 474 time to create 1 rle with old method : 0.0006377696990966797 length of segment : 28 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 1541 time to create 1 rle with old method : 0.0020189285278320312 length of segment : 67 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 143 time to create 1 rle with old method : 0.00023484230041503906 length of segment : 28 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 420 time to create 1 rle with old method : 0.0005819797515869141 length of segment : 30 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.44609 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 703 time to create 1 rle with old method : 0.0010728836059570312 length of segment : 63 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 85 time to create 1 rle with old method : 0.00016069412231445312 length of segment : 13 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 326 time to create 1 rle with old method : 0.0005006790161132812 length of segment : 19 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 123 time to create 1 rle with old method : 0.00022220611572265625 length of segment : 12 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.95000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 170 time to create 1 rle with old method : 0.0003809928894042969 length of segment : 21 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.87969 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.00010657310485839844 nb_pixel_total : 5652 time to create 1 rle with old method : 0.00718379020690918 length of segment : 72 time for calcul the mask position with numpy : 0.0001983642578125 nb_pixel_total : 4743 time to create 1 rle with old method : 0.006529331207275391 length of segment : 143 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.31094 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 102 time to create 1 rle with old method : 0.0002009868621826172 length of segment : 11 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 507 time to create 1 rle with old method : 0.0007662773132324219 length of segment : 19 time for calcul the mask position with numpy : 0.00010943412780761719 nb_pixel_total : 1826 time to create 1 rle with old method : 0.003379344940185547 length of segment : 51 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 779 time to create 1 rle with old method : 0.0009617805480957031 length of segment : 75 time for calcul the mask position with numpy : 0.0004892349243164062 nb_pixel_total : 39847 time to create 1 rle with old method : 0.05821657180786133 length of segment : 285 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 500 time to create 1 rle with old method : 0.000993967056274414 length of segment : 18 time for calcul the mask position with numpy : 7.772445678710938e-05 nb_pixel_total : 1615 time to create 1 rle with old method : 0.0030410289764404297 length of segment : 53 Processing 1 images image shape: (400, 400, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -81.34844 max: 117.24297 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -103.67266 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.0003743171691894531 length of segment : 18 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003781318664550781 length of segment : 19 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 181 time to create 1 rle with old method : 0.0002772808074951172 length of segment : 15 time for calcul the mask position with numpy : 0.0002777576446533203 nb_pixel_total : 20243 time to create 1 rle with old method : 0.023579120635986328 length of segment : 129 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 147 time to create 1 rle with old method : 0.0002818107604980469 length of segment : 38 time for calcul the mask position with numpy : 6.413459777832031e-05 nb_pixel_total : 1281 time to create 1 rle with old method : 0.0018312931060791016 length of segment : 31 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 1601 time to create 1 rle with old method : 0.002209186553955078 length of segment : 51 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 346 time to create 1 rle with old method : 0.0005290508270263672 length of segment : 22 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 1436 time to create 1 rle with old method : 0.001920938491821289 length of segment : 51 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 177 time to create 1 rle with old method : 0.0002677440643310547 length of segment : 14 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -109.32891 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 311 time to create 1 rle with old method : 0.0004878044128417969 length of segment : 41 time for calcul the mask position with numpy : 2.7894973754882812e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.00016927719116210938 length of segment : 9 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 192 time to create 1 rle with old method : 0.0003037452697753906 length of segment : 19 time for calcul the mask position with numpy : 2.7894973754882812e-05 nb_pixel_total : 149 time to create 1 rle with old method : 0.00022101402282714844 length of segment : 10 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 306 time to create 1 rle with old method : 0.00043845176696777344 length of segment : 20 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.0002715587615966797 length of segment : 16 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.0004382133483886719 length of segment : 19 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 111 time to create 1 rle with old method : 0.00020647048950195312 length of segment : 8 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 873 time to create 1 rle with old method : 0.001043558120727539 length of segment : 40 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 473 time to create 1 rle with old method : 0.0007433891296386719 length of segment : 14 time for calcul the mask position with numpy : 2.765655517578125e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.00015807151794433594 length of segment : 16 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 707 time to create 1 rle with old method : 0.0009529590606689453 length of segment : 31 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 123 time to create 1 rle with old method : 0.00024127960205078125 length of segment : 11 time for calcul the mask position with numpy : 2.7418136596679688e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.00020265579223632812 length of segment : 12 time for calcul the mask position with numpy : 0.00010919570922851562 nb_pixel_total : 2877 time to create 1 rle with old method : 0.003621816635131836 length of segment : 154 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 142 time to create 1 rle with old method : 0.0002129077911376953 length of segment : 13 time for calcul the mask position with numpy : 0.0001087188720703125 nb_pixel_total : 3715 time to create 1 rle with old method : 0.004643917083740234 length of segment : 155 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.75859 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 210 time to create 1 rle with old method : 0.0003364086151123047 length of segment : 12 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 1357 time to create 1 rle with old method : 0.0018379688262939453 length of segment : 41 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 169 time to create 1 rle with old method : 0.00031256675720214844 length of segment : 17 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 844 time to create 1 rle with old method : 0.0011148452758789062 length of segment : 68 time for calcul the mask position with numpy : 0.0002129077911376953 nb_pixel_total : 11953 time to create 1 rle with old method : 0.01481008529663086 length of segment : 157 time for calcul the mask position with numpy : 0.000186920166015625 nb_pixel_total : 9490 time to create 1 rle with old method : 0.011610984802246094 length of segment : 143 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 455 time to create 1 rle with old method : 0.0006649494171142578 length of segment : 26 time for calcul the mask position with numpy : 0.000232696533203125 nb_pixel_total : 8230 time to create 1 rle with old method : 0.010405540466308594 length of segment : 221 time for calcul the mask position with numpy : 8.559226989746094e-05 nb_pixel_total : 2271 time to create 1 rle with old method : 0.0029010772705078125 length of segment : 98 time for calcul the mask position with numpy : 9.846687316894531e-05 nb_pixel_total : 1963 time to create 1 rle with old method : 0.002421855926513672 length of segment : 135 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 0.0002357959747314453 nb_pixel_total : 4840 time to create 1 rle with old method : 0.008180856704711914 length of segment : 226 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 81 time to create 1 rle with old method : 0.00013637542724609375 length of segment : 13 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.00019073486328125 length of segment : 15 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 1185 time to create 1 rle with old method : 0.0016689300537109375 length of segment : 33 length of segment : 0 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 759 time to create 1 rle with old method : 0.0010020732879638672 length of segment : 50 time for calcul the mask position with numpy : 6.67572021484375e-05 nb_pixel_total : 1593 time to create 1 rle with old method : 0.0020377635955810547 length of segment : 83 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 1107 time to create 1 rle with old method : 0.001405954360961914 length of segment : 44 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 1083 time to create 1 rle with old method : 0.001529693603515625 length of segment : 32 Processing 1 images image shape: (280, 400, 3) min: 22.00000 max: 230.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 101.30547 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009143352508544922 nb_pixel_total : 106705 time to create 1 rle with old method : 0.12415695190429688 length of segment : 284 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 498 time to create 1 rle with old method : 0.0006978511810302734 length of segment : 30 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 1582 time to create 1 rle with old method : 0.002033710479736328 length of segment : 83 time for calcul the mask position with numpy : 9.417533874511719e-05 nb_pixel_total : 3248 time to create 1 rle with old method : 0.004258394241333008 length of segment : 96 time for calcul the mask position with numpy : 0.0002129077911376953 nb_pixel_total : 624 time to create 1 rle with old method : 0.0012679100036621094 length of segment : 35 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 1161 time to create 1 rle with old method : 0.0021514892578125 length of segment : 40 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 67 time to create 1 rle with old method : 0.00019049644470214844 length of segment : 10 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 943 time to create 1 rle with old method : 0.0016963481903076172 length of segment : 50 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 1530 time to create 1 rle with old method : 0.002050638198852539 length of segment : 36 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 359 time to create 1 rle with old method : 0.0004851818084716797 length of segment : 36 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.00026035308837890625 length of segment : 15 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 271 time to create 1 rle with old method : 0.00041413307189941406 length of segment : 20 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 1217 time to create 1 rle with old method : 0.00152587890625 length of segment : 42 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 263 time to create 1 rle with old method : 0.00039768218994140625 length of segment : 28 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 121 time to create 1 rle with old method : 0.00019288063049316406 length of segment : 11 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 456 time to create 1 rle with old method : 0.0006456375122070312 length of segment : 23 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 26 time for calcul the mask position with numpy : 6.985664367675781e-05 nb_pixel_total : 722 time to create 1 rle with old method : 0.0009937286376953125 length of segment : 40 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 385 time to create 1 rle with old method : 0.0005524158477783203 length of segment : 29 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003762245178222656 length of segment : 22 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 178 time to create 1 rle with old method : 0.0002868175506591797 length of segment : 13 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 699 time to create 1 rle with old method : 0.0010142326354980469 length of segment : 32 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 512 time to create 1 rle with old method : 0.0007450580596923828 length of segment : 24 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 187 time to create 1 rle with old method : 0.0003058910369873047 length of segment : 12 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 60 time to create 1 rle with old method : 0.00012612342834472656 length of segment : 9 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 110 time to create 1 rle with old method : 0.0002079010009765625 length of segment : 8 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 475 time to create 1 rle with old method : 0.0007731914520263672 length of segment : 32 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 667 time to create 1 rle with old method : 0.0012004375457763672 length of segment : 30 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 89 time to create 1 rle with old method : 0.00016260147094726562 length of segment : 13 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 586 time to create 1 rle with old method : 0.0008645057678222656 length of segment : 21 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 295 time to create 1 rle with old method : 0.0004112720489501953 length of segment : 26 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 771 time to create 1 rle with old method : 0.001032114028930664 length of segment : 40 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 443 time to create 1 rle with old method : 0.0005965232849121094 length of segment : 26 time for calcul the mask position with numpy : 8.440017700195312e-05 nb_pixel_total : 1971 time to create 1 rle with old method : 0.003245115280151367 length of segment : 67 time for calcul the mask position with numpy : 8.726119995117188e-05 nb_pixel_total : 3250 time to create 1 rle with old method : 0.004150390625 length of segment : 58 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.00042176246643066406 length of segment : 18 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 775 time to create 1 rle with old method : 0.001079559326171875 length of segment : 30 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 274 time to create 1 rle with old method : 0.00039696693420410156 length of segment : 16 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 288 time to create 1 rle with old method : 0.0003972053527832031 length of segment : 27 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 92 time to create 1 rle with old method : 0.00014901161193847656 length of segment : 15 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 1331 time to create 1 rle with old method : 0.0017094612121582031 length of segment : 59 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 271 time to create 1 rle with old method : 0.0003981590270996094 length of segment : 15 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 898 time to create 1 rle with old method : 0.0011832714080810547 length of segment : 44 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 120 time to create 1 rle with old method : 0.00022745132446289062 length of segment : 36 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 160 time to create 1 rle with old method : 0.00026035308837890625 length of segment : 19 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.0003845691680908203 length of segment : 24 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 460 time to create 1 rle with old method : 0.0006871223449707031 length of segment : 53 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.0002956390380859375 length of segment : 25 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 173 time to create 1 rle with old method : 0.0002605915069580078 length of segment : 16 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 727 time to create 1 rle with old method : 0.0009448528289794922 length of segment : 41 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 389 time to create 1 rle with old method : 0.0005562305450439453 length of segment : 24 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 1813 time to create 1 rle with old method : 0.0025186538696289062 length of segment : 40 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.22500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 7.557868957519531e-05 nb_pixel_total : 1573 time to create 1 rle with old method : 0.002644777297973633 length of segment : 54 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.000377655029296875 length of segment : 30 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 551 time to create 1 rle with old method : 0.0013167858123779297 length of segment : 39 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 46 time to create 1 rle with old method : 0.00015616416931152344 length of segment : 14 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 80 time to create 1 rle with old method : 0.0002560615539550781 length of segment : 10 time for calcul the mask position with numpy : 8.416175842285156e-05 nb_pixel_total : 19 time to create 1 rle with old method : 9.72747802734375e-05 length of segment : 11 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.26641 max: 150.03750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 30 time to create 1 rle with old method : 9.918212890625e-05 length of segment : 12 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 401 time to create 1 rle with old method : 0.0007545948028564453 length of segment : 27 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 107 time to create 1 rle with old method : 0.00022459030151367188 length of segment : 24 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 1531 time to create 1 rle with old method : 0.001992940902709961 length of segment : 66 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 46 time to create 1 rle with old method : 0.00010991096496582031 length of segment : 16 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.0003561973571777344 length of segment : 47 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.54766 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 148 time to create 1 rle with old method : 0.00022983551025390625 length of segment : 33 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.00030517578125 length of segment : 16 time for calcul the mask position with numpy : 0.000118255615234375 nb_pixel_total : 5715 time to create 1 rle with old method : 0.0073130130767822266 length of segment : 76 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 457 time to create 1 rle with old method : 0.0006792545318603516 length of segment : 21 time for calcul the mask position with numpy : 0.00047469139099121094 nb_pixel_total : 16373 time to create 1 rle with old method : 0.020017623901367188 length of segment : 432 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.78203 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 819 time to create 1 rle with old method : 0.0011243820190429688 length of segment : 44 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.29375 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 9.393692016601562e-05 nb_pixel_total : 4876 time to create 1 rle with old method : 0.006119728088378906 length of segment : 70 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.58437 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 496 time to create 1 rle with old method : 0.0007345676422119141 length of segment : 19 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 81 time to create 1 rle with old method : 0.00016236305236816406 length of segment : 9 time for calcul the mask position with numpy : 0.00048542022705078125 nb_pixel_total : 44047 time to create 1 rle with old method : 0.0496370792388916 length of segment : 204 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 698 time to create 1 rle with old method : 0.0008795261383056641 length of segment : 65 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 1146 time to create 1 rle with old method : 0.0015416145324707031 length of segment : 30 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 1260 time to create 1 rle with old method : 0.0016744136810302734 length of segment : 33 Processing 1 images image shape: (400, 400, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -75.76250 max: 117.53594 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0013306140899658203 nb_pixel_total : 153077 time to create 1 rle with new method : 0.002041339874267578 length of segment : 395 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -101.50859 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 356 time to create 1 rle with old method : 0.0006203651428222656 length of segment : 19 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 1279 time to create 1 rle with old method : 0.0017969608306884766 length of segment : 40 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.0002834796905517578 length of segment : 44 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 538 time to create 1 rle with old method : 0.0007784366607666016 length of segment : 37 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 406 time to create 1 rle with old method : 0.0010197162628173828 length of segment : 26 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.00040912628173828125 length of segment : 28 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 69 time to create 1 rle with old method : 0.00013446807861328125 length of segment : 11 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 656 time to create 1 rle with old method : 0.000982522964477539 length of segment : 30 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 1321 time to create 1 rle with old method : 0.0018072128295898438 length of segment : 37 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.48906 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 315 time to create 1 rle with old method : 0.00047397613525390625 length of segment : 41 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.0001926422119140625 length of segment : 10 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 138 time to create 1 rle with old method : 0.00021886825561523438 length of segment : 10 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 358 time to create 1 rle with old method : 0.0005025863647460938 length of segment : 23 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 157 time to create 1 rle with old method : 0.00025343894958496094 length of segment : 16 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 1272 time to create 1 rle with old method : 0.0017185211181640625 length of segment : 31 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 163 time to create 1 rle with old method : 0.0002627372741699219 length of segment : 17 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 668 time to create 1 rle with old method : 0.0009684562683105469 length of segment : 36 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 850 time to create 1 rle with old method : 0.001115560531616211 length of segment : 40 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 303 time to create 1 rle with old method : 0.0006761550903320312 length of segment : 11 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 565 time to create 1 rle with old method : 0.0011589527130126953 length of segment : 31 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.0002028942108154297 length of segment : 10 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 224 time to create 1 rle with old method : 0.00038313865661621094 length of segment : 14 time for calcul the mask position with numpy : 0.00017142295837402344 nb_pixel_total : 3130 time to create 1 rle with old method : 0.00449061393737793 length of segment : 163 time for calcul the mask position with numpy : 0.00018930435180664062 nb_pixel_total : 3885 time to create 1 rle with old method : 0.006666660308837891 length of segment : 173 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.16875 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.0003402233123779297 length of segment : 11 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 1424 time to create 1 rle with old method : 0.0018165111541748047 length of segment : 41 time for calcul the mask position with numpy : 0.0001647472381591797 nb_pixel_total : 8972 time to create 1 rle with old method : 0.010894775390625 length of segment : 155 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 185 time to create 1 rle with old method : 0.00032329559326171875 length of segment : 18 time for calcul the mask position with numpy : 0.00030517578125 nb_pixel_total : 12982 time to create 1 rle with old method : 0.016231060028076172 length of segment : 144 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 262 time to create 1 rle with old method : 0.0004718303680419922 length of segment : 23 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 531 time to create 1 rle with old method : 0.0007963180541992188 length of segment : 25 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 633 time to create 1 rle with old method : 0.0008194446563720703 length of segment : 64 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 0.00018715858459472656 nb_pixel_total : 4598 time to create 1 rle with old method : 0.005755186080932617 length of segment : 224 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 80 time to create 1 rle with old method : 0.00014734268188476562 length of segment : 13 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 933 time to create 1 rle with old method : 0.0013911724090576172 length of segment : 30 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 1271 time to create 1 rle with old method : 0.001638650894165039 length of segment : 53 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 752 time to create 1 rle with old method : 0.001018524169921875 length of segment : 49 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 1073 time to create 1 rle with old method : 0.0015289783477783203 length of segment : 32 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 91 time to create 1 rle with old method : 0.0001633167266845703 length of segment : 11 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 1013 time to create 1 rle with old method : 0.0014240741729736328 length of segment : 30 time for calcul the mask position with numpy : 0.00010704994201660156 nb_pixel_total : 1638 time to create 1 rle with old method : 0.0019884109497070312 length of segment : 83 Processing 1 images image shape: (280, 400, 3) min: 22.00000 max: 230.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 96.50859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 438 time to create 1 rle with old method : 0.0006353855133056641 length of segment : 47 time for calcul the mask position with numpy : 0.0009641647338867188 nb_pixel_total : 106441 time to create 1 rle with old method : 0.12546586990356445 length of segment : 281 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 1482 time to create 1 rle with old method : 0.0018672943115234375 length of segment : 81 time for calcul the mask position with numpy : 0.0001163482666015625 nb_pixel_total : 3379 time to create 1 rle with old method : 0.00499272346496582 length of segment : 98 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 482 time to create 1 rle with old method : 0.0006711483001708984 length of segment : 30 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 407 time to create 1 rle with old method : 0.0005848407745361328 length of segment : 22 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 176 time to create 1 rle with old method : 0.0002872943878173828 length of segment : 30 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 216 time to create 1 rle with old method : 0.00032901763916015625 length of segment : 15 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 1161 time to create 1 rle with old method : 0.0015473365783691406 length of segment : 41 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 170 time to create 1 rle with old method : 0.00035071372985839844 length of segment : 15 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 969 time to create 1 rle with old method : 0.0017547607421875 length of segment : 51 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 1189 time to create 1 rle with old method : 0.0021636486053466797 length of segment : 42 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 363 time to create 1 rle with old method : 0.0006742477416992188 length of segment : 38 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 549 time to create 1 rle with old method : 0.001020193099975586 length of segment : 31 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 1251 time to create 1 rle with old method : 0.0023043155670166016 length of segment : 38 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 157 time to create 1 rle with old method : 0.00033092498779296875 length of segment : 14 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 664 time to create 1 rle with old method : 0.0012614727020263672 length of segment : 32 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 475 time to create 1 rle with old method : 0.0009095668792724609 length of segment : 25 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 24 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 511 time to create 1 rle with old method : 0.0006945133209228516 length of segment : 30 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 760 time to create 1 rle with old method : 0.0010101795196533203 length of segment : 36 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 750 time to create 1 rle with old method : 0.0009899139404296875 length of segment : 42 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 388 time to create 1 rle with old method : 0.0005271434783935547 length of segment : 29 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 480 time to create 1 rle with old method : 0.0006890296936035156 length of segment : 25 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.000377655029296875 length of segment : 23 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.00037789344787597656 length of segment : 24 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 710 time to create 1 rle with old method : 0.0009059906005859375 length of segment : 40 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 97 time to create 1 rle with old method : 0.00019121170043945312 length of segment : 8 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 176 time to create 1 rle with old method : 0.00028395652770996094 length of segment : 13 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 189 time to create 1 rle with old method : 0.0002980232238769531 length of segment : 12 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 595 time to create 1 rle with old method : 0.0008158683776855469 length of segment : 43 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 505 time to create 1 rle with old method : 0.0007047653198242188 length of segment : 34 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 59 time to create 1 rle with old method : 0.00011348724365234375 length of segment : 9 time for calcul the mask position with numpy : 2.9087066650390625e-05 nb_pixel_total : 82 time to create 1 rle with old method : 0.00014138221740722656 length of segment : 13 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 1660 time to create 1 rle with old method : 0.0020592212677001953 length of segment : 46 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 579 time to create 1 rle with old method : 0.0008530616760253906 length of segment : 19 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003521442413330078 length of segment : 29 time for calcul the mask position with numpy : 2.7894973754882812e-05 nb_pixel_total : 42 time to create 1 rle with old method : 9.584426879882812e-05 length of segment : 4 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 793 time to create 1 rle with old method : 0.001619577407836914 length of segment : 36 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 441 time to create 1 rle with old method : 0.0008254051208496094 length of segment : 33 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 434 time to create 1 rle with old method : 0.0008039474487304688 length of segment : 27 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 273 time to create 1 rle with old method : 0.0005469322204589844 length of segment : 16 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 569 time to create 1 rle with old method : 0.0010039806365966797 length of segment : 34 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.85391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 421 time to create 1 rle with old method : 0.0006513595581054688 length of segment : 68 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 493 time to create 1 rle with old method : 0.0007429122924804688 length of segment : 57 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.0004036426544189453 length of segment : 25 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 1436 time to create 1 rle with old method : 0.001771688461303711 length of segment : 45 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 227 time to create 1 rle with old method : 0.0005080699920654297 length of segment : 21 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 279 time to create 1 rle with old method : 0.0004863739013671875 length of segment : 32 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 663 time to create 1 rle with old method : 0.0008635520935058594 length of segment : 41 time for calcul the mask position with numpy : 8.440017700195312e-05 nb_pixel_total : 3808 time to create 1 rle with old method : 0.004892110824584961 length of segment : 88 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 589 time to create 1 rle with old method : 0.0008056163787841797 length of segment : 27 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 1051 time to create 1 rle with old method : 0.0014028549194335938 length of segment : 51 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 236 time to create 1 rle with old method : 0.00036907196044921875 length of segment : 18 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 384 time to create 1 rle with old method : 0.0005540847778320312 length of segment : 24 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 398 time to create 1 rle with old method : 0.0005788803100585938 length of segment : 24 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.85000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 1549 time to create 1 rle with old method : 0.0019845962524414062 length of segment : 53 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 477 time to create 1 rle with old method : 0.0006489753723144531 length of segment : 31 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 121 time to create 1 rle with old method : 0.0002620220184326172 length of segment : 30 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.0003266334533691406 length of segment : 17 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 84 time to create 1 rle with old method : 0.000148773193359375 length of segment : 10 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 105 time to create 1 rle with old method : 0.00020170211791992188 length of segment : 34 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.00020933151245117188 length of segment : 45 Detection mask done ! Trying to reset tf kernel 2287092 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 2494 tf kernel not reseted sub process len(results) : 480 len(list_Values) 480 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 480 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 3687 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 480 chid ids of type : 4228 Number RLEs to save : 22052 save missing photos in datou_result : time spend for datou_step_exec : 32.10595464706421 time spend to save output : 1.8592984676361084 total time spend for step 1 : 33.96525311470032 step2:brightness Sat Feb 1 00:21:03 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1738365629_2286560_1333488441_fef3929a38b106c8c624126a41ccdfc4.jpg treat image : temp/1738365629_2286560_1333488416_7485a38e26da6c1f376789b883702231.jpg treat image : temp/1738365629_2286560_1333488413_2da8f9667c525bdc27091c85d0eba5a6.jpg treat image : temp/1738365629_2286560_1333488345_e852004712e8b0326d95067d4b491b69.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.011673450469970703 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 0.012622356414794922 save missing photos in datou_result : time spend for datou_step_exec : 1.0389530658721924 time spend to save output : 0.028774023056030273 total time spend for step 2 : 1.0677270889282227 step3:blur_detection Sat Feb 1 00:21:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1738365629_2286560_1333488441_fef3929a38b106c8c624126a41ccdfc4.jpg resize: (1080, 1920) 1333488441 -8.312087350845452 treat image : temp/1738365629_2286560_1333488416_7485a38e26da6c1f376789b883702231.jpg resize: (1080, 1920) 1333488416 -8.310477020277615 treat image : temp/1738365629_2286560_1333488413_2da8f9667c525bdc27091c85d0eba5a6.jpg resize: (1080, 1920) 1333488413 -8.307047131537074 treat image : temp/1738365629_2286560_1333488345_e852004712e8b0326d95067d4b491b69.jpg resize: (1080, 1920) 1333488345 -8.30179451149958 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 4 time used for this insertion : 0.015043258666992188 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 4 time used for this insertion : 0.01736164093017578 save missing photos in datou_result : time spend for datou_step_exec : 4.104166269302368 time spend to save output : 0.037087440490722656 total time spend for step 3 : 4.141253709793091 step4:rle_unique_nms_with_priority Sat Feb 1 00:21:08 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 480 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 123 nb_hashtags : 6 time to prepare the origin masks : 0.9626996517181396 time for calcul the mask position with numpy : 0.05275678634643555 nb_pixel_total : 1883904 time to create 1 rle with new method : 0.2021348476409912 time for calcul the mask position with numpy : 0.008285045623779297 nb_pixel_total : 20 time to create 1 rle with old method : 6.4849853515625e-05 time for calcul the mask position with numpy : 0.00787353515625 nb_pixel_total : 16311 time to create 1 rle with old method : 0.01729607582092285 time for calcul the mask position with numpy : 0.007907390594482422 nb_pixel_total : 314 time to create 1 rle with old method : 0.0003314018249511719 time for calcul the mask position with numpy : 0.007759571075439453 nb_pixel_total : 1173 time to create 1 rle with old method : 0.0012249946594238281 time for calcul the mask position with numpy : 0.007723569869995117 nb_pixel_total : 100 time to create 1 rle with old method : 0.0001544952392578125 time for calcul the mask position with numpy : 0.0077555179595947266 nb_pixel_total : 23 time to create 1 rle with old method : 3.24249267578125e-05 time for calcul the mask position with numpy : 0.007893085479736328 nb_pixel_total : 432 time to create 1 rle with old method : 0.00045990943908691406 time for calcul the mask position with numpy : 0.007849693298339844 nb_pixel_total : 100 time to create 1 rle with old method : 0.00011444091796875 time for calcul the mask position with numpy : 0.0076105594635009766 nb_pixel_total : 2900 time to create 1 rle with old method : 0.003145933151245117 time for calcul the mask position with numpy : 0.007781505584716797 nb_pixel_total : 47383 time to create 1 rle with old method : 0.050644636154174805 time for calcul the mask position with numpy : 0.008273839950561523 nb_pixel_total : 15691 time to create 1 rle with old method : 0.017107248306274414 time for calcul the mask position with numpy : 0.0081939697265625 nb_pixel_total : 79 time to create 1 rle with old method : 9.632110595703125e-05 time for calcul the mask position with numpy : 0.008093118667602539 nb_pixel_total : 218 time to create 1 rle with old method : 0.0002675056457519531 time for calcul the mask position with numpy : 0.007773160934448242 nb_pixel_total : 648 time to create 1 rle with old method : 0.0006806850433349609 time for calcul the mask position with numpy : 0.007753133773803711 nb_pixel_total : 332 time to create 1 rle with old method : 0.0003921985626220703 time for calcul the mask position with numpy : 0.00783991813659668 nb_pixel_total : 437 time to create 1 rle with old method : 0.0004973411560058594 time for calcul the mask position with numpy : 0.007660865783691406 nb_pixel_total : 429 time to create 1 rle with old method : 0.0004742145538330078 time for calcul the mask position with numpy : 0.007694721221923828 nb_pixel_total : 202 time to create 1 rle with old method : 0.00021958351135253906 time for calcul the mask position with numpy : 0.007658243179321289 nb_pixel_total : 3496 time to create 1 rle with old method : 0.003683328628540039 time for calcul the mask position with numpy : 0.00780034065246582 nb_pixel_total : 6208 time to create 1 rle with old method : 0.007173061370849609 time for calcul the mask position with numpy : 0.00811624526977539 nb_pixel_total : 17 time to create 1 rle with old method : 3.5762786865234375e-05 time for calcul the mask position with numpy : 0.00814509391784668 nb_pixel_total : 330 time to create 1 rle with old method : 0.0003802776336669922 time for calcul the mask position with numpy : 0.00802469253540039 nb_pixel_total : 85 time to create 1 rle with old method : 0.00010132789611816406 time for calcul the mask position with numpy : 0.007858514785766602 nb_pixel_total : 1334 time to create 1 rle with old method : 0.0015287399291992188 time for calcul the mask position with numpy : 0.007912635803222656 nb_pixel_total : 203 time to create 1 rle with old method : 0.00023508071899414062 time for calcul the mask position with numpy : 0.007952213287353516 nb_pixel_total : 2832 time to create 1 rle with old method : 0.0030536651611328125 time for calcul the mask position with numpy : 0.007840394973754883 nb_pixel_total : 390 time to create 1 rle with old method : 0.00042247772216796875 time for calcul the mask position with numpy : 0.00785207748413086 nb_pixel_total : 61 time to create 1 rle with old method : 9.059906005859375e-05 time for calcul the mask position with numpy : 0.00773167610168457 nb_pixel_total : 499 time to create 1 rle with old method : 0.0005342960357666016 time for calcul the mask position with numpy : 0.007848501205444336 nb_pixel_total : 166 time to create 1 rle with old method : 0.0001823902130126953 time for calcul the mask position with numpy : 0.008049964904785156 nb_pixel_total : 9599 time to create 1 rle with old method : 0.010225534439086914 time for calcul the mask position with numpy : 0.008197307586669922 nb_pixel_total : 4784 time to create 1 rle with old method : 0.005339622497558594 time for calcul the mask position with numpy : 0.007993221282958984 nb_pixel_total : 3235 time to create 1 rle with old method : 0.0037832260131835938 time for calcul the mask position with numpy : 0.008209228515625 nb_pixel_total : 201 time to create 1 rle with old method : 0.0002720355987548828 time for calcul the mask position with numpy : 0.008260965347290039 nb_pixel_total : 862 time to create 1 rle with old method : 0.0009799003601074219 time for calcul the mask position with numpy : 0.00800776481628418 nb_pixel_total : 70 time to create 1 rle with old method : 0.0001614093780517578 time for calcul the mask position with numpy : 0.007991552352905273 nb_pixel_total : 9143 time to create 1 rle with old method : 0.009415388107299805 time for calcul the mask position with numpy : 0.007976770401000977 nb_pixel_total : 336 time to create 1 rle with old method : 0.00040221214294433594 time for calcul the mask position with numpy : 0.008056879043579102 nb_pixel_total : 3356 time to create 1 rle with old method : 0.0038568973541259766 time for calcul the mask position with numpy : 0.009914159774780273 nb_pixel_total : 1471 time to create 1 rle with old method : 0.0016078948974609375 time for calcul the mask position with numpy : 0.008159160614013672 nb_pixel_total : 776 time to create 1 rle with old method : 0.0009164810180664062 time for calcul the mask position with numpy : 0.008057832717895508 nb_pixel_total : 2274 time to create 1 rle with old method : 0.0026390552520751953 time for calcul the mask position with numpy : 0.008452415466308594 nb_pixel_total : 344 time to create 1 rle with old method : 0.0005159378051757812 time for calcul the mask position with numpy : 0.009076595306396484 nb_pixel_total : 4656 time to create 1 rle with old method : 0.005069732666015625 time for calcul the mask position with numpy : 0.0077970027923583984 nb_pixel_total : 56 time to create 1 rle with old method : 6.4849853515625e-05 time for calcul the mask position with numpy : 0.007713794708251953 nb_pixel_total : 118 time to create 1 rle with old method : 0.00013446807861328125 time for calcul the mask position with numpy : 0.00774836540222168 nb_pixel_total : 114 time to create 1 rle with old method : 0.00014090538024902344 time for calcul the mask position with numpy : 0.007925033569335938 nb_pixel_total : 195 time to create 1 rle with old method : 0.0002079010009765625 time for calcul the mask position with numpy : 0.008250951766967773 nb_pixel_total : 55 time to create 1 rle with old method : 0.00010538101196289062 time for calcul the mask position with numpy : 0.008261442184448242 nb_pixel_total : 813 time to create 1 rle with old method : 0.0009222030639648438 time for calcul the mask position with numpy : 0.008210897445678711 nb_pixel_total : 184 time to create 1 rle with old method : 0.00021529197692871094 time for calcul the mask position with numpy : 0.008040904998779297 nb_pixel_total : 331 time to create 1 rle with old method : 0.0004107952117919922 time for calcul the mask position with numpy : 0.008306026458740234 nb_pixel_total : 1226 time to create 1 rle with old method : 0.001436471939086914 time for calcul the mask position with numpy : 0.007957935333251953 nb_pixel_total : 148 time to create 1 rle with old method : 0.00015854835510253906 time for calcul the mask position with numpy : 0.008223772048950195 nb_pixel_total : 266 time to create 1 rle with old method : 0.0003058910369873047 time for calcul the mask position with numpy : 0.008007526397705078 nb_pixel_total : 294 time to create 1 rle with old method : 0.0003159046173095703 time for calcul the mask position with numpy : 0.007982730865478516 nb_pixel_total : 1661 time to create 1 rle with old method : 0.0017685890197753906 time for calcul the mask position with numpy : 0.0077250003814697266 nb_pixel_total : 584 time to create 1 rle with old method : 0.0006635189056396484 time for calcul the mask position with numpy : 0.00785207748413086 nb_pixel_total : 8 time to create 1 rle with old method : 2.47955322265625e-05 time for calcul the mask position with numpy : 0.008348464965820312 nb_pixel_total : 130 time to create 1 rle with old method : 0.0001666545867919922 time for calcul the mask position with numpy : 0.007986068725585938 nb_pixel_total : 1452 time to create 1 rle with old method : 0.0015859603881835938 time for calcul the mask position with numpy : 0.008098602294921875 nb_pixel_total : 366 time to create 1 rle with old method : 0.0004124641418457031 time for calcul the mask position with numpy : 0.007927179336547852 nb_pixel_total : 159 time to create 1 rle with old method : 0.00017690658569335938 time for calcul the mask position with numpy : 0.008234500885009766 nb_pixel_total : 329 time to create 1 rle with old method : 0.00040030479431152344 time for calcul the mask position with numpy : 0.008048772811889648 nb_pixel_total : 187 time to create 1 rle with old method : 0.0002224445343017578 time for calcul the mask position with numpy : 0.008376836776733398 nb_pixel_total : 142 time to create 1 rle with old method : 0.00023412704467773438 time for calcul the mask position with numpy : 0.008172273635864258 nb_pixel_total : 877 time to create 1 rle with old method : 0.000997304916381836 time for calcul the mask position with numpy : 0.008382081985473633 nb_pixel_total : 197 time to create 1 rle with old method : 0.00024008750915527344 time for calcul the mask position with numpy : 0.008475780487060547 nb_pixel_total : 114 time to create 1 rle with old method : 0.00015592575073242188 time for calcul the mask position with numpy : 0.008285999298095703 nb_pixel_total : 394 time to create 1 rle with old method : 0.00046062469482421875 time for calcul the mask position with numpy : 0.00823974609375 nb_pixel_total : 226 time to create 1 rle with old method : 0.000293731689453125 time for calcul the mask position with numpy : 0.008734703063964844 nb_pixel_total : 1657 time to create 1 rle with old method : 0.003362417221069336 time for calcul the mask position with numpy : 0.010454654693603516 nb_pixel_total : 1132 time to create 1 rle with old method : 0.0016095638275146484 time for calcul the mask position with numpy : 0.008208751678466797 nb_pixel_total : 10 time to create 1 rle with old method : 1.9788742065429688e-05 time for calcul the mask position with numpy : 0.007930278778076172 nb_pixel_total : 764 time to create 1 rle with old method : 0.0008726119995117188 time for calcul the mask position with numpy : 0.008097410202026367 nb_pixel_total : 1262 time to create 1 rle with old method : 0.0015301704406738281 time for calcul the mask position with numpy : 0.008147001266479492 nb_pixel_total : 396 time to create 1 rle with old method : 0.0004527568817138672 time for calcul the mask position with numpy : 0.008213281631469727 nb_pixel_total : 64 time to create 1 rle with old method : 0.00011491775512695312 time for calcul the mask position with numpy : 0.008358478546142578 nb_pixel_total : 59 time to create 1 rle with old method : 0.00010585784912109375 time for calcul the mask position with numpy : 0.008414983749389648 nb_pixel_total : 704 time to create 1 rle with old method : 0.0008370876312255859 time for calcul the mask position with numpy : 0.008285284042358398 nb_pixel_total : 190 time to create 1 rle with old method : 0.00023221969604492188 time for calcul the mask position with numpy : 0.008206367492675781 nb_pixel_total : 390 time to create 1 rle with old method : 0.00047206878662109375 time for calcul the mask position with numpy : 0.008096694946289062 nb_pixel_total : 3731 time to create 1 rle with old method : 0.004057884216308594 time for calcul the mask position with numpy : 0.008214950561523438 nb_pixel_total : 90 time to create 1 rle with old method : 0.00010251998901367188 time for calcul the mask position with numpy : 0.008243083953857422 nb_pixel_total : 464 time to create 1 rle with old method : 0.0005574226379394531 time for calcul the mask position with numpy : 0.008236885070800781 nb_pixel_total : 403 time to create 1 rle with old method : 0.0004665851593017578 time for calcul the mask position with numpy : 0.008269548416137695 nb_pixel_total : 78 time to create 1 rle with old method : 9.942054748535156e-05 time for calcul the mask position with numpy : 0.008226156234741211 nb_pixel_total : 59 time to create 1 rle with old method : 8.463859558105469e-05 time for calcul the mask position with numpy : 0.008320331573486328 nb_pixel_total : 733 time to create 1 rle with old method : 0.0008802413940429688 time for calcul the mask position with numpy : 0.008122444152832031 nb_pixel_total : 602 time to create 1 rle with old method : 0.0007345676422119141 time for calcul the mask position with numpy : 0.008347511291503906 nb_pixel_total : 494 time to create 1 rle with old method : 0.0005822181701660156 time for calcul the mask position with numpy : 0.008041143417358398 nb_pixel_total : 452 time to create 1 rle with old method : 0.0005447864532470703 time for calcul the mask position with numpy : 0.007814168930053711 nb_pixel_total : 192 time to create 1 rle with old method : 0.0002110004425048828 time for calcul the mask position with numpy : 0.007951974868774414 nb_pixel_total : 413 time to create 1 rle with old method : 0.0004570484161376953 time for calcul the mask position with numpy : 0.008119344711303711 nb_pixel_total : 3035 time to create 1 rle with old method : 0.003324270248413086 time for calcul the mask position with numpy : 0.008116960525512695 nb_pixel_total : 710 time to create 1 rle with old method : 0.0007846355438232422 time for calcul the mask position with numpy : 0.008152246475219727 nb_pixel_total : 117 time to create 1 rle with old method : 0.00015115737915039062 time for calcul the mask position with numpy : 0.00840306282043457 nb_pixel_total : 730 time to create 1 rle with old method : 0.0008633136749267578 time for calcul the mask position with numpy : 0.008234024047851562 nb_pixel_total : 165 time to create 1 rle with old method : 0.0001976490020751953 time for calcul the mask position with numpy : 0.008381128311157227 nb_pixel_total : 8 time to create 1 rle with old method : 3.0994415283203125e-05 time for calcul the mask position with numpy : 0.008394002914428711 nb_pixel_total : 219 time to create 1 rle with old method : 0.0002789497375488281 time for calcul the mask position with numpy : 0.00828409194946289 nb_pixel_total : 358 time to create 1 rle with old method : 0.0004203319549560547 time for calcul the mask position with numpy : 0.00834202766418457 nb_pixel_total : 949 time to create 1 rle with old method : 0.0010690689086914062 time for calcul the mask position with numpy : 0.008469104766845703 nb_pixel_total : 301 time to create 1 rle with old method : 0.0003497600555419922 time for calcul the mask position with numpy : 0.008289337158203125 nb_pixel_total : 1523 time to create 1 rle with old method : 0.0018045902252197266 time for calcul the mask position with numpy : 0.008291244506835938 nb_pixel_total : 203 time to create 1 rle with old method : 0.0002453327178955078 time for calcul the mask position with numpy : 0.008196830749511719 nb_pixel_total : 2235 time to create 1 rle with old method : 0.0025207996368408203 time for calcul the mask position with numpy : 0.008320331573486328 nb_pixel_total : 46 time to create 1 rle with old method : 5.8650970458984375e-05 time for calcul the mask position with numpy : 0.008172988891601562 nb_pixel_total : 357 time to create 1 rle with old method : 0.0004329681396484375 time for calcul the mask position with numpy : 0.00858449935913086 nb_pixel_total : 527 time to create 1 rle with old method : 0.0006511211395263672 time for calcul the mask position with numpy : 0.008596658706665039 nb_pixel_total : 289 time to create 1 rle with old method : 0.00034737586975097656 time for calcul the mask position with numpy : 0.008508443832397461 nb_pixel_total : 4311 time to create 1 rle with old method : 0.00495457649230957 time for calcul the mask position with numpy : 0.008605241775512695 nb_pixel_total : 4 time to create 1 rle with old method : 1.9311904907226562e-05 time for calcul the mask position with numpy : 0.008592844009399414 nb_pixel_total : 2137 time to create 1 rle with old method : 0.002560853958129883 time for calcul the mask position with numpy : 0.008495807647705078 nb_pixel_total : 629 time to create 1 rle with old method : 0.0007627010345458984 time for calcul the mask position with numpy : 0.008539199829101562 nb_pixel_total : 253 time to create 1 rle with old method : 0.0003294944763183594 time for calcul the mask position with numpy : 0.008586406707763672 nb_pixel_total : 116 time to create 1 rle with old method : 0.00016641616821289062 time for calcul the mask position with numpy : 0.008417129516601562 nb_pixel_total : 496 time to create 1 rle with old method : 0.0005495548248291016 time for calcul the mask position with numpy : 0.008397102355957031 nb_pixel_total : 211 time to create 1 rle with old method : 0.00027060508728027344 time for calcul the mask position with numpy : 0.008086204528808594 nb_pixel_total : 346 time to create 1 rle with old method : 0.0003876686096191406 time for calcul the mask position with numpy : 0.00819706916809082 nb_pixel_total : 471 time to create 1 rle with old method : 0.0005629062652587891 time for calcul the mask position with numpy : 0.008052587509155273 nb_pixel_total : 178 time to create 1 rle with old method : 0.00021314620971679688 time for calcul the mask position with numpy : 0.008133888244628906 nb_pixel_total : 287 time to create 1 rle with old method : 0.0003304481506347656 create new chi : 1.4823057651519775 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.01157236099243164 batch 1 Loaded 124 chid ids of type : 4230 Number RLEs to save : 11481 TO DO : save crop sub photo not yet done ! save time : 0.7934472560882568 nb_obj : 110 nb_hashtags : 7 time to prepare the origin masks : 1.952179193496704 time for calcul the mask position with numpy : 0.03028106689453125 nb_pixel_total : 1806075 time to create 1 rle with new method : 0.05416703224182129 time for calcul the mask position with numpy : 0.010112524032592773 nb_pixel_total : 51816 time to create 1 rle with old method : 0.05654001235961914 time for calcul the mask position with numpy : 0.009443521499633789 nb_pixel_total : 29 time to create 1 rle with old method : 5.745887756347656e-05 time for calcul the mask position with numpy : 0.009552478790283203 nb_pixel_total : 421 time to create 1 rle with old method : 0.00045180320739746094 time for calcul the mask position with numpy : 0.009898900985717773 nb_pixel_total : 55 time to create 1 rle with old method : 8.96453857421875e-05 time for calcul the mask position with numpy : 0.009277105331420898 nb_pixel_total : 1381 time to create 1 rle with old method : 0.001592397689819336 time for calcul the mask position with numpy : 0.009505271911621094 nb_pixel_total : 3961 time to create 1 rle with old method : 0.0045757293701171875 time for calcul the mask position with numpy : 0.00555729866027832 nb_pixel_total : 789 time to create 1 rle with old method : 0.0008974075317382812 time for calcul the mask position with numpy : 0.0055348873138427734 nb_pixel_total : 1428 time to create 1 rle with old method : 0.0016410350799560547 time for calcul the mask position with numpy : 0.005513668060302734 nb_pixel_total : 330 time to create 1 rle with old method : 0.0003790855407714844 time for calcul the mask position with numpy : 0.005510091781616211 nb_pixel_total : 5 time to create 1 rle with old method : 2.8848648071289062e-05 time for calcul the mask position with numpy : 0.0057544708251953125 nb_pixel_total : 5945 time to create 1 rle with old method : 0.006456613540649414 time for calcul the mask position with numpy : 0.005757331848144531 nb_pixel_total : 78 time to create 1 rle with old method : 0.00010848045349121094 time for calcul the mask position with numpy : 0.005495548248291016 nb_pixel_total : 1098 time to create 1 rle with old method : 0.0012011528015136719 time for calcul the mask position with numpy : 0.009317398071289062 nb_pixel_total : 1111 time to create 1 rle with old method : 0.0012364387512207031 time for calcul the mask position with numpy : 0.009231805801391602 nb_pixel_total : 20 time to create 1 rle with old method : 6.389617919921875e-05 time for calcul the mask position with numpy : 0.00914144515991211 nb_pixel_total : 512 time to create 1 rle with old method : 0.0005905628204345703 time for calcul the mask position with numpy : 0.008132457733154297 nb_pixel_total : 475 time to create 1 rle with old method : 0.0006024837493896484 time for calcul the mask position with numpy : 0.005582332611083984 nb_pixel_total : 9327 time to create 1 rle with old method : 0.009907245635986328 time for calcul the mask position with numpy : 0.005807399749755859 nb_pixel_total : 13059 time to create 1 rle with old method : 0.013332843780517578 time for calcul the mask position with numpy : 0.0054819583892822266 nb_pixel_total : 120 time to create 1 rle with old method : 0.00023651123046875 time for calcul the mask position with numpy : 0.005472421646118164 nb_pixel_total : 279 time to create 1 rle with old method : 0.0003304481506347656 time for calcul the mask position with numpy : 0.0054628849029541016 nb_pixel_total : 2595 time to create 1 rle with old method : 0.002684354782104492 time for calcul the mask position with numpy : 0.006029367446899414 nb_pixel_total : 593 time to create 1 rle with old method : 0.0006818771362304688 time for calcul the mask position with numpy : 0.005883216857910156 nb_pixel_total : 1196 time to create 1 rle with old method : 0.0013959407806396484 time for calcul the mask position with numpy : 0.005547046661376953 nb_pixel_total : 1410 time to create 1 rle with old method : 0.0014755725860595703 time for calcul the mask position with numpy : 0.0059816837310791016 nb_pixel_total : 1624 time to create 1 rle with old method : 0.0017061233520507812 time for calcul the mask position with numpy : 0.005489349365234375 nb_pixel_total : 4948 time to create 1 rle with old method : 0.005120038986206055 time for calcul the mask position with numpy : 0.005593299865722656 nb_pixel_total : 73 time to create 1 rle with old method : 9.34600830078125e-05 time for calcul the mask position with numpy : 0.005511045455932617 nb_pixel_total : 93 time to create 1 rle with old method : 0.00012922286987304688 time for calcul the mask position with numpy : 0.005535602569580078 nb_pixel_total : 245 time to create 1 rle with old method : 0.0002808570861816406 time for calcul the mask position with numpy : 0.005720615386962891 nb_pixel_total : 858 time to create 1 rle with old method : 0.0010254383087158203 time for calcul the mask position with numpy : 0.0055484771728515625 nb_pixel_total : 184 time to create 1 rle with old method : 0.00022482872009277344 time for calcul the mask position with numpy : 0.005528450012207031 nb_pixel_total : 478 time to create 1 rle with old method : 0.0005867481231689453 time for calcul the mask position with numpy : 0.005606889724731445 nb_pixel_total : 20277 time to create 1 rle with old method : 0.02071094512939453 time for calcul the mask position with numpy : 0.005890369415283203 nb_pixel_total : 153 time to create 1 rle with old method : 0.00020360946655273438 time for calcul the mask position with numpy : 0.005812644958496094 nb_pixel_total : 280 time to create 1 rle with old method : 0.0003082752227783203 time for calcul the mask position with numpy : 0.005740642547607422 nb_pixel_total : 775 time to create 1 rle with old method : 0.0008323192596435547 time for calcul the mask position with numpy : 0.0056705474853515625 nb_pixel_total : 303 time to create 1 rle with old method : 0.0003409385681152344 time for calcul the mask position with numpy : 0.0057604312896728516 nb_pixel_total : 1620 time to create 1 rle with old method : 0.0016937255859375 time for calcul the mask position with numpy : 0.005745410919189453 nb_pixel_total : 479 time to create 1 rle with old method : 0.0005979537963867188 time for calcul the mask position with numpy : 0.005730390548706055 nb_pixel_total : 134 time to create 1 rle with old method : 0.0001595020294189453 time for calcul the mask position with numpy : 0.005767345428466797 nb_pixel_total : 156 time to create 1 rle with old method : 0.00018477439880371094 time for calcul the mask position with numpy : 0.0055980682373046875 nb_pixel_total : 235 time to create 1 rle with old method : 0.00026226043701171875 time for calcul the mask position with numpy : 0.005718708038330078 nb_pixel_total : 531 time to create 1 rle with old method : 0.0006320476531982422 time for calcul the mask position with numpy : 0.005518913269042969 nb_pixel_total : 255 time to create 1 rle with old method : 0.00029397010803222656 time for calcul the mask position with numpy : 0.00552058219909668 nb_pixel_total : 171 time to create 1 rle with old method : 0.00020170211791992188 time for calcul the mask position with numpy : 0.005582094192504883 nb_pixel_total : 1052 time to create 1 rle with old method : 0.0011000633239746094 time for calcul the mask position with numpy : 0.0055086612701416016 nb_pixel_total : 154 time to create 1 rle with old method : 0.00017571449279785156 time for calcul the mask position with numpy : 0.005507469177246094 nb_pixel_total : 122 time to create 1 rle with old method : 0.0001461505889892578 time for calcul the mask position with numpy : 0.0056498050689697266 nb_pixel_total : 307 time to create 1 rle with old method : 0.00036597251892089844 time for calcul the mask position with numpy : 0.006682872772216797 nb_pixel_total : 105574 time to create 1 rle with old method : 0.10904932022094727 time for calcul the mask position with numpy : 0.006394386291503906 nb_pixel_total : 162 time to create 1 rle with old method : 0.0002753734588623047 time for calcul the mask position with numpy : 0.006015777587890625 nb_pixel_total : 468 time to create 1 rle with old method : 0.0005850791931152344 time for calcul the mask position with numpy : 0.006249189376831055 nb_pixel_total : 130 time to create 1 rle with old method : 0.00020003318786621094 time for calcul the mask position with numpy : 0.00604701042175293 nb_pixel_total : 287 time to create 1 rle with old method : 0.0003523826599121094 time for calcul the mask position with numpy : 0.00608062744140625 nb_pixel_total : 1618 time to create 1 rle with old method : 0.0018129348754882812 time for calcul the mask position with numpy : 0.005976438522338867 nb_pixel_total : 299 time to create 1 rle with old method : 0.00034332275390625 time for calcul the mask position with numpy : 0.005730390548706055 nb_pixel_total : 1189 time to create 1 rle with old method : 0.001256704330444336 time for calcul the mask position with numpy : 0.00593113899230957 nb_pixel_total : 772 time to create 1 rle with old method : 0.0009076595306396484 time for calcul the mask position with numpy : 0.005820751190185547 nb_pixel_total : 319 time to create 1 rle with old method : 0.0003859996795654297 time for calcul the mask position with numpy : 0.005545616149902344 nb_pixel_total : 260 time to create 1 rle with old method : 0.0003066062927246094 time for calcul the mask position with numpy : 0.005760669708251953 nb_pixel_total : 376 time to create 1 rle with old method : 0.0004150867462158203 time for calcul the mask position with numpy : 0.005418539047241211 nb_pixel_total : 140 time to create 1 rle with old method : 0.0001938343048095703 time for calcul the mask position with numpy : 0.005601406097412109 nb_pixel_total : 558 time to create 1 rle with old method : 0.0005991458892822266 time for calcul the mask position with numpy : 0.005467414855957031 nb_pixel_total : 680 time to create 1 rle with old method : 0.0007264614105224609 time for calcul the mask position with numpy : 0.0054416656494140625 nb_pixel_total : 1093 time to create 1 rle with old method : 0.001220703125 time for calcul the mask position with numpy : 0.005648136138916016 nb_pixel_total : 155 time to create 1 rle with old method : 0.00018477439880371094 time for calcul the mask position with numpy : 0.0056493282318115234 nb_pixel_total : 249 time to create 1 rle with old method : 0.0002799034118652344 time for calcul the mask position with numpy : 0.0058746337890625 nb_pixel_total : 14 time to create 1 rle with old method : 5.1021575927734375e-05 time for calcul the mask position with numpy : 0.005570650100708008 nb_pixel_total : 387 time to create 1 rle with old method : 0.00045490264892578125 time for calcul the mask position with numpy : 0.005686283111572266 nb_pixel_total : 81 time to create 1 rle with old method : 0.00011277198791503906 time for calcul the mask position with numpy : 0.005656242370605469 nb_pixel_total : 1012 time to create 1 rle with old method : 0.0010538101196289062 time for calcul the mask position with numpy : 0.005664348602294922 nb_pixel_total : 505 time to create 1 rle with old method : 0.0005946159362792969 time for calcul the mask position with numpy : 0.005547761917114258 nb_pixel_total : 87 time to create 1 rle with old method : 0.00011372566223144531 time for calcul the mask position with numpy : 0.005609035491943359 nb_pixel_total : 3 time to create 1 rle with old method : 2.9087066650390625e-05 time for calcul the mask position with numpy : 0.005421876907348633 nb_pixel_total : 382 time to create 1 rle with old method : 0.00041985511779785156 time for calcul the mask position with numpy : 0.005534648895263672 nb_pixel_total : 50 time to create 1 rle with old method : 7.390975952148438e-05 time for calcul the mask position with numpy : 0.0054857730865478516 nb_pixel_total : 711 time to create 1 rle with old method : 0.0008671283721923828 time for calcul the mask position with numpy : 0.00553441047668457 nb_pixel_total : 137 time to create 1 rle with old method : 0.00018596649169921875 time for calcul the mask position with numpy : 0.005717754364013672 nb_pixel_total : 2 time to create 1 rle with old method : 2.1696090698242188e-05 time for calcul the mask position with numpy : 0.0058896541595458984 nb_pixel_total : 181 time to create 1 rle with old method : 0.00023412704467773438 time for calcul the mask position with numpy : 0.005932331085205078 nb_pixel_total : 59 time to create 1 rle with old method : 9.965896606445312e-05 time for calcul the mask position with numpy : 0.0058193206787109375 nb_pixel_total : 515 time to create 1 rle with old method : 0.0006306171417236328 time for calcul the mask position with numpy : 0.005690336227416992 nb_pixel_total : 4243 time to create 1 rle with old method : 0.0047872066497802734 time for calcul the mask position with numpy : 0.005833148956298828 nb_pixel_total : 34 time to create 1 rle with old method : 7.534027099609375e-05 time for calcul the mask position with numpy : 0.005582571029663086 nb_pixel_total : 730 time to create 1 rle with old method : 0.0007784366607666016 time for calcul the mask position with numpy : 0.005669355392456055 nb_pixel_total : 25 time to create 1 rle with old method : 5.602836608886719e-05 time for calcul the mask position with numpy : 0.005783557891845703 nb_pixel_total : 175 time to create 1 rle with old method : 0.00020432472229003906 time for calcul the mask position with numpy : 0.0056667327880859375 nb_pixel_total : 175 time to create 1 rle with old method : 0.00020647048950195312 time for calcul the mask position with numpy : 0.0056896209716796875 nb_pixel_total : 186 time to create 1 rle with old method : 0.00023698806762695312 time for calcul the mask position with numpy : 0.0056459903717041016 nb_pixel_total : 452 time to create 1 rle with old method : 0.00048279762268066406 time for calcul the mask position with numpy : 0.0055506229400634766 nb_pixel_total : 1495 time to create 1 rle with old method : 0.0016045570373535156 time for calcul the mask position with numpy : 0.005608320236206055 nb_pixel_total : 217 time to create 1 rle with old method : 0.0002570152282714844 time for calcul the mask position with numpy : 0.006166219711303711 nb_pixel_total : 58 time to create 1 rle with old method : 8.177757263183594e-05 time for calcul the mask position with numpy : 0.005434989929199219 nb_pixel_total : 153 time to create 1 rle with old method : 0.000179290771484375 time for calcul the mask position with numpy : 0.005589723587036133 nb_pixel_total : 2103 time to create 1 rle with old method : 0.002410888671875 time for calcul the mask position with numpy : 0.005560398101806641 nb_pixel_total : 265 time to create 1 rle with old method : 0.00029778480529785156 time for calcul the mask position with numpy : 0.005621194839477539 nb_pixel_total : 572 time to create 1 rle with old method : 0.0006415843963623047 time for calcul the mask position with numpy : 0.005628108978271484 nb_pixel_total : 44 time to create 1 rle with old method : 7.510185241699219e-05 time for calcul the mask position with numpy : 0.006206512451171875 nb_pixel_total : 2113 time to create 1 rle with old method : 0.00220489501953125 time for calcul the mask position with numpy : 0.005629062652587891 nb_pixel_total : 147 time to create 1 rle with old method : 0.00019049644470214844 time for calcul the mask position with numpy : 0.005487918853759766 nb_pixel_total : 106 time to create 1 rle with old method : 0.0001347064971923828 time for calcul the mask position with numpy : 0.0055773258209228516 nb_pixel_total : 453 time to create 1 rle with old method : 0.0004856586456298828 time for calcul the mask position with numpy : 0.00580596923828125 nb_pixel_total : 210 time to create 1 rle with old method : 0.0002319812774658203 time for calcul the mask position with numpy : 0.00539708137512207 nb_pixel_total : 547 time to create 1 rle with old method : 0.0005757808685302734 time for calcul the mask position with numpy : 0.005450725555419922 nb_pixel_total : 194 time to create 1 rle with old method : 0.00022149085998535156 time for calcul the mask position with numpy : 0.005559444427490234 nb_pixel_total : 170 time to create 1 rle with old method : 0.0001926422119140625 time for calcul the mask position with numpy : 0.0054666996002197266 nb_pixel_total : 144 time to create 1 rle with old method : 0.00019359588623046875 time for calcul the mask position with numpy : 0.005681276321411133 nb_pixel_total : 475 time to create 1 rle with old method : 0.0004987716674804688 time for calcul the mask position with numpy : 0.005476951599121094 nb_pixel_total : 44 time to create 1 rle with old method : 6.151199340820312e-05 create new chi : 1.0352678298950195 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.001322031021118164 batch 1 Loaded 111 chid ids of type : 4230 Number RLEs to save : 9787 TO DO : save crop sub photo not yet done ! save time : 0.7076985836029053 nb_obj : 122 nb_hashtags : 7 time to prepare the origin masks : 1.285301685333252 time for calcul the mask position with numpy : 0.6953411102294922 nb_pixel_total : 1808515 time to create 1 rle with new method : 0.07452774047851562 time for calcul the mask position with numpy : 0.00598454475402832 nb_pixel_total : 56 time to create 1 rle with old method : 9.083747863769531e-05 time for calcul the mask position with numpy : 0.005706310272216797 nb_pixel_total : 143 time to create 1 rle with old method : 0.00019407272338867188 time for calcul the mask position with numpy : 0.005834817886352539 nb_pixel_total : 101 time to create 1 rle with old method : 0.00014495849609375 time for calcul the mask position with numpy : 0.005969047546386719 nb_pixel_total : 703 time to create 1 rle with old method : 0.0007665157318115234 time for calcul the mask position with numpy : 0.0057392120361328125 nb_pixel_total : 36 time to create 1 rle with old method : 5.841255187988281e-05 time for calcul the mask position with numpy : 0.006247282028198242 nb_pixel_total : 39847 time to create 1 rle with old method : 0.04515886306762695 time for calcul the mask position with numpy : 0.005819559097290039 nb_pixel_total : 474 time to create 1 rle with old method : 0.0005006790161132812 time for calcul the mask position with numpy : 0.005844593048095703 nb_pixel_total : 85 time to create 1 rle with old method : 0.00011491775512695312 time for calcul the mask position with numpy : 0.005733966827392578 nb_pixel_total : 170 time to create 1 rle with old method : 0.00020623207092285156 time for calcul the mask position with numpy : 0.005772829055786133 nb_pixel_total : 779 time to create 1 rle with old method : 0.0009179115295410156 time for calcul the mask position with numpy : 0.005860328674316406 nb_pixel_total : 1541 time to create 1 rle with old method : 0.0016064643859863281 time for calcul the mask position with numpy : 0.005883455276489258 nb_pixel_total : 123 time to create 1 rle with old method : 0.00015163421630859375 time for calcul the mask position with numpy : 0.005847930908203125 nb_pixel_total : 326 time to create 1 rle with old method : 0.0003781318664550781 time for calcul the mask position with numpy : 0.005844593048095703 nb_pixel_total : 3132 time to create 1 rle with old method : 0.0034062862396240234 time for calcul the mask position with numpy : 0.005785465240478516 nb_pixel_total : 5652 time to create 1 rle with old method : 0.006056547164916992 time for calcul the mask position with numpy : 0.005807399749755859 nb_pixel_total : 1825 time to create 1 rle with old method : 0.0019378662109375 time for calcul the mask position with numpy : 0.005873441696166992 nb_pixel_total : 102 time to create 1 rle with old method : 0.0001347064971923828 time for calcul the mask position with numpy : 0.0056912899017333984 nb_pixel_total : 27 time to create 1 rle with old method : 0.00015020370483398438 time for calcul the mask position with numpy : 0.006014823913574219 nb_pixel_total : 507 time to create 1 rle with old method : 0.0005958080291748047 time for calcul the mask position with numpy : 0.0059812068939208984 nb_pixel_total : 5 time to create 1 rle with old method : 4.9591064453125e-05 time for calcul the mask position with numpy : 0.005955934524536133 nb_pixel_total : 473 time to create 1 rle with old method : 0.0006172657012939453 time for calcul the mask position with numpy : 0.005742549896240234 nb_pixel_total : 9490 time to create 1 rle with old method : 0.010006189346313477 time for calcul the mask position with numpy : 0.005753993988037109 nb_pixel_total : 2877 time to create 1 rle with old method : 0.003228425979614258 time for calcul the mask position with numpy : 0.00567626953125 nb_pixel_total : 216 time to create 1 rle with old method : 0.0003361701965332031 time for calcul the mask position with numpy : 0.006230831146240234 nb_pixel_total : 11364 time to create 1 rle with old method : 0.012518882751464844 time for calcul the mask position with numpy : 0.005933284759521484 nb_pixel_total : 844 time to create 1 rle with old method : 0.0009572505950927734 time for calcul the mask position with numpy : 0.005889177322387695 nb_pixel_total : 974 time to create 1 rle with old method : 0.001172780990600586 time for calcul the mask position with numpy : 0.005954742431640625 nb_pixel_total : 181 time to create 1 rle with old method : 0.0002155303955078125 time for calcul the mask position with numpy : 0.00573420524597168 nb_pixel_total : 11 time to create 1 rle with old method : 3.600120544433594e-05 time for calcul the mask position with numpy : 0.00659632682800293 nb_pixel_total : 2271 time to create 1 rle with old method : 0.002423524856567383 time for calcul the mask position with numpy : 0.005866289138793945 nb_pixel_total : 254 time to create 1 rle with old method : 0.0003306865692138672 time for calcul the mask position with numpy : 0.006040096282958984 nb_pixel_total : 1357 time to create 1 rle with old method : 0.0014662742614746094 time for calcul the mask position with numpy : 0.005768775939941406 nb_pixel_total : 1601 time to create 1 rle with old method : 0.0018281936645507812 time for calcul the mask position with numpy : 0.00595402717590332 nb_pixel_total : 83 time to create 1 rle with old method : 0.00015807151794433594 time for calcul the mask position with numpy : 0.005957365036010742 nb_pixel_total : 114 time to create 1 rle with old method : 0.00013637542724609375 time for calcul the mask position with numpy : 0.005822896957397461 nb_pixel_total : 147 time to create 1 rle with old method : 0.00017833709716796875 time for calcul the mask position with numpy : 0.005673646926879883 nb_pixel_total : 4840 time to create 1 rle with old method : 0.005254507064819336 time for calcul the mask position with numpy : 0.005882978439331055 nb_pixel_total : 123 time to create 1 rle with old method : 0.0001671314239501953 time for calcul the mask position with numpy : 0.00559687614440918 nb_pixel_total : 81 time to create 1 rle with old method : 0.00010156631469726562 time for calcul the mask position with numpy : 0.00580906867980957 nb_pixel_total : 1963 time to create 1 rle with old method : 0.002138376235961914 time for calcul the mask position with numpy : 0.0060155391693115234 nb_pixel_total : 91 time to create 1 rle with old method : 0.000125885009765625 time for calcul the mask position with numpy : 0.005864143371582031 nb_pixel_total : 111 time to create 1 rle with old method : 0.0001575946807861328 time for calcul the mask position with numpy : 0.005785465240478516 nb_pixel_total : 873 time to create 1 rle with old method : 0.0009205341339111328 time for calcul the mask position with numpy : 0.005738496780395508 nb_pixel_total : 169 time to create 1 rle with old method : 0.00020456314086914062 time for calcul the mask position with numpy : 0.005688190460205078 nb_pixel_total : 1107 time to create 1 rle with old method : 0.0012962818145751953 time for calcul the mask position with numpy : 0.0056874752044677734 nb_pixel_total : 346 time to create 1 rle with old method : 0.00038051605224609375 time for calcul the mask position with numpy : 0.005808830261230469 nb_pixel_total : 707 time to create 1 rle with old method : 0.0008032321929931641 time for calcul the mask position with numpy : 0.006158351898193359 nb_pixel_total : 460 time to create 1 rle with old method : 0.0006289482116699219 time for calcul the mask position with numpy : 0.005801677703857422 nb_pixel_total : 20243 time to create 1 rle with old method : 0.02169966697692871 time for calcul the mask position with numpy : 0.006125926971435547 nb_pixel_total : 149 time to create 1 rle with old method : 0.0001976490020751953 time for calcul the mask position with numpy : 0.005858182907104492 nb_pixel_total : 759 time to create 1 rle with old method : 0.0008740425109863281 time for calcul the mask position with numpy : 0.005678892135620117 nb_pixel_total : 311 time to create 1 rle with old method : 0.00039315223693847656 time for calcul the mask position with numpy : 0.006095409393310547 nb_pixel_total : 455 time to create 1 rle with old method : 0.0005135536193847656 time for calcul the mask position with numpy : 0.006026744842529297 nb_pixel_total : 1593 time to create 1 rle with old method : 0.0018312931060791016 time for calcul the mask position with numpy : 0.0058727264404296875 nb_pixel_total : 14 time to create 1 rle with old method : 5.1021575927734375e-05 time for calcul the mask position with numpy : 0.005785703659057617 nb_pixel_total : 128 time to create 1 rle with old method : 0.00016999244689941406 time for calcul the mask position with numpy : 0.005761384963989258 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003082752227783203 time for calcul the mask position with numpy : 0.0059659481048583984 nb_pixel_total : 162 time to create 1 rle with old method : 0.0001995563507080078 time for calcul the mask position with numpy : 0.00576019287109375 nb_pixel_total : 306 time to create 1 rle with old method : 0.0003960132598876953 time for calcul the mask position with numpy : 0.006132841110229492 nb_pixel_total : 291 time to create 1 rle with old method : 0.00033926963806152344 time for calcul the mask position with numpy : 0.006049394607543945 nb_pixel_total : 192 time to create 1 rle with old method : 0.0002453327178955078 time for calcul the mask position with numpy : 0.0058443546295166016 nb_pixel_total : 1185 time to create 1 rle with old method : 0.001316070556640625 time for calcul the mask position with numpy : 0.005675077438354492 nb_pixel_total : 210 time to create 1 rle with old method : 0.00024008750915527344 time for calcul the mask position with numpy : 0.005948543548583984 nb_pixel_total : 106 time to create 1 rle with old method : 0.00015401840209960938 time for calcul the mask position with numpy : 0.0059583187103271484 nb_pixel_total : 25 time to create 1 rle with old method : 5.888938903808594e-05 time for calcul the mask position with numpy : 0.00628352165222168 nb_pixel_total : 359 time to create 1 rle with old method : 0.0004382133483886719 time for calcul the mask position with numpy : 0.006049156188964844 nb_pixel_total : 146 time to create 1 rle with old method : 0.00018668174743652344 time for calcul the mask position with numpy : 0.00638270378112793 nb_pixel_total : 106705 time to create 1 rle with old method : 0.11407089233398438 time for calcul the mask position with numpy : 0.005904436111450195 nb_pixel_total : 296 time to create 1 rle with old method : 0.0003268718719482422 time for calcul the mask position with numpy : 0.006138324737548828 nb_pixel_total : 460 time to create 1 rle with old method : 0.0005090236663818359 time for calcul the mask position with numpy : 0.00565338134765625 nb_pixel_total : 1573 time to create 1 rle with old method : 0.001810312271118164 time for calcul the mask position with numpy : 0.0057468414306640625 nb_pixel_total : 13 time to create 1 rle with old method : 4.982948303222656e-05 time for calcul the mask position with numpy : 0.005883216857910156 nb_pixel_total : 775 time to create 1 rle with old method : 0.000926971435546875 time for calcul the mask position with numpy : 0.006179332733154297 nb_pixel_total : 263 time to create 1 rle with old method : 0.00032258033752441406 time for calcul the mask position with numpy : 0.006375551223754883 nb_pixel_total : 19 time to create 1 rle with old method : 4.3392181396484375e-05 time for calcul the mask position with numpy : 0.009696722030639648 nb_pixel_total : 586 time to create 1 rle with old method : 0.000690460205078125 time for calcul the mask position with numpy : 0.009600639343261719 nb_pixel_total : 1161 time to create 1 rle with old method : 0.0012426376342773438 time for calcul the mask position with numpy : 0.009736776351928711 nb_pixel_total : 271 time to create 1 rle with old method : 0.00033664703369140625 time for calcul the mask position with numpy : 0.009485244750976562 nb_pixel_total : 385 time to create 1 rle with old method : 0.000476837158203125 time for calcul the mask position with numpy : 0.009484052658081055 nb_pixel_total : 699 time to create 1 rle with old method : 0.0007753372192382812 time for calcul the mask position with numpy : 0.009572982788085938 nb_pixel_total : 62 time to create 1 rle with old method : 0.0001277923583984375 time for calcul the mask position with numpy : 0.009671926498413086 nb_pixel_total : 389 time to create 1 rle with old method : 0.00045561790466308594 time for calcul the mask position with numpy : 0.009504556655883789 nb_pixel_total : 80 time to create 1 rle with old method : 0.00010919570922851562 time for calcul the mask position with numpy : 0.009490728378295898 nb_pixel_total : 456 time to create 1 rle with old method : 0.0004899501800537109 time for calcul the mask position with numpy : 0.009512186050415039 nb_pixel_total : 443 time to create 1 rle with old method : 0.00052642822265625 time for calcul the mask position with numpy : 0.009725809097290039 nb_pixel_total : 445 time to create 1 rle with old method : 0.0005612373352050781 time for calcul the mask position with numpy : 0.009402036666870117 nb_pixel_total : 89 time to create 1 rle with old method : 0.00012993812561035156 time for calcul the mask position with numpy : 0.009791135787963867 nb_pixel_total : 60 time to create 1 rle with old method : 9.274482727050781e-05 time for calcul the mask position with numpy : 0.009589672088623047 nb_pixel_total : 667 time to create 1 rle with old method : 0.0007176399230957031 time for calcul the mask position with numpy : 0.009997129440307617 nb_pixel_total : 67 time to create 1 rle with old method : 0.00010347366333007812 time for calcul the mask position with numpy : 0.00968623161315918 nb_pixel_total : 722 time to create 1 rle with old method : 0.0008342266082763672 time for calcul the mask position with numpy : 0.0062503814697265625 nb_pixel_total : 512 time to create 1 rle with old method : 0.0005524158477783203 time for calcul the mask position with numpy : 0.005780458450317383 nb_pixel_total : 271 time to create 1 rle with old method : 0.00029540061950683594 time for calcul the mask position with numpy : 0.005624532699584961 nb_pixel_total : 624 time to create 1 rle with old method : 0.0007317066192626953 time for calcul the mask position with numpy : 0.006036281585693359 nb_pixel_total : 178 time to create 1 rle with old method : 0.00022602081298828125 time for calcul the mask position with numpy : 0.0061914920806884766 nb_pixel_total : 551 time to create 1 rle with old method : 0.0006430149078369141 time for calcul the mask position with numpy : 0.006661415100097656 nb_pixel_total : 3248 time to create 1 rle with old method : 0.003516674041748047 time for calcul the mask position with numpy : 0.006365060806274414 nb_pixel_total : 771 time to create 1 rle with old method : 0.0008716583251953125 time for calcul the mask position with numpy : 0.006104469299316406 nb_pixel_total : 120 time to create 1 rle with old method : 0.0001556873321533203 time for calcul the mask position with numpy : 0.00567936897277832 nb_pixel_total : 121 time to create 1 rle with old method : 0.00015091896057128906 time for calcul the mask position with numpy : 0.005762338638305664 nb_pixel_total : 727 time to create 1 rle with old method : 0.0008592605590820312 time for calcul the mask position with numpy : 0.005879878997802734 nb_pixel_total : 165 time to create 1 rle with old method : 0.00019121170043945312 time for calcul the mask position with numpy : 0.0056912899017333984 nb_pixel_total : 3250 time to create 1 rle with old method : 0.003509044647216797 time for calcul the mask position with numpy : 0.00579380989074707 nb_pixel_total : 943 time to create 1 rle with old method : 0.0010843276977539062 time for calcul the mask position with numpy : 0.006160259246826172 nb_pixel_total : 46 time to create 1 rle with old method : 6.699562072753906e-05 time for calcul the mask position with numpy : 0.005934000015258789 nb_pixel_total : 1331 time to create 1 rle with old method : 0.001580953598022461 time for calcul the mask position with numpy : 0.0060122013092041016 nb_pixel_total : 1582 time to create 1 rle with old method : 0.0018494129180908203 time for calcul the mask position with numpy : 0.0057675838470458984 nb_pixel_total : 202 time to create 1 rle with old method : 0.0002486705780029297 time for calcul the mask position with numpy : 0.005877017974853516 nb_pixel_total : 273 time to create 1 rle with old method : 0.0002987384796142578 time for calcul the mask position with numpy : 0.008039474487304688 nb_pixel_total : 1813 time to create 1 rle with old method : 0.0020766258239746094 time for calcul the mask position with numpy : 0.007824897766113281 nb_pixel_total : 288 time to create 1 rle with old method : 0.0003199577331542969 time for calcul the mask position with numpy : 0.008219480514526367 nb_pixel_total : 1971 time to create 1 rle with old method : 0.002235889434814453 time for calcul the mask position with numpy : 0.00829935073852539 nb_pixel_total : 173 time to create 1 rle with old method : 0.00020360946655273438 time for calcul the mask position with numpy : 0.008302927017211914 nb_pixel_total : 92 time to create 1 rle with old method : 0.00011420249938964844 time for calcul the mask position with numpy : 0.00824594497680664 nb_pixel_total : 110 time to create 1 rle with old method : 0.0001423358917236328 time for calcul the mask position with numpy : 0.0080718994140625 nb_pixel_total : 498 time to create 1 rle with old method : 0.0005214214324951172 time for calcul the mask position with numpy : 0.007855415344238281 nb_pixel_total : 248 time to create 1 rle with old method : 0.00027298927307128906 time for calcul the mask position with numpy : 0.008165121078491211 nb_pixel_total : 295 time to create 1 rle with old method : 0.0003514289855957031 time for calcul the mask position with numpy : 0.008121967315673828 nb_pixel_total : 475 time to create 1 rle with old method : 0.0005505084991455078 time for calcul the mask position with numpy : 0.008048057556152344 nb_pixel_total : 1530 time to create 1 rle with old method : 0.0017704963684082031 time for calcul the mask position with numpy : 0.008000850677490234 nb_pixel_total : 187 time to create 1 rle with old method : 0.00019931793212890625 time for calcul the mask position with numpy : 0.007815837860107422 nb_pixel_total : 160 time to create 1 rle with old method : 0.00017976760864257812 create new chi : 1.8841004371643066 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0014951229095458984 batch 1 Loaded 123 chid ids of type : 4230 Number RLEs to save : 10824 TO DO : save crop sub photo not yet done ! save time : 0.7842154502868652 nb_obj : 122 nb_hashtags : 7 time to prepare the origin masks : 1.4180502891540527 time for calcul the mask position with numpy : 0.2622666358947754 nb_pixel_total : 1655074 time to create 1 rle with new method : 0.07379865646362305 time for calcul the mask position with numpy : 0.0056917667388916016 nb_pixel_total : 148 time to create 1 rle with old method : 0.00018143653869628906 time for calcul the mask position with numpy : 0.00547027587890625 nb_pixel_total : 30 time to create 1 rle with old method : 5.435943603515625e-05 time for calcul the mask position with numpy : 0.005453348159790039 nb_pixel_total : 107 time to create 1 rle with old method : 0.0001380443572998047 time for calcul the mask position with numpy : 0.005437612533569336 nb_pixel_total : 46 time to create 1 rle with old method : 7.581710815429688e-05 time for calcul the mask position with numpy : 0.005445957183837891 nb_pixel_total : 401 time to create 1 rle with old method : 0.00043320655822753906 time for calcul the mask position with numpy : 0.0056607723236083984 nb_pixel_total : 44047 time to create 1 rle with old method : 0.04934334754943848 time for calcul the mask position with numpy : 0.006063699722290039 nb_pixel_total : 16373 time to create 1 rle with old method : 0.01757526397705078 time for calcul the mask position with numpy : 0.005651712417602539 nb_pixel_total : 819 time to create 1 rle with old method : 0.0009355545043945312 time for calcul the mask position with numpy : 0.005640268325805664 nb_pixel_total : 5715 time to create 1 rle with old method : 0.006085872650146484 time for calcul the mask position with numpy : 0.005638837814331055 nb_pixel_total : 698 time to create 1 rle with old method : 0.0007250308990478516 time for calcul the mask position with numpy : 0.005478620529174805 nb_pixel_total : 1531 time to create 1 rle with old method : 0.0015971660614013672 time for calcul the mask position with numpy : 0.0054569244384765625 nb_pixel_total : 457 time to create 1 rle with old method : 0.0005018711090087891 time for calcul the mask position with numpy : 0.005510568618774414 nb_pixel_total : 200 time to create 1 rle with old method : 0.00023698806762695312 time for calcul the mask position with numpy : 0.005473136901855469 nb_pixel_total : 4876 time to create 1 rle with old method : 0.004969596862792969 time for calcul the mask position with numpy : 0.0056612491607666016 nb_pixel_total : 81 time to create 1 rle with old method : 0.00011754035949707031 time for calcul the mask position with numpy : 0.0055806636810302734 nb_pixel_total : 160 time to create 1 rle with old method : 0.00021266937255859375 time for calcul the mask position with numpy : 0.005936384201049805 nb_pixel_total : 1146 time to create 1 rle with old method : 0.0013036727905273438 time for calcul the mask position with numpy : 0.005541324615478516 nb_pixel_total : 200 time to create 1 rle with old method : 0.00022912025451660156 time for calcul the mask position with numpy : 0.0055141448974609375 nb_pixel_total : 496 time to create 1 rle with old method : 0.0005881786346435547 time for calcul the mask position with numpy : 0.006217002868652344 nb_pixel_total : 153077 time to create 1 rle with new method : 0.1890096664428711 time for calcul the mask position with numpy : 0.00557708740234375 nb_pixel_total : 303 time to create 1 rle with old method : 0.0003571510314941406 time for calcul the mask position with numpy : 0.0054378509521484375 nb_pixel_total : 356 time to create 1 rle with old method : 0.00041031837463378906 time for calcul the mask position with numpy : 0.005533456802368164 nb_pixel_total : 8972 time to create 1 rle with old method : 0.009065866470336914 time for calcul the mask position with numpy : 0.005517005920410156 nb_pixel_total : 1279 time to create 1 rle with old method : 0.001453399658203125 time for calcul the mask position with numpy : 0.0055310726165771484 nb_pixel_total : 12982 time to create 1 rle with old method : 0.013288259506225586 time for calcul the mask position with numpy : 0.005468845367431641 nb_pixel_total : 3130 time to create 1 rle with old method : 0.0032346248626708984 time for calcul the mask position with numpy : 0.008597135543823242 nb_pixel_total : 863 time to create 1 rle with old method : 0.0010561943054199219 time for calcul the mask position with numpy : 0.009227275848388672 nb_pixel_total : 142 time to create 1 rle with old method : 0.000171661376953125 time for calcul the mask position with numpy : 0.00914764404296875 nb_pixel_total : 656 time to create 1 rle with old method : 0.0007357597351074219 time for calcul the mask position with numpy : 0.007223844528198242 nb_pixel_total : 1424 time to create 1 rle with old method : 0.0014634132385253906 time for calcul the mask position with numpy : 0.0053882598876953125 nb_pixel_total : 1321 time to create 1 rle with old method : 0.0013725757598876953 time for calcul the mask position with numpy : 0.006097316741943359 nb_pixel_total : 190 time to create 1 rle with old method : 0.0002257823944091797 time for calcul the mask position with numpy : 0.005734443664550781 nb_pixel_total : 4598 time to create 1 rle with old method : 0.004832744598388672 time for calcul the mask position with numpy : 0.006187915802001953 nb_pixel_total : 565 time to create 1 rle with old method : 0.0006048679351806641 time for calcul the mask position with numpy : 0.005685091018676758 nb_pixel_total : 80 time to create 1 rle with old method : 0.00010824203491210938 time for calcul the mask position with numpy : 0.00654292106628418 nb_pixel_total : 78 time to create 1 rle with old method : 0.00011658668518066406 time for calcul the mask position with numpy : 0.006460428237915039 nb_pixel_total : 668 time to create 1 rle with old method : 0.0008587837219238281 time for calcul the mask position with numpy : 0.006311178207397461 nb_pixel_total : 850 time to create 1 rle with old method : 0.0010328292846679688 time for calcul the mask position with numpy : 0.006674528121948242 nb_pixel_total : 1271 time to create 1 rle with old method : 0.0015025138854980469 time for calcul the mask position with numpy : 0.00644993782043457 nb_pixel_total : 185 time to create 1 rle with old method : 0.0002522468566894531 time for calcul the mask position with numpy : 0.0064237117767333984 nb_pixel_total : 538 time to create 1 rle with old method : 0.0006620883941650391 time for calcul the mask position with numpy : 0.006672859191894531 nb_pixel_total : 224 time to create 1 rle with old method : 0.0002903938293457031 time for calcul the mask position with numpy : 0.006392478942871094 nb_pixel_total : 138 time to create 1 rle with old method : 0.0001862049102783203 time for calcul the mask position with numpy : 0.006140947341918945 nb_pixel_total : 262 time to create 1 rle with old method : 0.0003018379211425781 time for calcul the mask position with numpy : 0.006048679351806641 nb_pixel_total : 752 time to create 1 rle with old method : 0.0009558200836181641 time for calcul the mask position with numpy : 0.006066799163818359 nb_pixel_total : 406 time to create 1 rle with old method : 0.0004889965057373047 time for calcul the mask position with numpy : 0.0059545040130615234 nb_pixel_total : 315 time to create 1 rle with old method : 0.0004038810729980469 time for calcul the mask position with numpy : 0.0062296390533447266 nb_pixel_total : 1638 time to create 1 rle with old method : 0.00189971923828125 time for calcul the mask position with numpy : 0.006380319595336914 nb_pixel_total : 278 time to create 1 rle with old method : 0.0003871917724609375 time for calcul the mask position with numpy : 0.0062067508697509766 nb_pixel_total : 114 time to create 1 rle with old method : 0.0001590251922607422 time for calcul the mask position with numpy : 0.0064241886138916016 nb_pixel_total : 1272 time to create 1 rle with old method : 0.0014841556549072266 time for calcul the mask position with numpy : 0.0064792633056640625 nb_pixel_total : 531 time to create 1 rle with old method : 0.0006644725799560547 time for calcul the mask position with numpy : 0.006089925765991211 nb_pixel_total : 157 time to create 1 rle with old method : 0.0002048015594482422 time for calcul the mask position with numpy : 0.006351947784423828 nb_pixel_total : 358 time to create 1 rle with old method : 0.00043511390686035156 time for calcul the mask position with numpy : 0.006119966506958008 nb_pixel_total : 163 time to create 1 rle with old method : 0.0002739429473876953 time for calcul the mask position with numpy : 0.006412982940673828 nb_pixel_total : 30 time to create 1 rle with old method : 0.00010752677917480469 time for calcul the mask position with numpy : 0.006249904632568359 nb_pixel_total : 933 time to create 1 rle with old method : 0.0011458396911621094 time for calcul the mask position with numpy : 0.006306171417236328 nb_pixel_total : 145 time to create 1 rle with old method : 0.0002338886260986328 time for calcul the mask position with numpy : 0.006293058395385742 nb_pixel_total : 191 time to create 1 rle with old method : 0.0002658367156982422 time for calcul the mask position with numpy : 0.006286144256591797 nb_pixel_total : 69 time to create 1 rle with old method : 0.00010728836059570312 time for calcul the mask position with numpy : 0.006203651428222656 nb_pixel_total : 118 time to create 1 rle with old method : 0.00017905235290527344 time for calcul the mask position with numpy : 0.006211280822753906 nb_pixel_total : 363 time to create 1 rle with old method : 0.0004246234893798828 time for calcul the mask position with numpy : 0.0063478946685791016 nb_pixel_total : 42 time to create 1 rle with old method : 7.200241088867188e-05 time for calcul the mask position with numpy : 0.006197452545166016 nb_pixel_total : 121 time to create 1 rle with old method : 0.0001952648162841797 time for calcul the mask position with numpy : 0.007769107818603516 nb_pixel_total : 106010 time to create 1 rle with old method : 0.12146639823913574 time for calcul the mask position with numpy : 0.006618022918701172 nb_pixel_total : 493 time to create 1 rle with old method : 0.0007252693176269531 time for calcul the mask position with numpy : 0.006536960601806641 nb_pixel_total : 1549 time to create 1 rle with old method : 0.0019659996032714844 time for calcul the mask position with numpy : 0.0063664913177490234 nb_pixel_total : 273 time to create 1 rle with old method : 0.0003867149353027344 time for calcul the mask position with numpy : 0.006444454193115234 nb_pixel_total : 793 time to create 1 rle with old method : 0.0010488033294677734 time for calcul the mask position with numpy : 0.006402254104614258 nb_pixel_total : 98 time to create 1 rle with old method : 0.00014543533325195312 time for calcul the mask position with numpy : 0.006402730941772461 nb_pixel_total : 176 time to create 1 rle with old method : 0.0002651214599609375 time for calcul the mask position with numpy : 0.006443500518798828 nb_pixel_total : 1436 time to create 1 rle with old method : 0.0019390583038330078 time for calcul the mask position with numpy : 0.006201028823852539 nb_pixel_total : 589 time to create 1 rle with old method : 0.0007326602935791016 time for calcul the mask position with numpy : 0.006075382232666016 nb_pixel_total : 595 time to create 1 rle with old method : 0.0007283687591552734 time for calcul the mask position with numpy : 0.0059583187103271484 nb_pixel_total : 579 time to create 1 rle with old method : 0.0006568431854248047 time for calcul the mask position with numpy : 0.006039857864379883 nb_pixel_total : 1051 time to create 1 rle with old method : 0.0012104511260986328 time for calcul the mask position with numpy : 0.005933523178100586 nb_pixel_total : 236 time to create 1 rle with old method : 0.0002944469451904297 time for calcul the mask position with numpy : 0.0057828426361083984 nb_pixel_total : 388 time to create 1 rle with old method : 0.00041675567626953125 time for calcul the mask position with numpy : 0.005815744400024414 nb_pixel_total : 760 time to create 1 rle with old method : 0.0008151531219482422 time for calcul the mask position with numpy : 0.005823850631713867 nb_pixel_total : 108 time to create 1 rle with old method : 0.00018548965454101562 time for calcul the mask position with numpy : 0.005925893783569336 nb_pixel_total : 1161 time to create 1 rle with old method : 0.0012385845184326172 time for calcul the mask position with numpy : 0.0061702728271484375 nb_pixel_total : 48 time to create 1 rle with old method : 0.00010704994201660156 time for calcul the mask position with numpy : 0.005774021148681641 nb_pixel_total : 216 time to create 1 rle with old method : 0.0002779960632324219 time for calcul the mask position with numpy : 0.006055593490600586 nb_pixel_total : 26 time to create 1 rle with old method : 0.00010132789611816406 time for calcul the mask position with numpy : 0.005682945251464844 nb_pixel_total : 384 time to create 1 rle with old method : 0.0004792213439941406 time for calcul the mask position with numpy : 0.006001710891723633 nb_pixel_total : 3808 time to create 1 rle with old method : 0.004106283187866211 time for calcul the mask position with numpy : 0.0058476924896240234 nb_pixel_total : 475 time to create 1 rle with old method : 0.0005362033843994141 time for calcul the mask position with numpy : 0.005930662155151367 nb_pixel_total : 84 time to create 1 rle with old method : 0.0001220703125 time for calcul the mask position with numpy : 0.005757808685302734 nb_pixel_total : 434 time to create 1 rle with old method : 0.00046324729919433594 time for calcul the mask position with numpy : 0.00630950927734375 nb_pixel_total : 454 time to create 1 rle with old method : 0.0005390644073486328 time for calcul the mask position with numpy : 0.00593113899230957 nb_pixel_total : 82 time to create 1 rle with old method : 0.00011658668518066406 time for calcul the mask position with numpy : 0.00610804557800293 nb_pixel_total : 59 time to create 1 rle with old method : 9.298324584960938e-05 time for calcul the mask position with numpy : 0.005789756774902344 nb_pixel_total : 31 time to create 1 rle with old method : 7.009506225585938e-05 time for calcul the mask position with numpy : 0.006458282470703125 nb_pixel_total : 750 time to create 1 rle with old method : 0.0008020401000976562 time for calcul the mask position with numpy : 0.0058705806732177734 nb_pixel_total : 128 time to create 1 rle with old method : 0.00017881393432617188 time for calcul the mask position with numpy : 0.0060176849365234375 nb_pixel_total : 480 time to create 1 rle with old method : 0.0005354881286621094 time for calcul the mask position with numpy : 0.005845308303833008 nb_pixel_total : 118 time to create 1 rle with old method : 0.00018405914306640625 time for calcul the mask position with numpy : 0.00577998161315918 nb_pixel_total : 549 time to create 1 rle with old method : 0.00064849853515625 time for calcul the mask position with numpy : 0.005733489990234375 nb_pixel_total : 176 time to create 1 rle with old method : 0.00022339820861816406 time for calcul the mask position with numpy : 0.0057179927825927734 nb_pixel_total : 3379 time to create 1 rle with old method : 0.0035936832427978516 time for calcul the mask position with numpy : 0.0058803558349609375 nb_pixel_total : 477 time to create 1 rle with old method : 0.0005824565887451172 time for calcul the mask position with numpy : 0.005916595458984375 nb_pixel_total : 710 time to create 1 rle with old method : 0.0007915496826171875 time for calcul the mask position with numpy : 0.006016969680786133 nb_pixel_total : 421 time to create 1 rle with old method : 0.0005326271057128906 time for calcul the mask position with numpy : 0.006009578704833984 nb_pixel_total : 663 time to create 1 rle with old method : 0.0007810592651367188 time for calcul the mask position with numpy : 0.0057790279388427734 nb_pixel_total : 170 time to create 1 rle with old method : 0.00020003318786621094 time for calcul the mask position with numpy : 0.005843162536621094 nb_pixel_total : 204 time to create 1 rle with old method : 0.00025916099548339844 time for calcul the mask position with numpy : 0.005706071853637695 nb_pixel_total : 969 time to create 1 rle with old method : 0.0010266304016113281 time for calcul the mask position with numpy : 0.005735874176025391 nb_pixel_total : 1482 time to create 1 rle with old method : 0.0015392303466796875 time for calcul the mask position with numpy : 0.005695819854736328 nb_pixel_total : 283 time to create 1 rle with old method : 0.0004210472106933594 time for calcul the mask position with numpy : 0.005717277526855469 nb_pixel_total : 407 time to create 1 rle with old method : 0.00044727325439453125 time for calcul the mask position with numpy : 0.0056858062744140625 nb_pixel_total : 261 time to create 1 rle with old method : 0.0003197193145751953 time for calcul the mask position with numpy : 0.005854129791259766 nb_pixel_total : 279 time to create 1 rle with old method : 0.00032806396484375 time for calcul the mask position with numpy : 0.0061190128326416016 nb_pixel_total : 239 time to create 1 rle with old method : 0.0002987384796142578 time for calcul the mask position with numpy : 0.006124973297119141 nb_pixel_total : 1660 time to create 1 rle with old method : 0.0019185543060302734 time for calcul the mask position with numpy : 0.006163358688354492 nb_pixel_total : 438 time to create 1 rle with old method : 0.0005168914794921875 time for calcul the mask position with numpy : 0.0059430599212646484 nb_pixel_total : 97 time to create 1 rle with old method : 0.00013756752014160156 time for calcul the mask position with numpy : 0.008833646774291992 nb_pixel_total : 482 time to create 1 rle with old method : 0.0005762577056884766 time for calcul the mask position with numpy : 0.00976705551147461 nb_pixel_total : 261 time to create 1 rle with old method : 0.00033354759216308594 time for calcul the mask position with numpy : 0.010130167007446289 nb_pixel_total : 511 time to create 1 rle with old method : 0.0006322860717773438 time for calcul the mask position with numpy : 0.009606599807739258 nb_pixel_total : 189 time to create 1 rle with old method : 0.0002429485321044922 time for calcul the mask position with numpy : 0.01005697250366211 nb_pixel_total : 227 time to create 1 rle with old method : 0.0003528594970703125 time for calcul the mask position with numpy : 0.009943485260009766 nb_pixel_total : 441 time to create 1 rle with old method : 0.0005421638488769531 create new chi : 1.6061592102050781 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0017056465148925781 batch 1 Loaded 123 chid ids of type : 4230 Number RLEs to save : 12208 TO DO : save crop sub photo not yet done ! save time : 0.9616405963897705 map_output_result : {1333488441: (0.0, 'Should be the crop_list due to order', 0.0), 1333488416: (0.0, 'Should be the crop_list due to order', 0.0), 1333488413: (0.0, 'Should be the crop_list due to order', 0.0), 1333488345: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1333488441, 1333488416, 1333488413, 1333488345] Looping around the photos to save general results len do output : 4 /1333488441.Didn't retrieve data . /1333488416.Didn't retrieve data . /1333488413.Didn't retrieve data . /1333488345.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488441', None, None, None, None, None, '2535886') ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488416', None, None, None, None, None, '2535886') ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488413', None, None, None, None, None, '2535886') ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488345', None, None, None, None, None, '2535886') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.015952587127685547 save_final save missing photos in datou_result : time spend for datou_step_exec : 15.389258861541748 time spend to save output : 0.016216516494750977 total time spend for step 4 : 15.405475378036499 step5:crop_condition Sat Feb 1 00:21:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 4 ! batch 1 Loaded 481 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 183 About to insert : list_path_to_insert length 183 new photo from crops ! About to upload 183 photos upload in portfolio : 4869462 init cache_photo without model_param we have 183 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738365687_2286560 we have uploaded 183 photos in the portfolio 4869462 time of upload the photos Elapsed time : 46.75873923301697 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 48 About to insert : list_path_to_insert length 48 new photo from crops ! About to upload 48 photos upload in portfolio : 4869462 init cache_photo without model_param we have 48 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738365735_2286560 we have uploaded 48 photos in the portfolio 4869462 time of upload the photos Elapsed time : 12.205528259277344 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 4869462 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738365747_2286560 we have uploaded 3 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.8908283710479736 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 35 About to insert : list_path_to_insert length 35 new photo from crops ! About to upload 35 photos upload in portfolio : 4869462 init cache_photo without model_param we have 35 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738365749_2286560 we have uploaded 35 photos in the portfolio 4869462 time of upload the photos Elapsed time : 8.566144704818726 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 52 About to insert : list_path_to_insert length 52 new photo from crops ! About to upload 52 photos upload in portfolio : 4869462 init cache_photo without model_param we have 52 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738365758_2286560 we have uploaded 52 photos in the portfolio 4869462 time of upload the photos Elapsed time : 12.2026846408844 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 4869462 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738365771_2286560 we have uploaded 3 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.0137102603912354 we have finished the crop for the class : pet_fonce delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1333488441, 1333488416, 1333488413, 1333488345] Looping around the photos to save general results len do output : 324 /1333506637Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506638Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506639Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506640Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506641Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506642Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506643Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506644Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506645Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506646Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506647Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506648Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506649Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506650Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506652Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506653Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506654Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506655Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506656Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506658Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506659Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506660Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506661Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506662Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506663Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506664Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506665Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506666Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506668Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506669Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506670Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506671Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506672Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506673Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506674Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506675Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506676Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506677Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506678Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506679Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506680Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506681Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506682Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506683Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506684Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506685Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506686Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506687Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506688Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506689Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506690Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506691Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506692Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506693Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506694Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506695Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506696Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506697Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506698Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506699Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506700Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506701Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506702Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506703Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506704Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506705Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506706Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506707Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506708Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506709Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506711Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506712Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506713Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506714Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506715Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506716Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506717Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506718Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506719Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506720Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506721Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506722Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506723Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506724Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506725Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506726Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506727Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506728Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506730Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506731Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506732Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506733Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506734Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506735Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506736Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506737Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506738Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506739Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506740Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506741Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506742Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506743Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506744Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506745Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506746Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506747Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506748Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506749Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506750Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506751Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506752Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506753Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506754Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506755Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506756Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506757Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506758Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506759Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506760Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506762Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506763Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506764Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506765Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506766Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506787Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506790Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506792Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506794Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506796Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506798Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506819Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506846Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506873Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506880Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506893Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506895Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506896Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506897Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506898Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506940Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506944Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506965Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506967Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506968Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506969Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506970Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506971Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506972Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506974Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506988Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506991Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333506992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488441', None, None, None, None, None, '2535886') ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488416', None, None, None, None, None, '2535886') ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488413', None, None, None, None, None, '2535886') ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488345', None, None, None, None, None, '2535886') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 976 time used for this insertion : 0.10531234741210938 save_final save missing photos in datou_result : time spend for datou_step_exec : 88.22044467926025 time spend to save output : 0.11366844177246094 total time spend for step 5 : 88.33411312103271 step6:thcl Sat Feb 1 00:22:52 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.026198625564575195 time to convert the images to numpy array : 0.10468220710754395 time to import caffe and check if the image exist : 0.03274726867675781 time to convert the images to numpy array : 0.10371708869934082 time to import caffe and check if the image exist : 0.02811431884765625 time to convert the images to numpy array : 0.10880446434020996 time to import caffe and check if the image exist : 0.02237105369567871 time to convert the images to numpy array : 0.12172174453735352 time to import caffe and check if the image exist : 0.02468276023864746 time to convert the images to numpy array : 0.12656021118164062 time to import caffe and check if the image exist : 0.028646230697631836 time to convert the images to numpy array : 0.12268233299255371 time to import caffe and check if the image exist : 0.02661609649658203 time to convert the images to numpy array : 0.1259593963623047 time to import caffe and check if the image exist : 0.022130727767944336 time to convert the images to numpy array : 0.1309361457824707 time to import caffe and check if the image exist : 0.0418238639831543 time to convert the images to numpy array : 0.11435937881469727 time to import caffe and check if the image exist : 0.03222346305847168 time to convert the images to numpy array : 0.12456345558166504 total time to convert the images to numpy array : 0.5366485118865967 list photo_ids error: [] list photo_ids correct : [1333506637, 1333506638, 1333506639, 1333506640, 1333506641, 1333506642, 1333506643, 1333506644, 1333506645, 1333506646, 1333506647, 1333506648, 1333506649, 1333506650, 1333506652, 1333506653, 1333506654, 1333506655, 1333506656, 1333506658, 1333506659, 1333506660, 1333506661, 1333506662, 1333506663, 1333506664, 1333506665, 1333506666, 1333506668, 1333506669, 1333506670, 1333506671, 1333506672, 1333506776, 1333506777, 1333506778, 1333506779, 1333506780, 1333506781, 1333506783, 1333506784, 1333506785, 1333506786, 1333506787, 1333506788, 1333506789, 1333506790, 1333506791, 1333506792, 1333506793, 1333506794, 1333506795, 1333506796, 1333506797, 1333506798, 1333506799, 1333506800, 1333506801, 1333506802, 1333506803, 1333506804, 1333506805, 1333506806, 1333506807, 1333506808, 1333506809, 1333506964, 1333506965, 1333506966, 1333506967, 1333506968, 1333506969, 1333506970, 1333506971, 1333506972, 1333506974, 1333506975, 1333506976, 1333506977, 1333506978, 1333506979, 1333506980, 1333506981, 1333506982, 1333506983, 1333506984, 1333506985, 1333506986, 1333506987, 1333506988, 1333506990, 1333506991, 1333506992, 1333506884, 1333506885, 1333506886, 1333506891, 1333506892, 1333506893, 1333506894, 1333506895, 1333506896, 1333506897, 1333506898, 1333506900, 1333506901, 1333506902, 1333506903, 1333506904, 1333506905, 1333506906, 1333506907, 1333506908, 1333506909, 1333506910, 1333506911, 1333506912, 1333506914, 1333506915, 1333506916, 1333506917, 1333506918, 1333506919, 1333506920, 1333506921, 1333506922, 1333506849, 1333506850, 1333506851, 1333506852, 1333506854, 1333506855, 1333506856, 1333506857, 1333506858, 1333506859, 1333506860, 1333506861, 1333506862, 1333506863, 1333506864, 1333506865, 1333506866, 1333506867, 1333506868, 1333506869, 1333506870, 1333506871, 1333506872, 1333506873, 1333506874, 1333506875, 1333506876, 1333506877, 1333506878, 1333506879, 1333506880, 1333506881, 1333506882, 1333506923, 1333506924, 1333506925, 1333506926, 1333506927, 1333506935, 1333506936, 1333506937, 1333506938, 1333506939, 1333506940, 1333506941, 1333506942, 1333506943, 1333506944, 1333506945, 1333506946, 1333506947, 1333506948, 1333506949, 1333506950, 1333506951, 1333506952, 1333506953, 1333506954, 1333506955, 1333506956, 1333506958, 1333506959, 1333506960, 1333506961, 1333506962, 1333506963, 1333506706, 1333506707, 1333506708, 1333506709, 1333506711, 1333506712, 1333506713, 1333506714, 1333506715, 1333506716, 1333506717, 1333506718, 1333506719, 1333506720, 1333506721, 1333506722, 1333506723, 1333506724, 1333506725, 1333506726, 1333506727, 1333506728, 1333506730, 1333506731, 1333506732, 1333506733, 1333506734, 1333506735, 1333506736, 1333506737, 1333506738, 1333506739, 1333506740, 1333506810, 1333506811, 1333506812, 1333506813, 1333506814, 1333506815, 1333506816, 1333506817, 1333506818, 1333506819, 1333506820, 1333506822, 1333506823, 1333506824, 1333506825, 1333506826, 1333506827, 1333506828, 1333506833, 1333506834, 1333506835, 1333506836, 1333506837, 1333506838, 1333506839, 1333506840, 1333506841, 1333506842, 1333506843, 1333506844, 1333506846, 1333506847, 1333506848, 1333506673, 1333506674, 1333506675, 1333506676, 1333506677, 1333506678, 1333506679, 1333506680, 1333506681, 1333506682, 1333506683, 1333506684, 1333506685, 1333506686, 1333506687, 1333506688, 1333506689, 1333506690, 1333506691, 1333506692, 1333506693, 1333506694, 1333506695, 1333506696, 1333506697, 1333506698, 1333506699, 1333506700, 1333506701, 1333506702, 1333506703, 1333506704, 1333506705, 1333506741, 1333506742, 1333506743, 1333506744, 1333506745, 1333506746, 1333506747, 1333506748, 1333506749, 1333506750, 1333506751, 1333506752, 1333506753, 1333506754, 1333506755, 1333506756, 1333506757, 1333506758, 1333506759, 1333506760, 1333506762, 1333506763, 1333506764, 1333506765, 1333506766, 1333506768, 1333506769, 1333506770, 1333506771, 1333506772, 1333506773, 1333506774, 1333506775] number of photos to traite : 324 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3687 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 3468 max_wait_temp : 1 max_wait : 0 dict_keys(['prob', 'pool5']) time used to do the prepocess of the images : 1.4953625202178955 time used to do the prediction : 1.2085068225860596 save descriptor for thcl : 3237 time to traite the descriptors : 1.9058458805084229 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1333506637 To insert : 1333506638 To insert : 1333506639 To insert : 1333506640 To insert : 1333506641 To insert : 1333506642 To insert : 1333506643 To insert : 1333506644 To insert : 1333506645 To insert : 1333506646 To insert : 1333506647 To insert : 1333506648 To insert : 1333506649 To insert : 1333506650 To insert : 1333506652 To insert : 1333506653 To insert : 1333506654 To insert : 1333506655 To insert : 1333506656 To insert : 1333506658 To insert : 1333506659 To insert : 1333506660 To insert : 1333506661 To insert : 1333506662 To insert : 1333506663 To insert : 1333506664 To insert : 1333506665 To insert : 1333506666 To insert : 1333506668 To insert : 1333506669 To insert : 1333506670 To insert : 1333506671 To insert : 1333506672 To insert : 1333506776 To insert : 1333506777 To insert : 1333506778 To insert : 1333506779 To insert : 1333506780 To insert : 1333506781 To insert : 1333506783 To insert : 1333506784 To insert : 1333506785 To insert : 1333506786 To insert : 1333506787 To insert : 1333506788 To insert : 1333506789 To insert : 1333506790 To insert : 1333506791 To insert : 1333506792 To insert : 1333506793 To insert : 1333506794 To insert : 1333506795 To insert : 1333506796 To insert : 1333506797 To insert : 1333506798 To insert : 1333506799 To insert : 1333506800 To insert : 1333506801 To insert : 1333506802 To insert : 1333506803 To insert : 1333506804 To insert : 1333506805 To insert : 1333506806 To insert : 1333506807 To insert : 1333506808 To insert : 1333506809 To insert : 1333506964 To insert : 1333506965 To insert : 1333506966 To insert : 1333506967 To insert : 1333506968 To insert : 1333506969 To insert : 1333506970 To insert : 1333506971 To insert : 1333506972 To insert : 1333506974 To insert : 1333506975 To insert : 1333506976 To insert : 1333506977 To insert : 1333506978 To insert : 1333506979 To insert : 1333506980 To insert : 1333506981 To insert : 1333506982 To insert : 1333506983 To insert : 1333506984 To insert : 1333506985 To insert : 1333506986 To insert : 1333506987 To insert : 1333506988 To insert : 1333506990 To insert : 1333506991 To insert : 1333506992 To insert : 1333506884 To insert : 1333506885 To insert : 1333506886 To insert : 1333506891 To insert : 1333506892 To insert : 1333506893 To insert : 1333506894 To insert : 1333506895 To insert : 1333506896 To insert : 1333506897 To insert : 1333506898 To insert : 1333506900 To insert : 1333506901 To insert : 1333506902 To insert : 1333506903 To insert : 1333506904 To insert : 1333506905 To insert : 1333506906 To insert : 1333506907 To insert : 1333506908 To insert : 1333506909 To insert : 1333506910 To insert : 1333506911 To insert : 1333506912 To insert : 1333506914 To insert : 1333506915 To insert : 1333506916 To insert : 1333506917 To insert : 1333506918 To insert : 1333506919 To insert : 1333506920 To insert : 1333506921 To insert : 1333506922 To insert : 1333506849 To insert : 1333506850 To insert : 1333506851 To insert : 1333506852 To insert : 1333506854 To insert : 1333506855 To insert : 1333506856 To insert : 1333506857 To insert : 1333506858 To insert : 1333506859 To insert : 1333506860 To insert : 1333506861 To insert : 1333506862 To insert : 1333506863 To insert : 1333506864 To insert : 1333506865 To insert : 1333506866 To insert : 1333506867 To insert : 1333506868 To insert : 1333506869 To insert : 1333506870 To insert : 1333506871 To insert : 1333506872 To insert : 1333506873 To insert : 1333506874 To insert : 1333506875 To insert : 1333506876 To insert : 1333506877 To insert : 1333506878 To insert : 1333506879 To insert : 1333506880 To insert : 1333506881 To insert : 1333506882 To insert : 1333506923 To insert : 1333506924 To insert : 1333506925 To insert : 1333506926 To insert : 1333506927 To insert : 1333506935 To insert : 1333506936 To insert : 1333506937 To insert : 1333506938 To insert : 1333506939 To insert : 1333506940 To insert : 1333506941 To insert : 1333506942 To insert : 1333506943 To insert : 1333506944 To insert : 1333506945 To insert : 1333506946 To insert : 1333506947 To insert : 1333506948 To insert : 1333506949 To insert : 1333506950 To insert : 1333506951 To insert : 1333506952 To insert : 1333506953 To insert : 1333506954 To insert : 1333506955 To insert : 1333506956 To insert : 1333506958 To insert : 1333506959 To insert : 1333506960 To insert : 1333506961 To insert : 1333506962 To insert : 1333506963 To insert : 1333506706 To insert : 1333506707 To insert : 1333506708 To insert : 1333506709 To insert : 1333506711 To insert : 1333506712 To insert : 1333506713 To insert : 1333506714 To insert : 1333506715 To insert : 1333506716 To insert : 1333506717 To insert : 1333506718 To insert : 1333506719 To insert : 1333506720 To insert : 1333506721 To insert : 1333506722 To insert : 1333506723 To insert : 1333506724 To insert : 1333506725 To insert : 1333506726 To insert : 1333506727 To insert : 1333506728 To insert : 1333506730 To insert : 1333506731 To insert : 1333506732 To insert : 1333506733 To insert : 1333506734 To insert : 1333506735 To insert : 1333506736 To insert : 1333506737 To insert : 1333506738 To insert : 1333506739 To insert : 1333506740 To insert : 1333506810 To insert : 1333506811 To insert : 1333506812 To insert : 1333506813 To insert : 1333506814 To insert : 1333506815 To insert : 1333506816 To insert : 1333506817 To insert : 1333506818 To insert : 1333506819 To insert : 1333506820 To insert : 1333506822 To insert : 1333506823 To insert : 1333506824 To insert : 1333506825 To insert : 1333506826 To insert : 1333506827 To insert : 1333506828 To insert : 1333506833 To insert : 1333506834 To insert : 1333506835 To insert : 1333506836 To insert : 1333506837 To insert : 1333506838 To insert : 1333506839 To insert : 1333506840 To insert : 1333506841 To insert : 1333506842 To insert : 1333506843 To insert : 1333506844 To insert : 1333506846 To insert : 1333506847 To insert : 1333506848 To insert : 1333506673 To insert : 1333506674 To insert : 1333506675 To insert : 1333506676 To insert : 1333506677 To insert : 1333506678 To insert : 1333506679 To insert : 1333506680 To insert : 1333506681 To insert : 1333506682 To insert : 1333506683 To insert : 1333506684 To insert : 1333506685 To insert : 1333506686 To insert : 1333506687 To insert : 1333506688 To insert : 1333506689 To insert : 1333506690 To insert : 1333506691 To insert : 1333506692 To insert : 1333506693 To insert : 1333506694 To insert : 1333506695 To insert : 1333506696 To insert : 1333506697 To insert : 1333506698 To insert : 1333506699 To insert : 1333506700 To insert : 1333506701 To insert : 1333506702 To insert : 1333506703 To insert : 1333506704 To insert : 1333506705 To insert : 1333506741 To insert : 1333506742 To insert : 1333506743 To insert : 1333506744 To insert : 1333506745 To insert : 1333506746 To insert : 1333506747 To insert : 1333506748 To insert : 1333506749 To insert : 1333506750 To insert : 1333506751 To insert : 1333506752 To insert : 1333506753 To insert : 1333506754 To insert : 1333506755 To insert : 1333506756 To insert : 1333506757 To insert : 1333506758 To insert : 1333506759 To insert : 1333506760 To insert : 1333506762 To insert : 1333506763 To insert : 1333506764 To insert : 1333506765 To insert : 1333506766 To insert : 1333506768 To insert : 1333506769 To insert : 1333506770 To insert : 1333506771 To insert : 1333506772 To insert : 1333506773 To insert : 1333506774 To insert : 1333506775 time to insert the descriptors : 53.59273672103882 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 494 time used for this insertion : 0.03796029090881348 save missing photos in datou_result : time spend for datou_step_exec : 62.88663673400879 time spend to save output : 0.10060405731201172 total time spend for step 6 : 62.9872407913208 step7:ventilate_hashtags_in_portfolio Sat Feb 1 00:23:55 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20127306 get user id for portfolio 20127306 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127306 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('Film_plastique','carton','papier','autre','PEHD','Papier','Tetrapak','PET_fonce','mal_croppe','PET_clair','metal','flou','environnement','refus','pet_clair','Carton','pehd','pet_fonce')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127306 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('Film_plastique','carton','papier','autre','PEHD','Papier','Tetrapak','PET_fonce','mal_croppe','PET_clair','metal','flou','environnement','refus','pet_clair','Carton','pehd','pet_fonce')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127306 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('Film_plastique','carton','papier','autre','PEHD','Papier','Tetrapak','PET_fonce','mal_croppe','PET_clair','metal','flou','environnement','refus','pet_clair','Carton','pehd','pet_fonce')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127306 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('Film_plastique','carton','papier','autre','PEHD','Papier','Tetrapak','PET_fonce','mal_croppe','PET_clair','metal','flou','environnement','refus','pet_clair','Carton','pehd','pet_fonce')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20127377,20127392,20127382,20127380,20127393,20127383,20127394,20127385,20127391,20127387,20127388,20127389,20127390?tags=film_plastique,carton,papier,autre,pehd,tetrapak,pet_fonce,mal_croppe,pet_clair,metal,flou,environnement,refus&datou_id_consolidate=4235&port_consolidate=20127306 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1333488441, 1333488416, 1333488413, 1333488345] Looping around the photos to save general results len do output : 1 /20127306. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488441', None, None, None, None, None, '2535886') ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488416', None, None, None, None, None, '2535886') ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488413', None, None, None, None, None, '2535886') ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488345', None, None, None, None, None, '2535886') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.011903524398803711 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.7522449493408203 time spend to save output : 0.012294769287109375 total time spend for step 7 : 2.7645397186279297 step8:final Sat Feb 1 00:23:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1333488441: ('0.2047372684132672',), 1333488416: ('0.2047372684132672',), 1333488413: ('0.2047372684132672',), 1333488345: ('0.2047372684132672',)} new output for save of step final : {1333488441: ('0.2047372684132672',), 1333488416: ('0.2047372684132672',), 1333488413: ('0.2047372684132672',), 1333488345: ('0.2047372684132672',)} [1333488441, 1333488416, 1333488413, 1333488345] Looping around the photos to save general results len do output : 4 /1333488441.Didn't retrieve data . /1333488416.Didn't retrieve data . /1333488413.Didn't retrieve data . /1333488345.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488441', None, None, None, None, None, '2535886') ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488416', None, None, None, None, None, '2535886') ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488413', None, None, None, None, None, '2535886') ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488345', None, None, None, None, None, '2535886') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 12 time used for this insertion : 0.012889623641967773 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.15993237495422363 time spend to save output : 0.013313055038452148 total time spend for step 8 : 0.17324542999267578 step9:velours_tree Sat Feb 1 00:23:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20127377,20127392,20127382,20127380,20127393,20127383,20127394,20127385,20127391,20127387,20127388,20127389,20127390 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20127377 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20127392 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20127382 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20127380 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20127393 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20127383 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20127394 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20127385 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20127391 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20127387 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20127388 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20127389 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20127390 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 324 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [1 2 2 0 1 4 1 1 1 4 1 1 4 1 1 1 0 1 2 0 2 1 3 1 4 0 0 1 1 1 3 0 0 2 2 2 2 0 1 1 0 0 2 1 4 3 3 2 0 4 1 1 4 1 4 0 1 1 1 2 0 2 2 3 1 3 1 1 4 1 1 1 0 1 1 1 1 0 2 2 1 2 2 3 0 1 0 2 0 1 3 3 2 0 4 1 2 4 0 4 3 0 1 4 1 0 1 2 0 2 2 3 1 3 1 4 1 1 0 1 1 1 3 1 3 3 2 2 1 1 2 2 1 1 3 0 0 0 3 3 0 3 2 1 4 1 4 1 1 1 1 2 0 2 3 1 3 1 1 4 1 1 0 3 1 1 1 1 3 0 2 2 4 2 2 0 1 0 0 2 1 4 3 0 3 0 3 2 2 1 1 1 1 1 4 0 1 0 2 2 1 1 2 1 4 1 3 3 3 0 0 3 2 1 0 2 2 1 4 4 0 1 3 0 3 2 1 0 2 1 4 1 3 1 2 1 0 1 4 4 4 0 0 2 4 1 2 1 4 4 0 0 4 2 1 0 1 4 1 2 4 0 1 4 4 4 0 1 2 2 0 3 2 3 0 5 2 2 1 2 3 2 1 2 0 3 5 3 2 1 3 2 2 3 0 3 3 0 5 2 1 2 3 2 3 2 0 3 3 3 2 5 2 1 2 2 2 2 3 1 3 1 1 2] Elapsed time: 0.05519700050354004 graph_id used : 74882 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20127377,20127392,20127382,20127380,20127393,20127383,20127394,20127385,20127391,20127387,20127388,20127389,20127390?tags=film_plastique,carton,papier,autre,pehd,tetrapak,pet_fonce,mal_croppe,pet_clair,metal,flou,environnement,refus&datou_id_consolidate=4235&port_consolidate=20127306&tree_id=74882 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1333488441, 1333488416, 1333488413, 1333488345] Looping around the photos to save general results len do output : 1 /20127306Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488441', None, None, None, None, None, '2535886') ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488416', None, None, None, None, None, '2535886') ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488413', None, None, None, None, None, '2535886') ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488345', None, None, None, None, None, '2535886') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.013316631317138672 save_final save missing photos in datou_result : time spend for datou_step_exec : 21.641997814178467 time spend to save output : 0.013632774353027344 total time spend for step 9 : 21.655630588531494 step10:send_mail_cod Sat Feb 1 00:24:20 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20127306_01-02-2025_00_24_20.pdf 20127359 imagette201273591738365860 20127374 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201273741738365860 20127364 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201273641738365861 20127362 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201273621738365862 20127375 imagette201273751738365862 20127365 imagette201273651738365863 20127376 change filename to text .change filename to text .change filename to text .imagette201273761738365863 20127367 imagette201273671738365863 20127373 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201273731738365863 20127369 change filename to text .change filename to text .change filename to text .imagette201273691738365864 20127370 imagette201273701738365864 20127372 imagette201273721738365864 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20127306 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20127377,20127392,20127382,20127380,20127393,20127383,20127394,20127385,20127391,20127387,20127388,20127389,20127390?tags=film_plastique,carton,papier,autre,pehd,tetrapak,pet_fonce,mal_croppe,pet_clair,metal,flou,environnement,refus&datou_id_consolidate=4235&port_consolidate=20127306&tree_id=74882 your option no_mail is active, we will not send the real mail to your client args[1333488441] : ((1333488441, -8.312087350845452, 492609224), (1333488441, -0.09307328504835281, 496442774), '0.2047372684132672') We are sending mail with results at cod@fotonower.com args[1333488416] : ((1333488416, -8.310477020277615, 492609224), (1333488416, -0.08338370409812035, 496442774), '0.2047372684132672') We are sending mail with results at cod@fotonower.com args[1333488413] : ((1333488413, -8.307047131537074, 492609224), (1333488413, -0.07971504659972715, 496442774), '0.2047372684132672') We are sending mail with results at cod@fotonower.com args[1333488345] : ((1333488345, -8.30179451149958, 492609224), (1333488345, -0.08399421279933685, 496442774), '0.2047372684132672') We are sending mail with results at cod@fotonower.com refus_total : 0.2047372684132672 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20127306 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127306_01-02-2025_00_24_20.pdf results_Qualipapia_P20127306_01-02-2025_00_24_20.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127306_01-02-2025_00_24_20.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20127306','results_Qualipapia_P20127306_01-02-2025_00_24_20.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127306_01-02-2025_00_24_20.pdf','pdf','','0.19','0.2047372684132672') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1333488441, 1333488416, 1333488413, 1333488345] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488441', None, None, None, None, None, '2535886') ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488416', None, None, None, None, None, '2535886') ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488413', None, None, None, None, None, '2535886') ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488345', None, None, None, None, None, '2535886') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.01415109634399414 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.907291650772095 time spend to save output : 0.014402627944946289 total time spend for step 10 : 4.921694278717041 step11:split_time_score Sat Feb 1 00:24:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('19', 4),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 31012025 20127306 Nombre de photos uploadées : 4 / 23040 (0%) 31012025 20127306 Nombre de photos taguées (types de déchets): 4 / 4 (100%) 31012025 20127306 Nombre de photos taguées (volume) : 0 / 4 (0%) elapsed_time : load_data_split_time_score 5.0067901611328125e-06 elapsed_time : order_list_meta_photo_and_scores 1.4543533325195312e-05 ???? elapsed_time : fill_and_build_computed_from_old_data 0.00046253204345703125 elapsed_time : insert_dashboard_record_day_entry 0.024744033813476562 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps Qualite : 0.16675929361879244 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20104701_31-01-2025_08_52_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20104701 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20104701 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106630 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106631 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106632 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106633 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106634 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106635 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106636 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106637 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106638 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106639 order by id desc limit 1 Qualite : 0.19140746727627336 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20106640_31-01-2025_09_48_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106640 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20106640 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20106641 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108219 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108222 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108224 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108226 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108227 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108229 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108231 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108233 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108237 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20108239 order by id desc limit 1 Qualite : 0.2536259478254959 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20115128_31-01-2025_18_26_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20115128 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20115128 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110587 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110608 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110610 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110613 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110616 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110618 order by id desc limit 1 Qualite : 0.25117894084688863 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20110621_31-01-2025_11_49_32.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110621 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20110621 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110623 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110625 order by id desc limit 1 Qualite : 0.2879457038717212 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20110626_31-01-2025_11_33_37.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110626 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20110626 AND mptpi.`type`=4230 To do Qualite : 0.29441342724686403 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20110628_31-01-2025_11_19_41.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20110628 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20110628 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114557 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114558 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114559 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114560 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114561 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114562 order by id desc limit 1 Qualite : 0.23808314138688313 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20114563_31-01-2025_17_48_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114563 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20114563 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114564 order by id desc limit 1 Qualite : 0.2576423828494527 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20114565_31-01-2025_12_57_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114565 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20114565 AND mptpi.`type`=4230 To do Qualite : 0.19770651428243047 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20114566_31-01-2025_16_47_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20114566 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20114566 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113516 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113517 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113519 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113521 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113523 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113525 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113527 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113529 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113530 order by id desc limit 1 Qualite : 0.2760275473614038 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20113531_31-01-2025_12_33_09.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113531 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20113531 AND mptpi.`type`=4230 To do Qualite : 0.20026238582895103 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20113532_31-01-2025_12_18_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20113532 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20113532 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119099 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119100 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119101 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119102 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119103 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119104 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119105 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119106 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119107 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119108 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119109 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119110 order by id desc limit 1 Qualite : 0.20617911161510105 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20119111_31-01-2025_18_33_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119111 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119111 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119112 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119113 order by id desc limit 1 Qualite : 0.25044888642272845 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20119114_31-01-2025_18_17_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119114 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119114 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119335 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119336 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119337 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119338 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119339 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119340 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119341 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119342 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119343 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119344 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119345 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119346 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119347 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119348 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119349 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119350 order by id desc limit 1 Qualite : 0.21454922986087174 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20119351_31-01-2025_18_47_24.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119351 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119351 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119740 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119741 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119742 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119743 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119770 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119782 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119783 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119784 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119785 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119786 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119787 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119789 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119791 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119793 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119795 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119797 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119799 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119800 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119802 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119804 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119806 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119808 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119810 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119812 order by id desc limit 1 Qualite : 0.21446781006255577 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20119813_31-01-2025_19_40_40.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119813 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119813 AND mptpi.`type`=4230 To do Qualite : 0.16814914130885286 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20119814_31-01-2025_19_18_05.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20119814 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20119814 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120234 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120235 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120236 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120237 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120238 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120239 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120240 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120241 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120243 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120244 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120572 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120573 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120574 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120575 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120576 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120577 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120578 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120579 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120580 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120581 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120582 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120583 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120584 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120585 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120586 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120587 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120588 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120589 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120590 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120591 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120247 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120248 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120249 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120250 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120251 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120252 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120253 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120254 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120255 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120256 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120257 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120258 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120259 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120260 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120261 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120262 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120263 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120264 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120265 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120266 order by id desc limit 1 Qualite : 0.22127035710538484 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20120267_31-01-2025_19_48_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120267 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20120267 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120268 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120592 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120593 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120594 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120595 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120596 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120597 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120598 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120599 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120600 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120601 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120602 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120603 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120604 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120605 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120606 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120607 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120608 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120609 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120610 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120611 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120612 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120613 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120614 order by id desc limit 1 Qualite : 0.20803760148353112 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20120615_31-01-2025_20_32_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120615 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20120615 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120932 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120933 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120934 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120935 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120936 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120937 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120938 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120939 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120940 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120941 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120942 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120943 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120944 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120945 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120946 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120947 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120948 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120949 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120950 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120951 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120952 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120953 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120954 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20120955 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121223 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121225 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121226 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121228 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121230 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121232 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121234 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121236 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121238 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121240 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121242 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121244 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121246 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121248 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121249 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121250 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121251 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121252 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121253 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121254 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121255 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121256 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121293 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121294 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121295 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121296 order by id desc limit 1 Qualite : 0.21380180788067177 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20121297_31-01-2025_21_35_44.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121297 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121297 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121298 order by id desc limit 1 Qualite : 0.21134396715307036 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20121299_31-01-2025_21_18_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121299 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20121299 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20121300 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122167 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127274 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127275 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127276 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127277 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122170 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122171 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122172 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122173 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122174 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122175 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122176 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122177 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122178 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122179 order by id desc limit 1 Qualite : 0.23284957561511838 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20122180_31-01-2025_21_49_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122180 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20122180 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20122181 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127278 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127279 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127280 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127281 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127282 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127283 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127284 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127285 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127286 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127287 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127302 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123398 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123423 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123424 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123425 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123426 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123427 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123428 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123429 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123430 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123431 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123432 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123433 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123434 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123435 order by id desc limit 1 Qualite : 0.24394261262748643 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20123436_31-01-2025_22_33_10.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123436 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20123436 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123437 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123438 order by id desc limit 1 Qualite : 0.2256012896625769 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20123439_31-01-2025_22_18_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20123439 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20123439 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124861 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124862 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124863 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124864 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124865 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124866 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124867 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124868 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124869 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124870 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124871 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124872 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124873 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124874 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124875 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124876 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124877 order by id desc limit 1 Qualite : 0.21109570840898997 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20124878_31-01-2025_23_48_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124878 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20124878 AND mptpi.`type`=4230 To do Qualite : 0.17361163724086415 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20124896_31-01-2025_23_34_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124896 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20124896 AND mptpi.`type`=4230 To do Qualite : 0.20118689386707925 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20124922_31-01-2025_22_51_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20124922 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20124922 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127303 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127304 order by id desc limit 1 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127305_01-02-2025_00_27_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127305 order by id desc limit 1 Qualite : 0.2047372684132672 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20127306_01-02-2025_00_24_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20127306 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20127306 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'31012025': {'nb_upload': 4, 'nb_taggue_class': 4, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1333488441, 1333488416, 1333488413, 1333488345] Looping around the photos to save general results len do output : 1 /20127306Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488441', None, None, None, None, None, '2535886') ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488416', None, None, None, None, None, '2535886') ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488413', None, None, None, None, None, '2535886') ('4234', None, None, None, None, None, None, None, '2535886') ('4234', '20127306', '1333488345', None, None, None, None, None, '2535886') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 5 time used for this insertion : 0.015431404113769531 save_final save missing photos in datou_result : time spend for datou_step_exec : 230.0744411945343 time spend to save output : 0.015616655349731445 total time spend for step 11 : 230.09005784988403 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 4 set_done_treatment 53.15user 33.42system 7:49.18elapsed 18%CPU (0avgtext+0avgdata 2494692maxresident)k 2692424inputs+23080outputs (9398major+2751876minor)pagefaults 0swaps