python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1430713 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2537948'] with mtr_portfolio_ids : ['20144249'] and first list_photo_ids : [] new path : /proc/1430713/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 3 ; length of list_pids : 3 ; length of list_args : 3 time to download the photos : 0.47063589096069336 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Sat Feb 1 20:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10332 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-01 20:20:32.261509: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-01 20:20:32.287552: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493020000 Hz 2025-02-01 20:20:32.289512: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f8a34000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-01 20:20:32.289577: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-01 20:20:32.293642: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-01 20:20:32.558081: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x8924950 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-01 20:20:32.558154: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-01 20:20:32.559018: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 20:20:32.559831: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 20:20:32.563532: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 20:20:32.567687: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 20:20:32.568613: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 20:20:32.574030: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 20:20:32.576652: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 20:20:32.586745: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 20:20:32.588610: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 20:20:32.588750: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 20:20:32.589699: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-01 20:20:32.589723: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-01 20:20:32.589737: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-01 20:20:32.591623: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9570 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-01 20:20:32.931935: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 20:20:32.932090: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 20:20:32.932119: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 20:20:32.932146: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 20:20:32.932170: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 20:20:32.932195: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 20:20:32.932218: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 20:20:32.932242: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 20:20:32.933644: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 20:20:32.935047: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-01 20:20:32.935081: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-01 20:20:32.935097: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 20:20:32.935112: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-01 20:20:32.935126: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-01 20:20:32.935140: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-01 20:20:32.935154: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-01 20:20:32.935168: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-01 20:20:32.936442: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-01 20:20:32.936485: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-01 20:20:32.936495: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-01 20:20:32.936503: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-01 20:20:32.937773: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9570 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-01 20:20:40.652978: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-01 20:20:40.822084: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 3 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.62578 max: 148.94375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 9.441375732421875e-05 nb_pixel_total : 411 time to create 1 rle with old method : 0.0008420944213867188 length of segment : 25 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 99 time to create 1 rle with old method : 0.0002086162567138672 length of segment : 28 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 920 time to create 1 rle with old method : 0.001676321029663086 length of segment : 34 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 111 time to create 1 rle with old method : 0.0002205371856689453 length of segment : 29 length of segment : 0 time for calcul the mask position with numpy : 0.00019788742065429688 nb_pixel_total : 3607 time to create 1 rle with old method : 0.00584864616394043 length of segment : 79 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.77813 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 401 time to create 1 rle with old method : 0.0010144710540771484 length of segment : 17 time for calcul the mask position with numpy : 0.00019216537475585938 nb_pixel_total : 3432 time to create 1 rle with old method : 0.006978750228881836 length of segment : 45 time for calcul the mask position with numpy : 8.797645568847656e-05 nb_pixel_total : 589 time to create 1 rle with old method : 0.0013194084167480469 length of segment : 31 time for calcul the mask position with numpy : 0.0001277923583984375 nb_pixel_total : 2686 time to create 1 rle with old method : 0.005488157272338867 length of segment : 54 time for calcul the mask position with numpy : 0.00013685226440429688 nb_pixel_total : 3238 time to create 1 rle with old method : 0.00651097297668457 length of segment : 42 time for calcul the mask position with numpy : 0.00013971328735351562 nb_pixel_total : 2306 time to create 1 rle with old method : 0.004712343215942383 length of segment : 49 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.36016 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.00016355514526367188 nb_pixel_total : 6651 time to create 1 rle with old method : 0.012193918228149414 length of segment : 103 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.02031 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 189 time to create 1 rle with old method : 0.00027871131896972656 length of segment : 16 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 1388 time to create 1 rle with old method : 0.0017657279968261719 length of segment : 52 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 722 time to create 1 rle with old method : 0.0009107589721679688 length of segment : 56 time for calcul the mask position with numpy : 0.00022029876708984375 nb_pixel_total : 13045 time to create 1 rle with old method : 0.015172481536865234 length of segment : 182 time for calcul the mask position with numpy : 0.00013780593872070312 nb_pixel_total : 8011 time to create 1 rle with old method : 0.009702920913696289 length of segment : 127 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 100 time to create 1 rle with old method : 0.000164031982421875 length of segment : 16 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 160 time to create 1 rle with old method : 0.00025534629821777344 length of segment : 12 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.10781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 1182 time to create 1 rle with old method : 0.002146482467651367 length of segment : 36 time for calcul the mask position with numpy : 7.510185241699219e-05 nb_pixel_total : 1860 time to create 1 rle with old method : 0.0030875205993652344 length of segment : 125 time for calcul the mask position with numpy : 0.0001380443572998047 nb_pixel_total : 5723 time to create 1 rle with old method : 0.008855342864990234 length of segment : 60 time for calcul the mask position with numpy : 5.817413330078125e-05 nb_pixel_total : 1089 time to create 1 rle with old method : 0.001329660415649414 length of segment : 82 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 440 time to create 1 rle with old method : 0.0006296634674072266 length of segment : 18 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 1169 time to create 1 rle with old method : 0.0015289783477783203 length of segment : 31 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 1400 time to create 1 rle with old method : 0.0023381710052490234 length of segment : 148 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 454 time to create 1 rle with old method : 0.0009281635284423828 length of segment : 17 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 455 time to create 1 rle with old method : 0.0008530616760253906 length of segment : 18 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 105 time to create 1 rle with old method : 0.0002472400665283203 length of segment : 13 Processing 1 images image shape: (400, 400, 3) min: 16.00000 max: 218.00000 molded_images shape: (1, 640, 640, 3) min: -87.28984 max: 92.04375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.001218557357788086 nb_pixel_total : 152928 time to create 1 rle with new method : 0.0019669532775878906 length of segment : 397 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.54766 max: 151.08047 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 378 time to create 1 rle with old method : 0.0005445480346679688 length of segment : 27 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 844 time to create 1 rle with old method : 0.0010938644409179688 length of segment : 33 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 1221 time to create 1 rle with old method : 0.0016322135925292969 length of segment : 43 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 519 time to create 1 rle with old method : 0.0007240772247314453 length of segment : 19 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 401 time to create 1 rle with old method : 0.0005543231964111328 length of segment : 41 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 142 time to create 1 rle with old method : 0.0002276897430419922 length of segment : 11 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 106 time to create 1 rle with old method : 0.0001671314239501953 length of segment : 13 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 820 time to create 1 rle with old method : 0.0010995864868164062 length of segment : 35 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 221 time to create 1 rle with old method : 0.0003330707550048828 length of segment : 18 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 142 time to create 1 rle with old method : 0.0002155303955078125 length of segment : 17 Processing 1 images image shape: (400, 400, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.09063 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 251 time to create 1 rle with old method : 0.0003762245178222656 length of segment : 17 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.00030303001403808594 length of segment : 30 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 324 time to create 1 rle with old method : 0.00045108795166015625 length of segment : 23 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.00030612945556640625 length of segment : 13 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.0002899169921875 length of segment : 15 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 526 time to create 1 rle with old method : 0.0006735324859619141 length of segment : 42 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 392 time to create 1 rle with old method : 0.0006222724914550781 length of segment : 17 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.21563 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 8.821487426757812e-05 nb_pixel_total : 660 time to create 1 rle with old method : 0.0012645721435546875 length of segment : 47 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.0005211830139160156 length of segment : 23 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 840 time to create 1 rle with old method : 0.0014905929565429688 length of segment : 37 time for calcul the mask position with numpy : 0.00010752677917480469 nb_pixel_total : 2436 time to create 1 rle with old method : 0.0043828487396240234 length of segment : 48 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 169 time to create 1 rle with old method : 0.0004470348358154297 length of segment : 18 time for calcul the mask position with numpy : 0.00016164779663085938 nb_pixel_total : 1577 time to create 1 rle with old method : 0.0029914379119873047 length of segment : 131 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 679 time to create 1 rle with old method : 0.001081705093383789 length of segment : 32 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 2294 time to create 1 rle with old method : 0.004307746887207031 length of segment : 53 time for calcul the mask position with numpy : 7.796287536621094e-05 nb_pixel_total : 2017 time to create 1 rle with old method : 0.0031404495239257812 length of segment : 42 time for calcul the mask position with numpy : 0.00010752677917480469 nb_pixel_total : 1392 time to create 1 rle with old method : 0.004212856292724609 length of segment : 79 time for calcul the mask position with numpy : 8.106231689453125e-05 nb_pixel_total : 1356 time to create 1 rle with old method : 0.0022487640380859375 length of segment : 42 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 298 time to create 1 rle with old method : 0.0004696846008300781 length of segment : 20 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 1714 time to create 1 rle with old method : 0.0025568008422851562 length of segment : 45 time for calcul the mask position with numpy : 0.00012826919555664062 nb_pixel_total : 4284 time to create 1 rle with old method : 0.005679607391357422 length of segment : 92 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.54531 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 406 time to create 1 rle with old method : 0.0005283355712890625 length of segment : 38 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 1369 time to create 1 rle with old method : 0.0016977787017822266 length of segment : 60 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 526 time to create 1 rle with old method : 0.00070953369140625 length of segment : 41 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 1599 time to create 1 rle with old method : 0.002012968063354492 length of segment : 81 time for calcul the mask position with numpy : 0.0002377033233642578 nb_pixel_total : 5173 time to create 1 rle with old method : 0.008013248443603516 length of segment : 230 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 703 time to create 1 rle with old method : 0.0008704662322998047 length of segment : 47 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 858 time to create 1 rle with old method : 0.0010879039764404297 length of segment : 36 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 1117 time to create 1 rle with old method : 0.0015757083892822266 length of segment : 75 time for calcul the mask position with numpy : 0.00019288063049316406 nb_pixel_total : 2499 time to create 1 rle with old method : 0.003245115280151367 length of segment : 55 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 405 time to create 1 rle with old method : 0.0005555152893066406 length of segment : 27 time for calcul the mask position with numpy : 0.0001697540283203125 nb_pixel_total : 3871 time to create 1 rle with old method : 0.004684925079345703 length of segment : 179 Processing 1 images image shape: (280, 400, 3) min: 8.00000 max: 203.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 74.68047 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 545 time to create 1 rle with old method : 0.0009181499481201172 length of segment : 54 time for calcul the mask position with numpy : 0.0014214515686035156 nb_pixel_total : 106598 time to create 1 rle with old method : 0.13735246658325195 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.84219 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 1618 time to create 1 rle with old method : 0.0018591880798339844 length of segment : 86 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 200 time to create 1 rle with old method : 0.0002956390380859375 length of segment : 26 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 180 time to create 1 rle with old method : 0.0002639293670654297 length of segment : 21 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.00041675567626953125 length of segment : 16 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 267 time to create 1 rle with old method : 0.0003936290740966797 length of segment : 30 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 228 time to create 1 rle with old method : 0.00046825408935546875 length of segment : 16 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 97 time to create 1 rle with old method : 0.00020956993103027344 length of segment : 17 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 77 time to create 1 rle with old method : 0.0002033710479736328 length of segment : 9 time for calcul the mask position with numpy : 0.0001914501190185547 nb_pixel_total : 4290 time to create 1 rle with old method : 0.0077893733978271484 length of segment : 160 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 37 time for calcul the mask position with numpy : 8.96453857421875e-05 nb_pixel_total : 463 time to create 1 rle with old method : 0.0011286735534667969 length of segment : 28 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 152 time to create 1 rle with old method : 0.0004534721374511719 length of segment : 17 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 190 time to create 1 rle with old method : 0.0005431175231933594 length of segment : 18 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 263 time to create 1 rle with old method : 0.00040602684020996094 length of segment : 16 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 107 time to create 1 rle with old method : 0.0001938343048095703 length of segment : 10 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 1321 time to create 1 rle with old method : 0.0016484260559082031 length of segment : 51 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 193 time to create 1 rle with old method : 0.0003294944763183594 length of segment : 12 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.00043129920959472656 length of segment : 16 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 392 time to create 1 rle with old method : 0.0005185604095458984 length of segment : 25 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 401 time to create 1 rle with old method : 0.0005490779876708984 length of segment : 21 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 220 time to create 1 rle with old method : 0.0003075599670410156 length of segment : 16 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 281 time to create 1 rle with old method : 0.00037479400634765625 length of segment : 31 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 305 time to create 1 rle with old method : 0.00043272972106933594 length of segment : 25 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 1880 time to create 1 rle with old method : 0.00231170654296875 length of segment : 62 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 234 time to create 1 rle with old method : 0.00034308433532714844 length of segment : 18 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 377 time to create 1 rle with old method : 0.0005238056182861328 length of segment : 19 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 295 time to create 1 rle with old method : 0.00042557716369628906 length of segment : 18 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 423 time to create 1 rle with old method : 0.0005757808685302734 length of segment : 27 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.00020194053649902344 length of segment : 10 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 623 time to create 1 rle with old method : 0.0008146762847900391 length of segment : 25 time for calcul the mask position with numpy : 0.00012111663818359375 nb_pixel_total : 2489 time to create 1 rle with old method : 0.0030117034912109375 length of segment : 151 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 231 time to create 1 rle with old method : 0.0003452301025390625 length of segment : 17 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 2055 time to create 1 rle with old method : 0.00252532958984375 length of segment : 58 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 94 time to create 1 rle with old method : 0.00015974044799804688 length of segment : 11 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 367 time to create 1 rle with old method : 0.0005252361297607422 length of segment : 23 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 1300 time to create 1 rle with old method : 0.0017588138580322266 length of segment : 20 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 535 time to create 1 rle with old method : 0.0006885528564453125 length of segment : 39 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 721 time to create 1 rle with old method : 0.0009675025939941406 length of segment : 32 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 407 time to create 1 rle with old method : 0.0005593299865722656 length of segment : 23 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 58 time to create 1 rle with old method : 0.00011539459228515625 length of segment : 8 time for calcul the mask position with numpy : 0.00011086463928222656 nb_pixel_total : 2254 time to create 1 rle with old method : 0.0027544498443603516 length of segment : 122 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 199 time to create 1 rle with old method : 0.0002982616424560547 length of segment : 18 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 1218 time to create 1 rle with old method : 0.001646280288696289 length of segment : 18 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.000347137451171875 length of segment : 16 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 846 time to create 1 rle with old method : 0.0010724067687988281 length of segment : 40 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 1098 time to create 1 rle with old method : 0.0014455318450927734 length of segment : 73 time for calcul the mask position with numpy : 0.00011777877807617188 nb_pixel_total : 2407 time to create 1 rle with old method : 0.0027725696563720703 length of segment : 129 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.17031 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 731 time to create 1 rle with old method : 0.0011539459228515625 length of segment : 31 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 501 time to create 1 rle with old method : 0.0006678104400634766 length of segment : 32 time for calcul the mask position with numpy : 9.632110595703125e-05 nb_pixel_total : 2363 time to create 1 rle with old method : 0.0029761791229248047 length of segment : 91 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 760 time to create 1 rle with old method : 0.0010745525360107422 length of segment : 18 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 877 time to create 1 rle with old method : 0.0011839866638183594 length of segment : 31 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 970 time to create 1 rle with old method : 0.0014677047729492188 length of segment : 43 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 59 time to create 1 rle with old method : 0.0001163482666015625 length of segment : 9 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 378 time to create 1 rle with old method : 0.0005085468292236328 length of segment : 30 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.00020456314086914062 length of segment : 34 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 176 time to create 1 rle with old method : 0.0002791881561279297 length of segment : 21 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.0003151893615722656 length of segment : 19 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 509 time to create 1 rle with old method : 0.0007426738739013672 length of segment : 36 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 140 time to create 1 rle with old method : 0.00021386146545410156 length of segment : 15 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 134.60000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.0001049041748046875 nb_pixel_total : 295 time to create 1 rle with old method : 0.0004248619079589844 length of segment : 41 time for calcul the mask position with numpy : 9.5367431640625e-05 nb_pixel_total : 977 time to create 1 rle with old method : 0.0014948844909667969 length of segment : 90 time for calcul the mask position with numpy : 0.0005042552947998047 nb_pixel_total : 39067 time to create 1 rle with old method : 0.048848867416381836 length of segment : 267 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.59453 max: 148.31484 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 425 time to create 1 rle with old method : 0.0005276203155517578 length of segment : 27 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 54 time to create 1 rle with old method : 0.00010943412780761719 length of segment : 22 time for calcul the mask position with numpy : 7.414817810058594e-05 nb_pixel_total : 121 time to create 1 rle with old method : 0.0002522468566894531 length of segment : 31 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 660 time to create 1 rle with old method : 0.0015759468078613281 length of segment : 40 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 205 time to create 1 rle with old method : 0.0003159046173095703 length of segment : 16 time for calcul the mask position with numpy : 8.225440979003906e-05 nb_pixel_total : 813 time to create 1 rle with old method : 0.0012362003326416016 length of segment : 33 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 925 time to create 1 rle with old method : 0.0012764930725097656 length of segment : 36 time for calcul the mask position with numpy : 0.00022864341735839844 nb_pixel_total : 6562 time to create 1 rle with old method : 0.008512258529663086 length of segment : 207 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 1237 time to create 1 rle with old method : 0.0016307830810546875 length of segment : 79 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.24688 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 8.0108642578125e-05 nb_pixel_total : 559 time to create 1 rle with old method : 0.0007185935974121094 length of segment : 28 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 354 time to create 1 rle with old method : 0.0004987716674804688 length of segment : 16 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 418 time to create 1 rle with old method : 0.0005743503570556641 length of segment : 18 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 2927 time to create 1 rle with old method : 0.003609180450439453 length of segment : 70 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 2198 time to create 1 rle with old method : 0.0026068687438964844 length of segment : 47 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 2464 time to create 1 rle with old method : 0.003026723861694336 length of segment : 50 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.18438 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 0.00010704994201660156 nb_pixel_total : 6732 time to create 1 rle with old method : 0.007528543472290039 length of segment : 105 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 918 time to create 1 rle with old method : 0.0014069080352783203 length of segment : 13 time for calcul the mask position with numpy : 8.58306884765625e-05 nb_pixel_total : 1837 time to create 1 rle with old method : 0.0024275779724121094 length of segment : 104 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.66875 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 218 time to create 1 rle with old method : 0.00031375885009765625 length of segment : 16 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 79 time to create 1 rle with old method : 0.00012946128845214844 length of segment : 14 time for calcul the mask position with numpy : 0.00020074844360351562 nb_pixel_total : 12808 time to create 1 rle with old method : 0.014880180358886719 length of segment : 202 time for calcul the mask position with numpy : 7.176399230957031e-05 nb_pixel_total : 1274 time to create 1 rle with old method : 0.0015189647674560547 length of segment : 55 time for calcul the mask position with numpy : 0.00014662742614746094 nb_pixel_total : 7615 time to create 1 rle with old method : 0.009191036224365234 length of segment : 126 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 176 time to create 1 rle with old method : 0.0002846717834472656 length of segment : 12 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.0002911090850830078 length of segment : 19 time for calcul the mask position with numpy : 0.00023603439331054688 nb_pixel_total : 12338 time to create 1 rle with old method : 0.014267206192016602 length of segment : 173 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 126 time to create 1 rle with old method : 0.0002319812774658203 length of segment : 8 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 768 time to create 1 rle with old method : 0.0009670257568359375 length of segment : 58 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 263 time to create 1 rle with old method : 0.0003705024719238281 length of segment : 25 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.30703 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 1793 time to create 1 rle with old method : 0.002160787582397461 length of segment : 128 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 110 time to create 1 rle with old method : 0.00020241737365722656 length of segment : 11 time for calcul the mask position with numpy : 0.00012636184692382812 nb_pixel_total : 6116 time to create 1 rle with old method : 0.007485151290893555 length of segment : 59 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 1230 time to create 1 rle with old method : 0.0014052391052246094 length of segment : 82 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 102 time to create 1 rle with old method : 0.0001857280731201172 length of segment : 10 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 1172 time to create 1 rle with old method : 0.0014996528625488281 length of segment : 36 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 496 time to create 1 rle with old method : 0.0006814002990722656 length of segment : 19 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 487 time to create 1 rle with old method : 0.0006721019744873047 length of segment : 19 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 1510 time to create 1 rle with old method : 0.0017495155334472656 length of segment : 119 Processing 1 images image shape: (400, 400, 3) min: 17.00000 max: 226.00000 molded_images shape: (1, 640, 640, 3) min: -83.22734 max: 96.56328 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0013821125030517578 nb_pixel_total : 153034 time to create 1 rle with new method : 0.002362489700317383 length of segment : 396 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.45781 max: 150.78359 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 354 time to create 1 rle with old method : 0.0005285739898681641 length of segment : 27 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 818 time to create 1 rle with old method : 0.0010573863983154297 length of segment : 33 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 1225 time to create 1 rle with old method : 0.001547098159790039 length of segment : 44 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 945 time to create 1 rle with old method : 0.0012516975402832031 length of segment : 40 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 502 time to create 1 rle with old method : 0.0006961822509765625 length of segment : 18 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 396 time to create 1 rle with old method : 0.000553131103515625 length of segment : 41 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 147 time to create 1 rle with old method : 0.00023031234741210938 length of segment : 12 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 153 time to create 1 rle with old method : 0.00026679039001464844 length of segment : 27 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 100 time to create 1 rle with old method : 0.00015687942504882812 length of segment : 13 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 174 time to create 1 rle with old method : 0.0002715587615966797 length of segment : 12 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 1075 time to create 1 rle with old method : 0.0013968944549560547 length of segment : 36 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.81328 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 319 time to create 1 rle with old method : 0.00045609474182128906 length of segment : 22 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 351 time to create 1 rle with old method : 0.0005121231079101562 length of segment : 31 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.0001990795135498047 length of segment : 16 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 714 time to create 1 rle with old method : 0.0009024143218994141 length of segment : 30 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 202 time to create 1 rle with old method : 0.0003170967102050781 length of segment : 16 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 709 time to create 1 rle with old method : 0.0009348392486572266 length of segment : 29 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 699 time to create 1 rle with old method : 0.0010209083557128906 length of segment : 25 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 182 time to create 1 rle with old method : 0.00026726722717285156 length of segment : 26 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 665 time to create 1 rle with old method : 0.0009081363677978516 length of segment : 32 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 459 time to create 1 rle with old method : 0.0005960464477539062 length of segment : 24 time for calcul the mask position with numpy : 0.00024890899658203125 nb_pixel_total : 779 time to create 1 rle with old method : 0.0011701583862304688 length of segment : 39 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002827644348144531 length of segment : 12 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 175 time to create 1 rle with old method : 0.0002722740173339844 length of segment : 25 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 329 time to create 1 rle with old method : 0.0005879402160644531 length of segment : 29 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.39922 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 667 time to create 1 rle with old method : 0.001188039779663086 length of segment : 45 time for calcul the mask position with numpy : 8.7738037109375e-05 nb_pixel_total : 2852 time to create 1 rle with old method : 0.0077304840087890625 length of segment : 57 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 174 time to create 1 rle with old method : 0.002184629440307617 length of segment : 19 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 623 time to create 1 rle with old method : 0.0011262893676757812 length of segment : 31 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 1198 time to create 1 rle with old method : 0.0020532608032226562 length of segment : 38 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 299 time to create 1 rle with old method : 0.000583648681640625 length of segment : 21 time for calcul the mask position with numpy : 0.00011420249938964844 nb_pixel_total : 1446 time to create 1 rle with old method : 0.006072998046875 length of segment : 122 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 834 time to create 1 rle with old method : 0.0014426708221435547 length of segment : 37 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 2617 time to create 1 rle with old method : 0.003216981887817383 length of segment : 40 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 900 time to create 1 rle with old method : 0.0012371540069580078 length of segment : 44 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 2463 time to create 1 rle with old method : 0.0029485225677490234 length of segment : 51 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.54531 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 322 time to create 1 rle with old method : 0.00046324729919433594 length of segment : 16 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 384 time to create 1 rle with old method : 0.0004892349243164062 length of segment : 30 time for calcul the mask position with numpy : 7.939338684082031e-05 nb_pixel_total : 2982 time to create 1 rle with old method : 0.0034949779510498047 length of segment : 95 time for calcul the mask position with numpy : 7.462501525878906e-05 nb_pixel_total : 1519 time to create 1 rle with old method : 0.0020291805267333984 length of segment : 108 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 1224 time to create 1 rle with old method : 0.0016028881072998047 length of segment : 94 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 97 time to create 1 rle with old method : 0.0001761913299560547 length of segment : 15 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 251 time to create 1 rle with old method : 0.0003502368927001953 length of segment : 36 time for calcul the mask position with numpy : 0.00016927719116210938 nb_pixel_total : 4137 time to create 1 rle with old method : 0.004720211029052734 length of segment : 183 time for calcul the mask position with numpy : 0.00018978118896484375 nb_pixel_total : 5240 time to create 1 rle with old method : 0.006058216094970703 length of segment : 225 Processing 1 images image shape: (280, 400, 3) min: 12.00000 max: 202.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 70.32500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 555 time to create 1 rle with old method : 0.0007281303405761719 length of segment : 57 time for calcul the mask position with numpy : 0.0009624958038330078 nb_pixel_total : 106480 time to create 1 rle with old method : 0.11897540092468262 length of segment : 280 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.20937 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 7.915496826171875e-05 nb_pixel_total : 1665 time to create 1 rle with old method : 0.0020513534545898438 length of segment : 89 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 213 time to create 1 rle with old method : 0.0002923011779785156 length of segment : 28 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 89 time to create 1 rle with old method : 0.0001373291015625 length of segment : 19 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 183 time to create 1 rle with old method : 0.00028586387634277344 length of segment : 15 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 214 time to create 1 rle with old method : 0.0003669261932373047 length of segment : 16 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 177 time to create 1 rle with old method : 0.0002505779266357422 length of segment : 21 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 84 time to create 1 rle with old method : 0.00014710426330566406 length of segment : 11 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 233 time to create 1 rle with old method : 0.00033593177795410156 length of segment : 30 time for calcul the mask position with numpy : 0.00012350082397460938 nb_pixel_total : 6947 time to create 1 rle with old method : 0.00806879997253418 length of segment : 97 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 42 time for calcul the mask position with numpy : 9.72747802734375e-05 nb_pixel_total : 495 time to create 1 rle with old method : 0.0006716251373291016 length of segment : 29 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 135 time to create 1 rle with old method : 0.00022602081298828125 length of segment : 15 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 243 time to create 1 rle with old method : 0.00037097930908203125 length of segment : 14 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 208 time to create 1 rle with old method : 0.0003173351287841797 length of segment : 12 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 141 time to create 1 rle with old method : 0.000217437744140625 length of segment : 10 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 1292 time to create 1 rle with old method : 0.0015037059783935547 length of segment : 51 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 115 time to create 1 rle with old method : 0.00018906593322753906 length of segment : 11 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 185 time to create 1 rle with old method : 0.00028061866760253906 length of segment : 17 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 392 time to create 1 rle with old method : 0.0005056858062744141 length of segment : 21 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 217 time to create 1 rle with old method : 0.00031948089599609375 length of segment : 18 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 379 time to create 1 rle with old method : 0.0005564689636230469 length of segment : 21 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 688 time to create 1 rle with old method : 0.0012621879577636719 length of segment : 31 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 312 time to create 1 rle with old method : 0.0004444122314453125 length of segment : 18 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 1339 time to create 1 rle with old method : 0.001832723617553711 length of segment : 21 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 300 time to create 1 rle with old method : 0.0004379749298095703 length of segment : 19 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 253 time to create 1 rle with old method : 0.0003428459167480469 length of segment : 18 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 83 time to create 1 rle with old method : 0.00012946128845214844 length of segment : 12 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 319 time to create 1 rle with old method : 0.00043654441833496094 length of segment : 25 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 214 time to create 1 rle with old method : 0.0003032684326171875 length of segment : 17 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 590 time to create 1 rle with old method : 0.0007436275482177734 length of segment : 41 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 54 time to create 1 rle with old method : 0.00010895729064941406 length of segment : 9 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.0003247261047363281 length of segment : 37 time for calcul the mask position with numpy : 0.00015163421630859375 nb_pixel_total : 2399 time to create 1 rle with old method : 0.002876758575439453 length of segment : 148 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 83 time to create 1 rle with old method : 0.00017333030700683594 length of segment : 11 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 260 time to create 1 rle with old method : 0.000392913818359375 length of segment : 21 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.000499725341796875 length of segment : 18 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 411 time to create 1 rle with old method : 0.0006432533264160156 length of segment : 23 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 304 time to create 1 rle with old method : 0.00046515464782714844 length of segment : 22 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 511 time to create 1 rle with old method : 0.0007274150848388672 length of segment : 35 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 310 time to create 1 rle with old method : 0.00041103363037109375 length of segment : 21 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 59 time to create 1 rle with old method : 0.00011754035949707031 length of segment : 9 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1307 time to create 1 rle with old method : 0.0019593238830566406 length of segment : 20 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.00027179718017578125 length of segment : 15 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 691 time to create 1 rle with old method : 0.0008478164672851562 length of segment : 28 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 393 time to create 1 rle with old method : 0.0005633831024169922 length of segment : 23 time for calcul the mask position with numpy : 0.0001289844512939453 nb_pixel_total : 2011 time to create 1 rle with old method : 0.003081798553466797 length of segment : 75 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.0004200935363769531 length of segment : 19 time for calcul the mask position with numpy : 0.00011491775512695312 nb_pixel_total : 2221 time to create 1 rle with old method : 0.003254413604736328 length of segment : 126 time for calcul the mask position with numpy : 0.00010752677917480469 nb_pixel_total : 1611 time to create 1 rle with old method : 0.0024154186248779297 length of segment : 59 time for calcul the mask position with numpy : 7.2479248046875e-05 nb_pixel_total : 235 time to create 1 rle with old method : 0.0005707740783691406 length of segment : 18 time for calcul the mask position with numpy : 8.58306884765625e-05 nb_pixel_total : 1782 time to create 1 rle with old method : 0.0031058788299560547 length of segment : 82 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.00046515464782714844 length of segment : 16 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.25625 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 545 time to create 1 rle with old method : 0.0007297992706298828 length of segment : 31 time for calcul the mask position with numpy : 0.00010323524475097656 nb_pixel_total : 3060 time to create 1 rle with old method : 0.003528594970703125 length of segment : 90 time for calcul the mask position with numpy : 8.130073547363281e-05 nb_pixel_total : 743 time to create 1 rle with old method : 0.0009529590606689453 length of segment : 34 time for calcul the mask position with numpy : 5.316734313964844e-05 nb_pixel_total : 802 time to create 1 rle with old method : 0.0010480880737304688 length of segment : 27 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 736 time to create 1 rle with old method : 0.0011227130889892578 length of segment : 38 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 350 time to create 1 rle with old method : 0.0004572868347167969 length of segment : 28 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 644 time to create 1 rle with old method : 0.0009484291076660156 length of segment : 16 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 519 time to create 1 rle with old method : 0.0006945133209228516 length of segment : 38 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 218 time to create 1 rle with old method : 0.0003204345703125 length of segment : 19 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 59 time to create 1 rle with old method : 0.00010895729064941406 length of segment : 10 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 134.60000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 6.532669067382812e-05 nb_pixel_total : 322 time to create 1 rle with old method : 0.0004284381866455078 length of segment : 41 time for calcul the mask position with numpy : 0.00040149688720703125 nb_pixel_total : 36367 time to create 1 rle with old method : 0.04528212547302246 length of segment : 225 time for calcul the mask position with numpy : 0.0005524158477783203 nb_pixel_total : 49217 time to create 1 rle with old method : 0.0667121410369873 length of segment : 253 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.18438 max: 147.78750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 444 time to create 1 rle with old method : 0.0005829334259033203 length of segment : 26 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 121 time to create 1 rle with old method : 0.00017213821411132812 length of segment : 30 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 97 time to create 1 rle with old method : 0.00015425682067871094 length of segment : 25 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 974 time to create 1 rle with old method : 0.001293182373046875 length of segment : 40 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 867 time to create 1 rle with old method : 0.0011649131774902344 length of segment : 36 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 3 time to create 1 rle with old method : 2.3603439331054688e-05 length of segment : 3 time for calcul the mask position with numpy : 0.00016236305236816406 nb_pixel_total : 2502 time to create 1 rle with old method : 0.003311634063720703 length of segment : 105 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 180 time to create 1 rle with old method : 0.0002872943878173828 length of segment : 14 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 1529 time to create 1 rle with old method : 0.002050638198852539 length of segment : 49 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -117.22344 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 408 time to create 1 rle with old method : 0.0006170272827148438 length of segment : 17 time for calcul the mask position with numpy : 0.00011110305786132812 nb_pixel_total : 3599 time to create 1 rle with old method : 0.004403352737426758 length of segment : 45 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 562 time to create 1 rle with old method : 0.0006928443908691406 length of segment : 29 time for calcul the mask position with numpy : 9.202957153320312e-05 nb_pixel_total : 2381 time to create 1 rle with old method : 0.0029058456420898438 length of segment : 53 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 568 time to create 1 rle with old method : 0.0007338523864746094 length of segment : 62 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 373 time to create 1 rle with old method : 0.0005314350128173828 length of segment : 17 time for calcul the mask position with numpy : 7.295608520507812e-05 nb_pixel_total : 2673 time to create 1 rle with old method : 0.003021240234375 length of segment : 54 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 2371 time to create 1 rle with old method : 0.0028908252716064453 length of segment : 51 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.87969 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.0002033710479736328 nb_pixel_total : 6317 time to create 1 rle with old method : 0.009555339813232422 length of segment : 101 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 176 time to create 1 rle with old method : 0.0002696514129638672 length of segment : 15 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.83281 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 214 time to create 1 rle with old method : 0.0004582405090332031 length of segment : 16 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 885 time to create 1 rle with old method : 0.0015149116516113281 length of segment : 57 time for calcul the mask position with numpy : 8.416175842285156e-05 nb_pixel_total : 1625 time to create 1 rle with old method : 0.0028772354125976562 length of segment : 52 time for calcul the mask position with numpy : 0.00021982192993164062 nb_pixel_total : 7742 time to create 1 rle with old method : 0.013429880142211914 length of segment : 138 time for calcul the mask position with numpy : 0.0003142356872558594 nb_pixel_total : 11331 time to create 1 rle with old method : 0.012992143630981445 length of segment : 171 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.0001881122589111328 length of segment : 18 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 258 time to create 1 rle with old method : 0.00032711029052734375 length of segment : 25 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 243 time to create 1 rle with old method : 0.0003635883331298828 length of segment : 16 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002562999725341797 length of segment : 13 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.10781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 0.00010204315185546875 nb_pixel_total : 1757 time to create 1 rle with old method : 0.0026879310607910156 length of segment : 135 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 1172 time to create 1 rle with old method : 0.0018880367279052734 length of segment : 35 time for calcul the mask position with numpy : 6.341934204101562e-05 nb_pixel_total : 1407 time to create 1 rle with old method : 0.0020568370819091797 length of segment : 40 time for calcul the mask position with numpy : 6.771087646484375e-05 nb_pixel_total : 484 time to create 1 rle with old method : 0.0009038448333740234 length of segment : 17 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 473 time to create 1 rle with old method : 0.0009379386901855469 length of segment : 18 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 99 time to create 1 rle with old method : 0.0002446174621582031 length of segment : 10 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 606 time to create 1 rle with old method : 0.0007510185241699219 length of segment : 72 time for calcul the mask position with numpy : 0.0008091926574707031 nb_pixel_total : 63493 time to create 1 rle with old method : 0.07752251625061035 length of segment : 343 time for calcul the mask position with numpy : 9.036064147949219e-05 nb_pixel_total : 1094 time to create 1 rle with old method : 0.0016484260559082031 length of segment : 67 time for calcul the mask position with numpy : 0.00010323524475097656 nb_pixel_total : 1193 time to create 1 rle with old method : 0.001611471176147461 length of segment : 80 Processing 1 images image shape: (400, 400, 3) min: 18.00000 max: 222.00000 molded_images shape: (1, 640, 640, 3) min: -83.32891 max: 92.04375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0012907981872558594 nb_pixel_total : 152898 time to create 1 rle with new method : 0.0021996498107910156 length of segment : 398 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -109.62188 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 803 time to create 1 rle with old method : 0.0009987354278564453 length of segment : 32 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 335 time to create 1 rle with old method : 0.00046515464782714844 length of segment : 26 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 857 time to create 1 rle with old method : 0.0011324882507324219 length of segment : 30 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 1270 time to create 1 rle with old method : 0.0015957355499267578 length of segment : 45 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 147 time to create 1 rle with old method : 0.0002346038818359375 length of segment : 12 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 389 time to create 1 rle with old method : 0.000553131103515625 length of segment : 40 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 98 time to create 1 rle with old method : 0.00015401840209960938 length of segment : 13 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 147 time to create 1 rle with old method : 0.00023031234741210938 length of segment : 18 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 165 time to create 1 rle with old method : 0.0002722740173339844 length of segment : 27 time for calcul the mask position with numpy : 0.0002503395080566406 nb_pixel_total : 19018 time to create 1 rle with old method : 0.020941972732543945 length of segment : 128 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 495 time to create 1 rle with old method : 0.0006687641143798828 length of segment : 18 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.0002589225769042969 length of segment : 12 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -118.94219 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 187 time to create 1 rle with old method : 0.0002815723419189453 length of segment : 14 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 342 time to create 1 rle with old method : 0.0004277229309082031 length of segment : 23 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 253 time to create 1 rle with old method : 0.00036907196044921875 length of segment : 19 time for calcul the mask position with numpy : 0.00016236305236816406 nb_pixel_total : 6164 time to create 1 rle with old method : 0.007192850112915039 length of segment : 113 time for calcul the mask position with numpy : 6.389617919921875e-05 nb_pixel_total : 198 time to create 1 rle with old method : 0.00032401084899902344 length of segment : 29 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.67266 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 650 time to create 1 rle with old method : 0.0007956027984619141 length of segment : 46 time for calcul the mask position with numpy : 8.130073547363281e-05 nb_pixel_total : 2028 time to create 1 rle with old method : 0.0023872852325439453 length of segment : 136 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 606 time to create 1 rle with old method : 0.0007963180541992188 length of segment : 35 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 2829 time to create 1 rle with old method : 0.003183603286743164 length of segment : 59 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 169 time to create 1 rle with old method : 0.00027108192443847656 length of segment : 18 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 275 time to create 1 rle with old method : 0.0003790855407714844 length of segment : 19 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.0004029273986816406 length of segment : 25 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 1195 time to create 1 rle with old method : 0.0014674663543701172 length of segment : 40 time for calcul the mask position with numpy : 6.031990051269531e-05 nb_pixel_total : 2494 time to create 1 rle with old method : 0.003058910369873047 length of segment : 49 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 794 time to create 1 rle with old method : 0.0009932518005371094 length of segment : 36 time for calcul the mask position with numpy : 0.00011897087097167969 nb_pixel_total : 4609 time to create 1 rle with old method : 0.0056951045989990234 length of segment : 106 time for calcul the mask position with numpy : 0.00011205673217773438 nb_pixel_total : 4143 time to create 1 rle with old method : 0.004637241363525391 length of segment : 96 time for calcul the mask position with numpy : 5.793571472167969e-05 nb_pixel_total : 1779 time to create 1 rle with old method : 0.002096891403198242 length of segment : 45 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.35781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 1614 time to create 1 rle with old method : 0.0019259452819824219 length of segment : 86 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 346 time to create 1 rle with old method : 0.0004763603210449219 length of segment : 17 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0004734992980957031 length of segment : 35 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 867 time to create 1 rle with old method : 0.00102996826171875 length of segment : 36 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 1589 time to create 1 rle with old method : 0.0018625259399414062 length of segment : 77 time for calcul the mask position with numpy : 0.00020813941955566406 nb_pixel_total : 4050 time to create 1 rle with old method : 0.00455474853515625 length of segment : 203 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 900 time to create 1 rle with old method : 0.001196146011352539 length of segment : 81 time for calcul the mask position with numpy : 0.00015354156494140625 nb_pixel_total : 3844 time to create 1 rle with old method : 0.004473209381103516 length of segment : 187 Processing 1 images image shape: (280, 400, 3) min: 4.00000 max: 204.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 73.32891 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 546 time to create 1 rle with old method : 0.0006434917449951172 length of segment : 53 time for calcul the mask position with numpy : 0.0009284019470214844 nb_pixel_total : 106571 time to create 1 rle with old method : 0.11545562744140625 length of segment : 281 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.26016 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 0.00010585784912109375 nb_pixel_total : 1584 time to create 1 rle with old method : 0.0019350051879882812 length of segment : 82 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 2046 time to create 1 rle with old method : 0.002517223358154297 length of segment : 78 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 224 time to create 1 rle with old method : 0.00030517578125 length of segment : 27 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 237 time to create 1 rle with old method : 0.00041174888610839844 length of segment : 17 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 175 time to create 1 rle with old method : 0.00023984909057617188 length of segment : 21 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 709 time to create 1 rle with old method : 0.0009014606475830078 length of segment : 63 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 1533 time to create 1 rle with old method : 0.0018057823181152344 length of segment : 61 time for calcul the mask position with numpy : 0.00017452239990234375 nb_pixel_total : 9477 time to create 1 rle with old method : 0.010831356048583984 length of segment : 127 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.00018477439880371094 length of segment : 22 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 36 time for calcul the mask position with numpy : 8.511543273925781e-05 nb_pixel_total : 466 time to create 1 rle with old method : 0.0006308555603027344 length of segment : 29 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 150 time to create 1 rle with old method : 0.00022840499877929688 length of segment : 15 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 191 time to create 1 rle with old method : 0.00026726722717285156 length of segment : 18 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 135 time to create 1 rle with old method : 0.000232696533203125 length of segment : 11 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.00038886070251464844 length of segment : 16 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003254413604736328 length of segment : 17 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 315 time to create 1 rle with old method : 0.00042366981506347656 length of segment : 24 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 658 time to create 1 rle with old method : 0.0008683204650878906 length of segment : 29 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 408 time to create 1 rle with old method : 0.0005376338958740234 length of segment : 21 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.0003161430358886719 length of segment : 18 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 1266 time to create 1 rle with old method : 0.0014646053314208984 length of segment : 47 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.0004553794860839844 length of segment : 16 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 186 time to create 1 rle with old method : 0.0002796649932861328 length of segment : 12 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 396 time to create 1 rle with old method : 0.0005083084106445312 length of segment : 26 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 875 time to create 1 rle with old method : 0.001127004623413086 length of segment : 40 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.0003046989440917969 length of segment : 16 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 300 time to create 1 rle with old method : 0.00039839744567871094 length of segment : 17 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 1327 time to create 1 rle with old method : 0.00180816650390625 length of segment : 22 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 247 time to create 1 rle with old method : 0.00031375885009765625 length of segment : 33 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 509 time to create 1 rle with old method : 0.0006399154663085938 length of segment : 38 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 385 time to create 1 rle with old method : 0.0005352497100830078 length of segment : 21 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 1995 time to create 1 rle with old method : 0.0022852420806884766 length of segment : 74 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 243 time to create 1 rle with old method : 0.00034117698669433594 length of segment : 16 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 90 time to create 1 rle with old method : 0.0001518726348876953 length of segment : 10 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0005071163177490234 length of segment : 20 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 1359 time to create 1 rle with old method : 0.0016717910766601562 length of segment : 20 time for calcul the mask position with numpy : 2.7418136596679688e-05 nb_pixel_total : 60 time to create 1 rle with old method : 0.0001068115234375 length of segment : 8 time for calcul the mask position with numpy : 0.0001354217529296875 nb_pixel_total : 2413 time to create 1 rle with old method : 0.002811431884765625 length of segment : 148 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 899 time to create 1 rle with old method : 0.0010097026824951172 length of segment : 40 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 432 time to create 1 rle with old method : 0.0005586147308349609 length of segment : 26 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 295 time to create 1 rle with old method : 0.0003871917724609375 length of segment : 22 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 387 time to create 1 rle with old method : 0.0004730224609375 length of segment : 31 time for calcul the mask position with numpy : 5.269050598144531e-05 nb_pixel_total : 1326 time to create 1 rle with old method : 0.0016026496887207031 length of segment : 49 time for calcul the mask position with numpy : 8.797645568847656e-05 nb_pixel_total : 2261 time to create 1 rle with old method : 0.002612590789794922 length of segment : 130 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 220 time to create 1 rle with old method : 0.0002932548522949219 length of segment : 14 time for calcul the mask position with numpy : 8.845329284667969e-05 nb_pixel_total : 2264 time to create 1 rle with old method : 0.002599954605102539 length of segment : 125 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.10391 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 765 time to create 1 rle with old method : 0.00091552734375 length of segment : 32 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 744 time to create 1 rle with old method : 0.0010426044464111328 length of segment : 17 time for calcul the mask position with numpy : 7.43865966796875e-05 nb_pixel_total : 2536 time to create 1 rle with old method : 0.0028853416442871094 length of segment : 109 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 609 time to create 1 rle with old method : 0.0007517337799072266 length of segment : 35 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 875 time to create 1 rle with old method : 0.0010180473327636719 length of segment : 29 time for calcul the mask position with numpy : 5.340576171875e-05 nb_pixel_total : 383 time to create 1 rle with old method : 0.0005619525909423828 length of segment : 84 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 843 time to create 1 rle with old method : 0.00115966796875 length of segment : 36 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 345 time to create 1 rle with old method : 0.000431060791015625 length of segment : 29 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 1085 time to create 1 rle with old method : 0.001329660415649414 length of segment : 53 time for calcul the mask position with numpy : 2.956390380859375e-05 nb_pixel_total : 92 time to create 1 rle with old method : 0.00014328956604003906 length of segment : 17 time for calcul the mask position with numpy : 2.8371810913085938e-05 nb_pixel_total : 68 time to create 1 rle with old method : 0.00011968612670898438 length of segment : 10 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.0001995563507080078 length of segment : 14 time for calcul the mask position with numpy : 7.939338684082031e-05 nb_pixel_total : 2449 time to create 1 rle with old method : 0.002914905548095703 length of segment : 101 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 134.60000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 6.937980651855469e-05 nb_pixel_total : 225 time to create 1 rle with old method : 0.00040531158447265625 length of segment : 61 time for calcul the mask position with numpy : 0.00039124488830566406 nb_pixel_total : 31375 time to create 1 rle with old method : 0.03490328788757324 length of segment : 293 time for calcul the mask position with numpy : 0.0005533695220947266 nb_pixel_total : 54089 time to create 1 rle with old method : 0.05677604675292969 length of segment : 355 Detection mask done ! Trying to reset tf kernel 1431174 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4244 tf kernel not reseted sub process len(results) : 427 len(list_Values) 427 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 427 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9360 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 427 chid ids of type : 4228 Number RLEs to save : 21834 save missing photos in datou_result : time spend for datou_step_exec : 27.930840492248535 time spend to save output : 1.4571542739868164 total time spend for step 1 : 29.38799476623535 step2:brightness Sat Feb 1 20:20:58 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1738437628_1430713_1333763100_18baada7748bb1391f4993fc671e1448.jpg treat image : temp/1738437628_1430713_1333763021_03d85e9941db60f5604c3f1890ee71f7.jpg treat image : temp/1738437628_1430713_1333762991_cdde44693024e5096fbfd45fb7b3724b.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 3 time used for this insertion : 0.013800382614135742 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 3 time used for this insertion : 0.023401498794555664 save missing photos in datou_result : time spend for datou_step_exec : 0.9480972290039062 time spend to save output : 0.04302978515625 total time spend for step 2 : 0.9911270141601562 step3:blur_detection Sat Feb 1 20:20:59 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1738437628_1430713_1333763100_18baada7748bb1391f4993fc671e1448.jpg resize: (1080, 1920) 1333763100 -8.20002981190201 treat image : temp/1738437628_1430713_1333763021_03d85e9941db60f5604c3f1890ee71f7.jpg resize: (1080, 1920) 1333763021 -8.193745233642026 treat image : temp/1738437628_1430713_1333762991_cdde44693024e5096fbfd45fb7b3724b.jpg resize: (1080, 1920) 1333762991 -8.198101534809584 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 3 time used for this insertion : 0.013807058334350586 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 3 time used for this insertion : 0.011915922164916992 save missing photos in datou_result : time spend for datou_step_exec : 2.8580572605133057 time spend to save output : 0.0318150520324707 total time spend for step 3 : 2.8898723125457764 step4:rle_unique_nms_with_priority Sat Feb 1 20:21:02 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 427 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 136 nb_hashtags : 7 time to prepare the origin masks : 1.2047932147979736 time for calcul the mask position with numpy : 0.14615368843078613 nb_pixel_total : 1648232 time to create 1 rle with new method : 0.32360291481018066 time for calcul the mask position with numpy : 0.008975505828857422 nb_pixel_total : 1860 time to create 1 rle with old method : 0.0022470951080322266 time for calcul the mask position with numpy : 0.008684873580932617 nb_pixel_total : 1388 time to create 1 rle with old method : 0.0015716552734375 time for calcul the mask position with numpy : 0.008536338806152344 nb_pixel_total : 99 time to create 1 rle with old method : 0.0001361370086669922 time for calcul the mask position with numpy : 0.00853729248046875 nb_pixel_total : 111 time to create 1 rle with old method : 0.0001373291015625 time for calcul the mask position with numpy : 0.008877038955688477 nb_pixel_total : 920 time to create 1 rle with old method : 0.0010313987731933594 time for calcul the mask position with numpy : 0.008529901504516602 nb_pixel_total : 411 time to create 1 rle with old method : 0.0004601478576660156 time for calcul the mask position with numpy : 0.008510589599609375 nb_pixel_total : 2686 time to create 1 rle with old method : 0.0029265880584716797 time for calcul the mask position with numpy : 0.008506059646606445 nb_pixel_total : 15 time to create 1 rle with old method : 3.1948089599609375e-05 time for calcul the mask position with numpy : 0.008539199829101562 nb_pixel_total : 3607 time to create 1 rle with old method : 0.004113912582397461 time for calcul the mask position with numpy : 0.008497476577758789 nb_pixel_total : 697 time to create 1 rle with old method : 0.0007722377777099609 time for calcul the mask position with numpy : 0.008493423461914062 nb_pixel_total : 589 time to create 1 rle with old method : 0.0006597042083740234 time for calcul the mask position with numpy : 0.008530139923095703 nb_pixel_total : 189 time to create 1 rle with old method : 0.00021958351135253906 time for calcul the mask position with numpy : 0.009541988372802734 nb_pixel_total : 465 time to create 1 rle with old method : 0.0008893013000488281 time for calcul the mask position with numpy : 0.010970592498779297 nb_pixel_total : 13045 time to create 1 rle with old method : 0.014807462692260742 time for calcul the mask position with numpy : 0.008684158325195312 nb_pixel_total : 5723 time to create 1 rle with old method : 0.006551504135131836 time for calcul the mask position with numpy : 0.008589506149291992 nb_pixel_total : 1089 time to create 1 rle with old method : 0.0011823177337646484 time for calcul the mask position with numpy : 0.008579492568969727 nb_pixel_total : 6651 time to create 1 rle with old method : 0.007347583770751953 time for calcul the mask position with numpy : 0.008577823638916016 nb_pixel_total : 8011 time to create 1 rle with old method : 0.009203910827636719 time for calcul the mask position with numpy : 0.008600473403930664 nb_pixel_total : 105 time to create 1 rle with old method : 0.00013566017150878906 time for calcul the mask position with numpy : 0.008571624755859375 nb_pixel_total : 160 time to create 1 rle with old method : 0.00020051002502441406 time for calcul the mask position with numpy : 0.008502721786499023 nb_pixel_total : 1182 time to create 1 rle with old method : 0.0013163089752197266 time for calcul the mask position with numpy : 0.008536338806152344 nb_pixel_total : 27 time to create 1 rle with old method : 8.058547973632812e-05 time for calcul the mask position with numpy : 0.008588552474975586 nb_pixel_total : 3432 time to create 1 rle with old method : 0.0037288665771484375 time for calcul the mask position with numpy : 0.008636474609375 nb_pixel_total : 18 time to create 1 rle with old method : 6.651878356933594e-05 time for calcul the mask position with numpy : 0.008523225784301758 nb_pixel_total : 440 time to create 1 rle with old method : 0.0005002021789550781 time for calcul the mask position with numpy : 0.00863957405090332 nb_pixel_total : 401 time to create 1 rle with old method : 0.0005373954772949219 time for calcul the mask position with numpy : 0.008564949035644531 nb_pixel_total : 57 time to create 1 rle with old method : 8.487701416015625e-05 time for calcul the mask position with numpy : 0.008644580841064453 nb_pixel_total : 100 time to create 1 rle with old method : 0.0001285076141357422 time for calcul the mask position with numpy : 0.00861358642578125 nb_pixel_total : 15 time to create 1 rle with old method : 5.91278076171875e-05 time for calcul the mask position with numpy : 0.010373592376708984 nb_pixel_total : 152928 time to create 1 rle with new method : 0.2636539936065674 time for calcul the mask position with numpy : 0.008646965026855469 nb_pixel_total : 679 time to create 1 rle with old method : 0.0008070468902587891 time for calcul the mask position with numpy : 0.008558273315429688 nb_pixel_total : 1221 time to create 1 rle with old method : 0.0013468265533447266 time for calcul the mask position with numpy : 0.008579492568969727 nb_pixel_total : 2294 time to create 1 rle with old method : 0.002637147903442383 time for calcul the mask position with numpy : 0.008486270904541016 nb_pixel_total : 392 time to create 1 rle with old method : 0.0004596710205078125 time for calcul the mask position with numpy : 0.00851130485534668 nb_pixel_total : 840 time to create 1 rle with old method : 0.0009315013885498047 time for calcul the mask position with numpy : 0.008509397506713867 nb_pixel_total : 1356 time to create 1 rle with old method : 0.0015888214111328125 time for calcul the mask position with numpy : 0.00859212875366211 nb_pixel_total : 703 time to create 1 rle with old method : 0.0008251667022705078 time for calcul the mask position with numpy : 0.008591651916503906 nb_pixel_total : 406 time to create 1 rle with old method : 0.00045680999755859375 time for calcul the mask position with numpy : 0.008656024932861328 nb_pixel_total : 844 time to create 1 rle with old method : 0.0009744167327880859 time for calcul the mask position with numpy : 0.008540153503417969 nb_pixel_total : 858 time to create 1 rle with old method : 0.0009958744049072266 time for calcul the mask position with numpy : 0.008875846862792969 nb_pixel_total : 526 time to create 1 rle with old method : 0.0006203651428222656 time for calcul the mask position with numpy : 0.009413003921508789 nb_pixel_total : 519 time to create 1 rle with old method : 0.0007028579711914062 time for calcul the mask position with numpy : 0.008671045303344727 nb_pixel_total : 5173 time to create 1 rle with old method : 0.0064699649810791016 time for calcul the mask position with numpy : 0.010934114456176758 nb_pixel_total : 1392 time to create 1 rle with old method : 0.0020551681518554688 time for calcul the mask position with numpy : 0.00890493392944336 nb_pixel_total : 1577 time to create 1 rle with old method : 0.0018231868743896484 time for calcul the mask position with numpy : 0.0091400146484375 nb_pixel_total : 2499 time to create 1 rle with old method : 0.0029921531677246094 time for calcul the mask position with numpy : 0.008832693099975586 nb_pixel_total : 526 time to create 1 rle with old method : 0.0005970001220703125 time for calcul the mask position with numpy : 0.008573055267333984 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002624988555908203 time for calcul the mask position with numpy : 0.008631706237792969 nb_pixel_total : 367 time to create 1 rle with old method : 0.0004405975341796875 time for calcul the mask position with numpy : 0.00858759880065918 nb_pixel_total : 298 time to create 1 rle with old method : 0.0003802776336669922 time for calcul the mask position with numpy : 0.008268594741821289 nb_pixel_total : 169 time to create 1 rle with old method : 0.00020360946655273438 time for calcul the mask position with numpy : 0.008126974105834961 nb_pixel_total : 1117 time to create 1 rle with old method : 0.001256704330444336 time for calcul the mask position with numpy : 0.008172035217285156 nb_pixel_total : 251 time to create 1 rle with old method : 0.00027060508728027344 time for calcul the mask position with numpy : 0.008347272872924805 nb_pixel_total : 248 time to create 1 rle with old method : 0.0002791881561279297 time for calcul the mask position with numpy : 0.008489131927490234 nb_pixel_total : 320 time to create 1 rle with old method : 0.0003631114959716797 time for calcul the mask position with numpy : 0.008464574813842773 nb_pixel_total : 142 time to create 1 rle with old method : 0.0001678466796875 time for calcul the mask position with numpy : 0.008426427841186523 nb_pixel_total : 1369 time to create 1 rle with old method : 0.0014929771423339844 time for calcul the mask position with numpy : 0.008565664291381836 nb_pixel_total : 142 time to create 1 rle with old method : 0.00017333030700683594 time for calcul the mask position with numpy : 0.00844573974609375 nb_pixel_total : 401 time to create 1 rle with old method : 0.00048661231994628906 time for calcul the mask position with numpy : 0.008737802505493164 nb_pixel_total : 106 time to create 1 rle with old method : 0.00013113021850585938 time for calcul the mask position with numpy : 0.008541584014892578 nb_pixel_total : 4284 time to create 1 rle with old method : 0.0046999454498291016 time for calcul the mask position with numpy : 0.008642196655273438 nb_pixel_total : 1599 time to create 1 rle with old method : 0.0017948150634765625 time for calcul the mask position with numpy : 0.008598566055297852 nb_pixel_total : 221 time to create 1 rle with old method : 0.0004134178161621094 time for calcul the mask position with numpy : 0.010808944702148438 nb_pixel_total : 660 time to create 1 rle with old method : 0.0009908676147460938 time for calcul the mask position with numpy : 0.008657217025756836 nb_pixel_total : 1714 time to create 1 rle with old method : 0.001886606216430664 time for calcul the mask position with numpy : 0.008941411972045898 nb_pixel_total : 378 time to create 1 rle with old method : 0.00043654441833496094 time for calcul the mask position with numpy : 0.008684396743774414 nb_pixel_total : 202 time to create 1 rle with old method : 0.0002396106719970703 time for calcul the mask position with numpy : 0.008801937103271484 nb_pixel_total : 2436 time to create 1 rle with old method : 0.0027687549591064453 time for calcul the mask position with numpy : 0.008824825286865234 nb_pixel_total : 86 time to create 1 rle with old method : 0.0001475811004638672 time for calcul the mask position with numpy : 0.008927583694458008 nb_pixel_total : 183 time to create 1 rle with old method : 0.0002396106719970703 time for calcul the mask position with numpy : 0.008678197860717773 nb_pixel_total : 820 time to create 1 rle with old method : 0.0009312629699707031 time for calcul the mask position with numpy : 0.008831501007080078 nb_pixel_total : 204 time to create 1 rle with old method : 0.00024247169494628906 time for calcul the mask position with numpy : 0.009192228317260742 nb_pixel_total : 106142 time to create 1 rle with old method : 0.11421418190002441 time for calcul the mask position with numpy : 0.008634328842163086 nb_pixel_total : 107 time to create 1 rle with old method : 0.00015115737915039062 time for calcul the mask position with numpy : 0.008498668670654297 nb_pixel_total : 760 time to create 1 rle with old method : 0.0008611679077148438 time for calcul the mask position with numpy : 0.008903026580810547 nb_pixel_total : 713 time to create 1 rle with old method : 0.0008440017700195312 time for calcul the mask position with numpy : 0.008656740188598633 nb_pixel_total : 267 time to create 1 rle with old method : 0.0003387928009033203 time for calcul the mask position with numpy : 0.009060859680175781 nb_pixel_total : 295 time to create 1 rle with old method : 0.0003502368927001953 time for calcul the mask position with numpy : 0.008787393569946289 nb_pixel_total : 2363 time to create 1 rle with old method : 0.002785205841064453 time for calcul the mask position with numpy : 0.008967161178588867 nb_pixel_total : 509 time to create 1 rle with old method : 0.0006148815155029297 time for calcul the mask position with numpy : 0.008904457092285156 nb_pixel_total : 39067 time to create 1 rle with old method : 0.04162764549255371 time for calcul the mask position with numpy : 0.009129524230957031 nb_pixel_total : 213 time to create 1 rle with old method : 0.0002925395965576172 time for calcul the mask position with numpy : 0.009166717529296875 nb_pixel_total : 367 time to create 1 rle with old method : 0.0005650520324707031 time for calcul the mask position with numpy : 0.00908041000366211 nb_pixel_total : 228 time to create 1 rle with old method : 0.0003139972686767578 time for calcul the mask position with numpy : 0.009088993072509766 nb_pixel_total : 220 time to create 1 rle with old method : 0.00028324127197265625 time for calcul the mask position with numpy : 0.009117841720581055 nb_pixel_total : 263 time to create 1 rle with old method : 0.00033974647521972656 time for calcul the mask position with numpy : 0.009097814559936523 nb_pixel_total : 377 time to create 1 rle with old method : 0.000476837158203125 time for calcul the mask position with numpy : 0.009165525436401367 nb_pixel_total : 152 time to create 1 rle with old method : 0.0003426074981689453 time for calcul the mask position with numpy : 0.009855985641479492 nb_pixel_total : 401 time to create 1 rle with old method : 0.0005033016204833984 time for calcul the mask position with numpy : 0.009881019592285156 nb_pixel_total : 15 time to create 1 rle with old method : 0.000118255615234375 time for calcul the mask position with numpy : 0.009841680526733398 nb_pixel_total : 105 time to create 1 rle with old method : 0.00016689300537109375 time for calcul the mask position with numpy : 0.008991003036499023 nb_pixel_total : 1807 time to create 1 rle with old method : 0.002652406692504883 time for calcul the mask position with numpy : 0.009221315383911133 nb_pixel_total : 113 time to create 1 rle with old method : 0.00018405914306640625 time for calcul the mask position with numpy : 0.00900721549987793 nb_pixel_total : 193 time to create 1 rle with old method : 0.0002713203430175781 time for calcul the mask position with numpy : 0.008892059326171875 nb_pixel_total : 140 time to create 1 rle with old method : 0.0001995563507080078 time for calcul the mask position with numpy : 0.009038448333740234 nb_pixel_total : 296 time to create 1 rle with old method : 0.0003943443298339844 time for calcul the mask position with numpy : 0.009963512420654297 nb_pixel_total : 731 time to create 1 rle with old method : 0.0011627674102783203 time for calcul the mask position with numpy : 0.011154413223266602 nb_pixel_total : 2489 time to create 1 rle with old method : 0.0034513473510742188 time for calcul the mask position with numpy : 0.009663581848144531 nb_pixel_total : 43 time to create 1 rle with old method : 0.00013566017150878906 time for calcul the mask position with numpy : 0.008951902389526367 nb_pixel_total : 180 time to create 1 rle with old method : 0.0002639293670654297 time for calcul the mask position with numpy : 0.008940458297729492 nb_pixel_total : 301 time to create 1 rle with old method : 0.00041747093200683594 time for calcul the mask position with numpy : 0.008952617645263672 nb_pixel_total : 501 time to create 1 rle with old method : 0.0006024837493896484 time for calcul the mask position with numpy : 0.009012937545776367 nb_pixel_total : 58 time to create 1 rle with old method : 0.00011467933654785156 time for calcul the mask position with numpy : 0.010196924209594727 nb_pixel_total : 226 time to create 1 rle with old method : 0.0006041526794433594 time for calcul the mask position with numpy : 0.011146306991577148 nb_pixel_total : 200 time to create 1 rle with old method : 0.00026345252990722656 time for calcul the mask position with numpy : 0.008992195129394531 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003299713134765625 time for calcul the mask position with numpy : 0.010092735290527344 nb_pixel_total : 877 time to create 1 rle with old method : 0.0014920234680175781 time for calcul the mask position with numpy : 0.009150505065917969 nb_pixel_total : 231 time to create 1 rle with old method : 0.0003273487091064453 time for calcul the mask position with numpy : 0.009171247482299805 nb_pixel_total : 1618 time to create 1 rle with old method : 0.0018248558044433594 time for calcul the mask position with numpy : 0.009135007858276367 nb_pixel_total : 378 time to create 1 rle with old method : 0.00048160552978515625 time for calcul the mask position with numpy : 0.009029865264892578 nb_pixel_total : 535 time to create 1 rle with old method : 0.0006372928619384766 time for calcul the mask position with numpy : 0.009098052978515625 nb_pixel_total : 295 time to create 1 rle with old method : 0.00037550926208496094 time for calcul the mask position with numpy : 0.00907278060913086 nb_pixel_total : 970 time to create 1 rle with old method : 0.0011701583862304688 time for calcul the mask position with numpy : 0.009103775024414062 nb_pixel_total : 199 time to create 1 rle with old method : 0.0002682209014892578 time for calcul the mask position with numpy : 0.009063243865966797 nb_pixel_total : 423 time to create 1 rle with old method : 0.0005064010620117188 time for calcul the mask position with numpy : 0.009111404418945312 nb_pixel_total : 4290 time to create 1 rle with old method : 0.0048525333404541016 time for calcul the mask position with numpy : 0.009078502655029297 nb_pixel_total : 98 time to create 1 rle with old method : 0.00017261505126953125 time for calcul the mask position with numpy : 0.009051084518432617 nb_pixel_total : 623 time to create 1 rle with old method : 0.0007226467132568359 time for calcul the mask position with numpy : 0.00908207893371582 nb_pixel_total : 1880 time to create 1 rle with old method : 0.002196073532104492 time for calcul the mask position with numpy : 0.009027957916259766 nb_pixel_total : 190 time to create 1 rle with old method : 0.00028252601623535156 time for calcul the mask position with numpy : 0.009064435958862305 nb_pixel_total : 59 time to create 1 rle with old method : 0.00011086463928222656 time for calcul the mask position with numpy : 0.009062528610229492 nb_pixel_total : 174 time to create 1 rle with old method : 0.00023746490478515625 time for calcul the mask position with numpy : 0.00903940200805664 nb_pixel_total : 305 time to create 1 rle with old method : 0.00044727325439453125 time for calcul the mask position with numpy : 0.009073257446289062 nb_pixel_total : 846 time to create 1 rle with old method : 0.0010533332824707031 time for calcul the mask position with numpy : 0.009049654006958008 nb_pixel_total : 323 time to create 1 rle with old method : 0.0004279613494873047 time for calcul the mask position with numpy : 0.00912618637084961 nb_pixel_total : 93 time to create 1 rle with old method : 0.00015044212341308594 time for calcul the mask position with numpy : 0.009072303771972656 nb_pixel_total : 545 time to create 1 rle with old method : 0.0006403923034667969 time for calcul the mask position with numpy : 0.010014772415161133 nb_pixel_total : 1321 time to create 1 rle with old method : 0.0014901161193847656 time for calcul the mask position with numpy : 0.009119033813476562 nb_pixel_total : 281 time to create 1 rle with old method : 0.0003650188446044922 time for calcul the mask position with numpy : 0.009141206741333008 nb_pixel_total : 97 time to create 1 rle with old method : 0.00015401840209960938 time for calcul the mask position with numpy : 0.009083271026611328 nb_pixel_total : 392 time to create 1 rle with old method : 0.0004761219024658203 time for calcul the mask position with numpy : 0.009076833724975586 nb_pixel_total : 463 time to create 1 rle with old method : 0.00063323974609375 time for calcul the mask position with numpy : 0.009086847305297852 nb_pixel_total : 234 time to create 1 rle with old method : 0.00031375885009765625 time for calcul the mask position with numpy : 0.00909876823425293 nb_pixel_total : 56 time to create 1 rle with old method : 0.00017261505126953125 time for calcul the mask position with numpy : 0.009146690368652344 nb_pixel_total : 1300 time to create 1 rle with old method : 0.0015006065368652344 time for calcul the mask position with numpy : 0.00909566879272461 nb_pixel_total : 77 time to create 1 rle with old method : 0.00012731552124023438 create new chi : 2.2861247062683105 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.013229846954345703 batch 1 Loaded 137 chid ids of type : 4230 Number RLEs to save : 13301 TO DO : save crop sub photo not yet done ! save time : 0.8123443126678467 nb_obj : 150 nb_hashtags : 7 time to prepare the origin masks : 2.6786625385284424 time for calcul the mask position with numpy : 0.0863485336303711 nb_pixel_total : 1636963 time to create 1 rle with new method : 0.5235276222229004 time for calcul the mask position with numpy : 0.010029077529907227 nb_pixel_total : 1837 time to create 1 rle with old method : 0.002594470977783203 time for calcul the mask position with numpy : 0.010415315628051758 nb_pixel_total : 1793 time to create 1 rle with old method : 0.0023348331451416016 time for calcul the mask position with numpy : 0.009888410568237305 nb_pixel_total : 1274 time to create 1 rle with old method : 0.0016646385192871094 time for calcul the mask position with numpy : 0.009796619415283203 nb_pixel_total : 54 time to create 1 rle with old method : 0.00011992454528808594 time for calcul the mask position with numpy : 0.010671138763427734 nb_pixel_total : 81 time to create 1 rle with old method : 0.00015473365783691406 time for calcul the mask position with numpy : 0.009716033935546875 nb_pixel_total : 660 time to create 1 rle with old method : 0.0007641315460205078 time for calcul the mask position with numpy : 0.009715080261230469 nb_pixel_total : 1237 time to create 1 rle with old method : 0.0014834403991699219 time for calcul the mask position with numpy : 0.009471893310546875 nb_pixel_total : 205 time to create 1 rle with old method : 0.0002810955047607422 time for calcul the mask position with numpy : 0.00949549674987793 nb_pixel_total : 121 time to create 1 rle with old method : 0.00021529197692871094 time for calcul the mask position with numpy : 0.008823871612548828 nb_pixel_total : 237 time to create 1 rle with old method : 0.0003192424774169922 time for calcul the mask position with numpy : 0.008710384368896484 nb_pixel_total : 425 time to create 1 rle with old method : 0.0006091594696044922 time for calcul the mask position with numpy : 0.00853586196899414 nb_pixel_total : 283 time to create 1 rle with old method : 0.00039577484130859375 time for calcul the mask position with numpy : 0.007844924926757812 nb_pixel_total : 2198 time to create 1 rle with old method : 0.0024590492248535156 time for calcul the mask position with numpy : 0.00903773307800293 nb_pixel_total : 734 time to create 1 rle with old method : 0.0010557174682617188 time for calcul the mask position with numpy : 0.00861048698425293 nb_pixel_total : 6562 time to create 1 rle with old method : 0.007306337356567383 time for calcul the mask position with numpy : 0.008371114730834961 nb_pixel_total : 263 time to create 1 rle with old method : 0.00032401084899902344 time for calcul the mask position with numpy : 0.00861501693725586 nb_pixel_total : 559 time to create 1 rle with old method : 0.0006554126739501953 time for calcul the mask position with numpy : 0.008144617080688477 nb_pixel_total : 218 time to create 1 rle with old method : 0.0002837181091308594 time for calcul the mask position with numpy : 0.007562875747680664 nb_pixel_total : 406 time to create 1 rle with old method : 0.00048089027404785156 time for calcul the mask position with numpy : 0.008394956588745117 nb_pixel_total : 12808 time to create 1 rle with old method : 0.014600038528442383 time for calcul the mask position with numpy : 0.01027536392211914 nb_pixel_total : 204 time to create 1 rle with old method : 0.0002532005310058594 time for calcul the mask position with numpy : 0.01043391227722168 nb_pixel_total : 6116 time to create 1 rle with old method : 0.007112264633178711 time for calcul the mask position with numpy : 0.009602785110473633 nb_pixel_total : 813 time to create 1 rle with old method : 0.0011010169982910156 time for calcul the mask position with numpy : 0.009633779525756836 nb_pixel_total : 1230 time to create 1 rle with old method : 0.0014009475708007812 time for calcul the mask position with numpy : 0.008946418762207031 nb_pixel_total : 126 time to create 1 rle with old method : 0.00017595291137695312 time for calcul the mask position with numpy : 0.008752584457397461 nb_pixel_total : 918 time to create 1 rle with old method : 0.001012563705444336 time for calcul the mask position with numpy : 0.007772922515869141 nb_pixel_total : 6732 time to create 1 rle with old method : 0.007790327072143555 time for calcul the mask position with numpy : 0.009668588638305664 nb_pixel_total : 7615 time to create 1 rle with old method : 0.010555744171142578 time for calcul the mask position with numpy : 0.010493278503417969 nb_pixel_total : 110 time to create 1 rle with old method : 0.00015497207641601562 time for calcul the mask position with numpy : 0.0118560791015625 nb_pixel_total : 6 time to create 1 rle with old method : 3.910064697265625e-05 time for calcul the mask position with numpy : 0.009511947631835938 nb_pixel_total : 176 time to create 1 rle with old method : 0.0002987384796142578 time for calcul the mask position with numpy : 0.00933694839477539 nb_pixel_total : 1172 time to create 1 rle with old method : 0.0017163753509521484 time for calcul the mask position with numpy : 0.013733625411987305 nb_pixel_total : 2927 time to create 1 rle with old method : 0.0043413639068603516 time for calcul the mask position with numpy : 0.012902498245239258 nb_pixel_total : 496 time to create 1 rle with old method : 0.000690460205078125 time for calcul the mask position with numpy : 0.009217023849487305 nb_pixel_total : 10 time to create 1 rle with old method : 3.743171691894531e-05 time for calcul the mask position with numpy : 0.006641387939453125 nb_pixel_total : 64 time to create 1 rle with old method : 0.00011706352233886719 time for calcul the mask position with numpy : 0.00661015510559082 nb_pixel_total : 354 time to create 1 rle with old method : 0.00042724609375 time for calcul the mask position with numpy : 0.006582498550415039 nb_pixel_total : 79 time to create 1 rle with old method : 0.00011467933654785156 time for calcul the mask position with numpy : 0.010538816452026367 nb_pixel_total : 153034 time to create 1 rle with new method : 0.11885929107666016 time for calcul the mask position with numpy : 0.009832382202148438 nb_pixel_total : 623 time to create 1 rle with old method : 0.0007481575012207031 time for calcul the mask position with numpy : 0.009791851043701172 nb_pixel_total : 1225 time to create 1 rle with old method : 0.001417398452758789 time for calcul the mask position with numpy : 0.009991168975830078 nb_pixel_total : 2852 time to create 1 rle with old method : 0.003316164016723633 time for calcul the mask position with numpy : 0.00998067855834961 nb_pixel_total : 699 time to create 1 rle with old method : 0.0008070468902587891 time for calcul the mask position with numpy : 0.00956416130065918 nb_pixel_total : 714 time to create 1 rle with old method : 0.0008096694946289062 time for calcul the mask position with numpy : 0.010044097900390625 nb_pixel_total : 834 time to create 1 rle with old method : 0.0009558200836181641 time for calcul the mask position with numpy : 0.009969949722290039 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002162456512451172 time for calcul the mask position with numpy : 0.009886503219604492 nb_pixel_total : 459 time to create 1 rle with old method : 0.000553131103515625 time for calcul the mask position with numpy : 0.010854005813598633 nb_pixel_total : 1198 time to create 1 rle with old method : 0.0013480186462402344 time for calcul the mask position with numpy : 0.010154962539672852 nb_pixel_total : 384 time to create 1 rle with old method : 0.0004887580871582031 time for calcul the mask position with numpy : 0.010034561157226562 nb_pixel_total : 818 time to create 1 rle with old method : 0.0009212493896484375 time for calcul the mask position with numpy : 0.009946107864379883 nb_pixel_total : 97 time to create 1 rle with old method : 0.00013375282287597656 time for calcul the mask position with numpy : 0.009826183319091797 nb_pixel_total : 109 time to create 1 rle with old method : 0.0001461505889892578 time for calcul the mask position with numpy : 0.01001739501953125 nb_pixel_total : 502 time to create 1 rle with old method : 0.0005867481231689453 time for calcul the mask position with numpy : 0.009760856628417969 nb_pixel_total : 1519 time to create 1 rle with old method : 0.0017342567443847656 time for calcul the mask position with numpy : 0.009798526763916016 nb_pixel_total : 53 time to create 1 rle with old method : 0.00013017654418945312 time for calcul the mask position with numpy : 0.01015019416809082 nb_pixel_total : 1399 time to create 1 rle with old method : 0.0015757083892822266 time for calcul the mask position with numpy : 0.009637832641601562 nb_pixel_total : 665 time to create 1 rle with old method : 0.0008134841918945312 time for calcul the mask position with numpy : 0.009969949722290039 nb_pixel_total : 322 time to create 1 rle with old method : 0.0003910064697265625 time for calcul the mask position with numpy : 0.010042428970336914 nb_pixel_total : 4137 time to create 1 rle with old method : 0.004615306854248047 time for calcul the mask position with numpy : 0.009812593460083008 nb_pixel_total : 1446 time to create 1 rle with old method : 0.001691579818725586 time for calcul the mask position with numpy : 0.010481595993041992 nb_pixel_total : 299 time to create 1 rle with old method : 0.0003523826599121094 time for calcul the mask position with numpy : 0.010507822036743164 nb_pixel_total : 174 time to create 1 rle with old method : 0.00023865699768066406 time for calcul the mask position with numpy : 0.011080741882324219 nb_pixel_total : 128 time to create 1 rle with old method : 0.00019502639770507812 time for calcul the mask position with numpy : 0.00770258903503418 nb_pixel_total : 2982 time to create 1 rle with old method : 0.004179239273071289 time for calcul the mask position with numpy : 0.006955146789550781 nb_pixel_total : 236 time to create 1 rle with old method : 0.00031280517578125 time for calcul the mask position with numpy : 0.0071258544921875 nb_pixel_total : 709 time to create 1 rle with old method : 0.0008349418640136719 time for calcul the mask position with numpy : 0.006521463394165039 nb_pixel_total : 319 time to create 1 rle with old method : 0.0004405975341796875 time for calcul the mask position with numpy : 0.006684303283691406 nb_pixel_total : 147 time to create 1 rle with old method : 0.0002124309539794922 time for calcul the mask position with numpy : 0.0065555572509765625 nb_pixel_total : 900 time to create 1 rle with old method : 0.0011014938354492188 time for calcul the mask position with numpy : 0.00677180290222168 nb_pixel_total : 396 time to create 1 rle with old method : 0.0004937648773193359 time for calcul the mask position with numpy : 0.0066738128662109375 nb_pixel_total : 100 time to create 1 rle with old method : 0.000141143798828125 time for calcul the mask position with numpy : 0.006983518600463867 nb_pixel_total : 153 time to create 1 rle with old method : 0.00022721290588378906 time for calcul the mask position with numpy : 0.007062673568725586 nb_pixel_total : 667 time to create 1 rle with old method : 0.0008194446563720703 time for calcul the mask position with numpy : 0.006999969482421875 nb_pixel_total : 174 time to create 1 rle with old method : 0.0002262592315673828 time for calcul the mask position with numpy : 0.007159233093261719 nb_pixel_total : 774 time to create 1 rle with old method : 0.0009918212890625 time for calcul the mask position with numpy : 0.006747007369995117 nb_pixel_total : 354 time to create 1 rle with old method : 0.00042700767517089844 time for calcul the mask position with numpy : 0.006375551223754883 nb_pixel_total : 135 time to create 1 rle with old method : 0.0002129077911376953 time for calcul the mask position with numpy : 0.006177186965942383 nb_pixel_total : 2617 time to create 1 rle with old method : 0.0030202865600585938 time for calcul the mask position with numpy : 0.006133317947387695 nb_pixel_total : 202 time to create 1 rle with old method : 0.0002484321594238281 time for calcul the mask position with numpy : 0.0061757564544677734 nb_pixel_total : 175 time to create 1 rle with old method : 0.000217437744140625 time for calcul the mask position with numpy : 0.006449460983276367 nb_pixel_total : 155 time to create 1 rle with old method : 0.00021886825561523438 time for calcul the mask position with numpy : 0.006563425064086914 nb_pixel_total : 945 time to create 1 rle with old method : 0.0010869503021240234 time for calcul the mask position with numpy : 0.006546974182128906 nb_pixel_total : 306 time to create 1 rle with old method : 0.000392913818359375 time for calcul the mask position with numpy : 0.007026195526123047 nb_pixel_total : 182 time to create 1 rle with old method : 0.00022268295288085938 time for calcul the mask position with numpy : 0.0068264007568359375 nb_pixel_total : 106034 time to create 1 rle with old method : 0.12258124351501465 time for calcul the mask position with numpy : 0.007512092590332031 nb_pixel_total : 141 time to create 1 rle with old method : 0.00019049644470214844 time for calcul the mask position with numpy : 0.007466316223144531 nb_pixel_total : 644 time to create 1 rle with old method : 0.0007522106170654297 time for calcul the mask position with numpy : 0.007425785064697266 nb_pixel_total : 3060 time to create 1 rle with old method : 0.0034339427947998047 time for calcul the mask position with numpy : 0.00743412971496582 nb_pixel_total : 233 time to create 1 rle with old method : 0.000293731689453125 time for calcul the mask position with numpy : 0.007402658462524414 nb_pixel_total : 322 time to create 1 rle with old method : 0.0004673004150390625 time for calcul the mask position with numpy : 0.00738072395324707 nb_pixel_total : 519 time to create 1 rle with old method : 0.0006041526794433594 time for calcul the mask position with numpy : 0.007420539855957031 nb_pixel_total : 12878 time to create 1 rle with old method : 0.014081954956054688 time for calcul the mask position with numpy : 0.0076024532318115234 nb_pixel_total : 36367 time to create 1 rle with old method : 0.03888511657714844 time for calcul the mask position with numpy : 0.00738525390625 nb_pixel_total : 393 time to create 1 rle with old method : 0.00047278404235839844 time for calcul the mask position with numpy : 0.007367134094238281 nb_pixel_total : 218 time to create 1 rle with old method : 0.0002834796905517578 time for calcul the mask position with numpy : 0.007326364517211914 nb_pixel_total : 183 time to create 1 rle with old method : 0.00025844573974609375 time for calcul the mask position with numpy : 0.007414340972900391 nb_pixel_total : 214 time to create 1 rle with old method : 0.00026988983154296875 time for calcul the mask position with numpy : 0.00736546516418457 nb_pixel_total : 392 time to create 1 rle with old method : 0.00046706199645996094 time for calcul the mask position with numpy : 0.007406949996948242 nb_pixel_total : 243 time to create 1 rle with old method : 0.00032258033752441406 time for calcul the mask position with numpy : 0.0075299739837646484 nb_pixel_total : 135 time to create 1 rle with old method : 0.00019049644470214844 time for calcul the mask position with numpy : 0.007443428039550781 nb_pixel_total : 379 time to create 1 rle with old method : 0.0004551410675048828 time for calcul the mask position with numpy : 0.007552623748779297 nb_pixel_total : 260 time to create 1 rle with old method : 0.00031495094299316406 time for calcul the mask position with numpy : 0.0075359344482421875 nb_pixel_total : 109 time to create 1 rle with old method : 0.00016307830810546875 time for calcul the mask position with numpy : 0.0074193477630615234 nb_pixel_total : 208 time to create 1 rle with old method : 0.0002732276916503906 time for calcul the mask position with numpy : 0.008472681045532227 nb_pixel_total : 11 time to create 1 rle with old method : 6.389617919921875e-05 time for calcul the mask position with numpy : 0.008227109909057617 nb_pixel_total : 300 time to create 1 rle with old method : 0.00036716461181640625 time for calcul the mask position with numpy : 0.007431507110595703 nb_pixel_total : 743 time to create 1 rle with old method : 0.0008666515350341797 time for calcul the mask position with numpy : 0.007449626922607422 nb_pixel_total : 297 time to create 1 rle with old method : 0.00041794776916503906 time for calcul the mask position with numpy : 0.007340908050537109 nb_pixel_total : 2399 time to create 1 rle with old method : 0.002668142318725586 time for calcul the mask position with numpy : 0.007371664047241211 nb_pixel_total : 177 time to create 1 rle with old method : 0.0002269744873046875 time for calcul the mask position with numpy : 0.007383823394775391 nb_pixel_total : 54 time to create 1 rle with old method : 9.608268737792969e-05 time for calcul the mask position with numpy : 0.007448911666870117 nb_pixel_total : 545 time to create 1 rle with old method : 0.0006945133209228516 time for calcul the mask position with numpy : 0.007470369338989258 nb_pixel_total : 214 time to create 1 rle with old method : 0.00028443336486816406 time for calcul the mask position with numpy : 0.007443428039550781 nb_pixel_total : 213 time to create 1 rle with old method : 0.0002663135528564453 time for calcul the mask position with numpy : 0.007451534271240234 nb_pixel_total : 304 time to create 1 rle with old method : 0.00037026405334472656 time for calcul the mask position with numpy : 0.007418155670166016 nb_pixel_total : 8 time to create 1 rle with old method : 5.125999450683594e-05 time for calcul the mask position with numpy : 0.007429599761962891 nb_pixel_total : 3 time to create 1 rle with old method : 3.7670135498046875e-05 time for calcul the mask position with numpy : 0.007416725158691406 nb_pixel_total : 802 time to create 1 rle with old method : 0.0009000301361083984 time for calcul the mask position with numpy : 0.0074307918548583984 nb_pixel_total : 411 time to create 1 rle with old method : 0.0004911422729492188 time for calcul the mask position with numpy : 0.007345914840698242 nb_pixel_total : 5 time to create 1 rle with old method : 0.00014209747314453125 time for calcul the mask position with numpy : 0.007747650146484375 nb_pixel_total : 1665 time to create 1 rle with old method : 0.0019383430480957031 time for calcul the mask position with numpy : 0.007691621780395508 nb_pixel_total : 253 time to create 1 rle with old method : 0.00032448768615722656 time for calcul the mask position with numpy : 0.007773160934448242 nb_pixel_total : 20 time to create 1 rle with old method : 6.29425048828125e-05 time for calcul the mask position with numpy : 0.007675647735595703 nb_pixel_total : 590 time to create 1 rle with old method : 0.0006709098815917969 time for calcul the mask position with numpy : 0.008274078369140625 nb_pixel_total : 350 time to create 1 rle with old method : 0.0005102157592773438 time for calcul the mask position with numpy : 0.008522987365722656 nb_pixel_total : 312 time to create 1 rle with old method : 0.0003771781921386719 time for calcul the mask position with numpy : 0.007508516311645508 nb_pixel_total : 736 time to create 1 rle with old method : 0.0008447170257568359 time for calcul the mask position with numpy : 0.00741267204284668 nb_pixel_total : 319 time to create 1 rle with old method : 0.0003871917724609375 time for calcul the mask position with numpy : 0.00742793083190918 nb_pixel_total : 511 time to create 1 rle with old method : 0.0005934238433837891 time for calcul the mask position with numpy : 0.007437229156494141 nb_pixel_total : 310 time to create 1 rle with old method : 0.0003743171691894531 time for calcul the mask position with numpy : 0.00787496566772461 nb_pixel_total : 6947 time to create 1 rle with old method : 0.00753331184387207 time for calcul the mask position with numpy : 0.007675647735595703 nb_pixel_total : 17 time to create 1 rle with old method : 6.961822509765625e-05 time for calcul the mask position with numpy : 0.00757908821105957 nb_pixel_total : 688 time to create 1 rle with old method : 0.0007805824279785156 time for calcul the mask position with numpy : 0.008409261703491211 nb_pixel_total : 59 time to create 1 rle with old method : 0.000102996826171875 time for calcul the mask position with numpy : 0.008853912353515625 nb_pixel_total : 185 time to create 1 rle with old method : 0.0002484321594238281 time for calcul the mask position with numpy : 0.008728742599487305 nb_pixel_total : 29 time to create 1 rle with old method : 0.00010609626770019531 time for calcul the mask position with numpy : 0.007993459701538086 nb_pixel_total : 2011 time to create 1 rle with old method : 0.002264738082885742 time for calcul the mask position with numpy : 0.008525848388671875 nb_pixel_total : 32 time to create 1 rle with old method : 6.175041198730469e-05 time for calcul the mask position with numpy : 0.008461475372314453 nb_pixel_total : 83 time to create 1 rle with old method : 0.00010395050048828125 time for calcul the mask position with numpy : 0.008467435836791992 nb_pixel_total : 112 time to create 1 rle with old method : 0.0001316070556640625 time for calcul the mask position with numpy : 0.008502483367919922 nb_pixel_total : 555 time to create 1 rle with old method : 0.0006124973297119141 time for calcul the mask position with numpy : 0.00847005844116211 nb_pixel_total : 1292 time to create 1 rle with old method : 0.0014195442199707031 time for calcul the mask position with numpy : 0.008485555648803711 nb_pixel_total : 83 time to create 1 rle with old method : 0.00010466575622558594 time for calcul the mask position with numpy : 0.008486270904541016 nb_pixel_total : 89 time to create 1 rle with old method : 0.00011038780212402344 time for calcul the mask position with numpy : 0.008491754531860352 nb_pixel_total : 495 time to create 1 rle with old method : 0.00054931640625 time for calcul the mask position with numpy : 0.008478879928588867 nb_pixel_total : 226 time to create 1 rle with old method : 0.00027632713317871094 time for calcul the mask position with numpy : 0.008464574813842773 nb_pixel_total : 1339 time to create 1 rle with old method : 0.0014984607696533203 time for calcul the mask position with numpy : 0.008468866348266602 nb_pixel_total : 217 time to create 1 rle with old method : 0.0002498626708984375 time for calcul the mask position with numpy : 0.008434295654296875 nb_pixel_total : 84 time to create 1 rle with old method : 0.00010919570922851562 time for calcul the mask position with numpy : 0.00845026969909668 nb_pixel_total : 18 time to create 1 rle with old method : 3.5762786865234375e-05 create new chi : 2.3361175060272217 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0017745494842529297 batch 1 Loaded 151 chid ids of type : 4230 Number RLEs to save : 13929 TO DO : save crop sub photo not yet done ! save time : 2.2804155349731445 nb_obj : 137 nb_hashtags : 7 time to prepare the origin masks : 1.9084603786468506 time for calcul the mask position with numpy : 0.02534651756286621 nb_pixel_total : 1545164 time to create 1 rle with new method : 0.04630136489868164 time for calcul the mask position with numpy : 0.007925987243652344 nb_pixel_total : 63480 time to create 1 rle with old method : 0.07907223701477051 time for calcul the mask position with numpy : 0.00896596908569336 nb_pixel_total : 1757 time to create 1 rle with old method : 0.003484487533569336 time for calcul the mask position with numpy : 0.00895833969116211 nb_pixel_total : 1625 time to create 1 rle with old method : 0.00188446044921875 time for calcul the mask position with numpy : 0.00735926628112793 nb_pixel_total : 974 time to create 1 rle with old method : 0.0011763572692871094 time for calcul the mask position with numpy : 0.0073680877685546875 nb_pixel_total : 97 time to create 1 rle with old method : 0.00014591217041015625 time for calcul the mask position with numpy : 0.007323026657104492 nb_pixel_total : 180 time to create 1 rle with old method : 0.00023508071899414062 time for calcul the mask position with numpy : 0.00736236572265625 nb_pixel_total : 121 time to create 1 rle with old method : 0.0001633167266845703 time for calcul the mask position with numpy : 0.007367849349975586 nb_pixel_total : 568 time to create 1 rle with old method : 0.0006761550903320312 time for calcul the mask position with numpy : 0.007337093353271484 nb_pixel_total : 444 time to create 1 rle with old method : 0.0005097389221191406 time for calcul the mask position with numpy : 0.007337331771850586 nb_pixel_total : 1529 time to create 1 rle with old method : 0.0017206668853759766 time for calcul the mask position with numpy : 0.007399082183837891 nb_pixel_total : 8 time to create 1 rle with old method : 6.341934204101562e-05 time for calcul the mask position with numpy : 0.00729823112487793 nb_pixel_total : 2381 time to create 1 rle with old method : 0.002577066421508789 time for calcul the mask position with numpy : 0.006169557571411133 nb_pixel_total : 300 time to create 1 rle with old method : 0.00038814544677734375 time for calcul the mask position with numpy : 0.00601506233215332 nb_pixel_total : 15 time to create 1 rle with old method : 5.4836273193359375e-05 time for calcul the mask position with numpy : 0.0064890384674072266 nb_pixel_total : 176 time to create 1 rle with old method : 0.00030994415283203125 time for calcul the mask position with numpy : 0.0064852237701416016 nb_pixel_total : 827 time to create 1 rle with old method : 0.0013976097106933594 time for calcul the mask position with numpy : 0.006515979766845703 nb_pixel_total : 2502 time to create 1 rle with old method : 0.004076242446899414 time for calcul the mask position with numpy : 0.006507158279418945 nb_pixel_total : 258 time to create 1 rle with old method : 0.0004413127899169922 time for calcul the mask position with numpy : 0.006791591644287109 nb_pixel_total : 562 time to create 1 rle with old method : 0.000965118408203125 time for calcul the mask position with numpy : 0.00640416145324707 nb_pixel_total : 214 time to create 1 rle with old method : 0.00033354759216308594 time for calcul the mask position with numpy : 0.0061190128326416016 nb_pixel_total : 606 time to create 1 rle with old method : 0.0007009506225585938 time for calcul the mask position with numpy : 0.006229400634765625 nb_pixel_total : 11331 time to create 1 rle with old method : 0.013084888458251953 time for calcul the mask position with numpy : 0.007154703140258789 nb_pixel_total : 124 time to create 1 rle with old method : 0.00018858909606933594 time for calcul the mask position with numpy : 0.007521152496337891 nb_pixel_total : 1040 time to create 1 rle with old method : 0.0014045238494873047 time for calcul the mask position with numpy : 0.006793975830078125 nb_pixel_total : 6317 time to create 1 rle with old method : 0.006963491439819336 time for calcul the mask position with numpy : 0.006215333938598633 nb_pixel_total : 7742 time to create 1 rle with old method : 0.008397817611694336 time for calcul the mask position with numpy : 0.006702899932861328 nb_pixel_total : 99 time to create 1 rle with old method : 0.0001404285430908203 time for calcul the mask position with numpy : 0.010463476181030273 nb_pixel_total : 243 time to create 1 rle with old method : 0.0002987384796142578 time for calcul the mask position with numpy : 0.0063626766204833984 nb_pixel_total : 1172 time to create 1 rle with old method : 0.0013213157653808594 time for calcul the mask position with numpy : 0.006399869918823242 nb_pixel_total : 258 time to create 1 rle with old method : 0.0003457069396972656 time for calcul the mask position with numpy : 0.00609278678894043 nb_pixel_total : 3599 time to create 1 rle with old method : 0.003947019577026367 time for calcul the mask position with numpy : 0.006796598434448242 nb_pixel_total : 8 time to create 1 rle with old method : 5.53131103515625e-05 time for calcul the mask position with numpy : 0.005984067916870117 nb_pixel_total : 484 time to create 1 rle with old method : 0.0005414485931396484 time for calcul the mask position with numpy : 0.006003856658935547 nb_pixel_total : 408 time to create 1 rle with old method : 0.0004856586456298828 time for calcul the mask position with numpy : 0.006021976470947266 nb_pixel_total : 5 time to create 1 rle with old method : 3.314018249511719e-05 time for calcul the mask position with numpy : 0.006062746047973633 nb_pixel_total : 118 time to create 1 rle with old method : 0.00015163421630859375 time for calcul the mask position with numpy : 0.00676274299621582 nb_pixel_total : 152898 time to create 1 rle with new method : 0.04105353355407715 time for calcul the mask position with numpy : 0.0059850215911865234 nb_pixel_total : 606 time to create 1 rle with old method : 0.0007188320159912109 time for calcul the mask position with numpy : 0.00664973258972168 nb_pixel_total : 1270 time to create 1 rle with old method : 0.0013873577117919922 time for calcul the mask position with numpy : 0.006034374237060547 nb_pixel_total : 2829 time to create 1 rle with old method : 0.0030753612518310547 time for calcul the mask position with numpy : 0.006213665008544922 nb_pixel_total : 794 time to create 1 rle with old method : 0.0008707046508789062 time for calcul the mask position with numpy : 0.0059697628021240234 nb_pixel_total : 1195 time to create 1 rle with old method : 0.0012996196746826172 time for calcul the mask position with numpy : 0.0060079097747802734 nb_pixel_total : 6164 time to create 1 rle with old method : 0.006691694259643555 time for calcul the mask position with numpy : 0.006207466125488281 nb_pixel_total : 390 time to create 1 rle with old method : 0.00044417381286621094 time for calcul the mask position with numpy : 0.006063699722290039 nb_pixel_total : 803 time to create 1 rle with old method : 0.0008854866027832031 time for calcul the mask position with numpy : 0.006002187728881836 nb_pixel_total : 867 time to create 1 rle with old method : 0.0009739398956298828 time for calcul the mask position with numpy : 0.00597071647644043 nb_pixel_total : 495 time to create 1 rle with old method : 0.0005605220794677734 time for calcul the mask position with numpy : 0.006013393402099609 nb_pixel_total : 900 time to create 1 rle with old method : 0.0010237693786621094 time for calcul the mask position with numpy : 0.006108999252319336 nb_pixel_total : 346 time to create 1 rle with old method : 0.00041413307189941406 time for calcul the mask position with numpy : 0.0061075687408447266 nb_pixel_total : 280 time to create 1 rle with old method : 0.0004177093505859375 time for calcul the mask position with numpy : 0.006222963333129883 nb_pixel_total : 2028 time to create 1 rle with old method : 0.0022144317626953125 time for calcul the mask position with numpy : 0.006268501281738281 nb_pixel_total : 4008 time to create 1 rle with old method : 0.005582094192504883 time for calcul the mask position with numpy : 0.007018327713012695 nb_pixel_total : 275 time to create 1 rle with old method : 0.00032019615173339844 time for calcul the mask position with numpy : 0.006127119064331055 nb_pixel_total : 169 time to create 1 rle with old method : 0.00021696090698242188 time for calcul the mask position with numpy : 0.006124019622802734 nb_pixel_total : 245 time to create 1 rle with old method : 0.00029468536376953125 time for calcul the mask position with numpy : 0.006093740463256836 nb_pixel_total : 283 time to create 1 rle with old method : 0.00032782554626464844 time for calcul the mask position with numpy : 0.007207155227661133 nb_pixel_total : 342 time to create 1 rle with old method : 0.0006034374237060547 time for calcul the mask position with numpy : 0.0071620941162109375 nb_pixel_total : 19001 time to create 1 rle with old method : 0.020312786102294922 time for calcul the mask position with numpy : 0.006269693374633789 nb_pixel_total : 147 time to create 1 rle with old method : 0.00023412704467773438 time for calcul the mask position with numpy : 0.0061566829681396484 nb_pixel_total : 1589 time to create 1 rle with old method : 0.001790761947631836 time for calcul the mask position with numpy : 0.006177663803100586 nb_pixel_total : 147 time to create 1 rle with old method : 0.00018525123596191406 time for calcul the mask position with numpy : 0.006061553955078125 nb_pixel_total : 389 time to create 1 rle with old method : 0.00047469139099121094 time for calcul the mask position with numpy : 0.006029605865478516 nb_pixel_total : 98 time to create 1 rle with old method : 0.00012636184692382812 time for calcul the mask position with numpy : 0.006205081939697266 nb_pixel_total : 4609 time to create 1 rle with old method : 0.0050411224365234375 time for calcul the mask position with numpy : 0.006268739700317383 nb_pixel_total : 1614 time to create 1 rle with old method : 0.0017790794372558594 time for calcul the mask position with numpy : 0.0060884952545166016 nb_pixel_total : 165 time to create 1 rle with old method : 0.00020933151245117188 time for calcul the mask position with numpy : 0.006089925765991211 nb_pixel_total : 108 time to create 1 rle with old method : 0.00023794174194335938 time for calcul the mask position with numpy : 0.006156206130981445 nb_pixel_total : 650 time to create 1 rle with old method : 0.0007307529449462891 time for calcul the mask position with numpy : 0.006111621856689453 nb_pixel_total : 162 time to create 1 rle with old method : 0.0002193450927734375 time for calcul the mask position with numpy : 0.006129264831542969 nb_pixel_total : 1778 time to create 1 rle with old method : 0.0019354820251464844 time for calcul the mask position with numpy : 0.006034374237060547 nb_pixel_total : 335 time to create 1 rle with old method : 0.0003883838653564453 time for calcul the mask position with numpy : 0.0061686038970947266 nb_pixel_total : 2494 time to create 1 rle with old method : 0.0028045177459716797 time for calcul the mask position with numpy : 0.0061681270599365234 nb_pixel_total : 198 time to create 1 rle with old method : 0.00024080276489257812 time for calcul the mask position with numpy : 0.006242036819458008 nb_pixel_total : 187 time to create 1 rle with old method : 0.00029158592224121094 time for calcul the mask position with numpy : 0.006150722503662109 nb_pixel_total : 857 time to create 1 rle with old method : 0.0009510517120361328 time for calcul the mask position with numpy : 0.008025407791137695 nb_pixel_total : 106096 time to create 1 rle with old method : 0.11932086944580078 time for calcul the mask position with numpy : 0.007597208023071289 nb_pixel_total : 744 time to create 1 rle with old method : 0.0008907318115234375 time for calcul the mask position with numpy : 0.007455587387084961 nb_pixel_total : 709 time to create 1 rle with old method : 0.0008511543273925781 time for calcul the mask position with numpy : 0.007485628128051758 nb_pixel_total : 135 time to create 1 rle with old method : 0.000186920166015625 time for calcul the mask position with numpy : 0.007862091064453125 nb_pixel_total : 2536 time to create 1 rle with old method : 0.002916097640991211 time for calcul the mask position with numpy : 0.0073699951171875 nb_pixel_total : 211 time to create 1 rle with old method : 0.00029206275939941406 time for calcul the mask position with numpy : 0.0074961185455322266 nb_pixel_total : 225 time to create 1 rle with old method : 0.0003101825714111328 time for calcul the mask position with numpy : 0.00752711296081543 nb_pixel_total : 1085 time to create 1 rle with old method : 0.0012006759643554688 time for calcul the mask position with numpy : 0.0075762271881103516 nb_pixel_total : 26929 time to create 1 rle with old method : 0.02918243408203125 time for calcul the mask position with numpy : 0.008339405059814453 nb_pixel_total : 31363 time to create 1 rle with old method : 0.039101600646972656 time for calcul the mask position with numpy : 0.007556915283203125 nb_pixel_total : 92 time to create 1 rle with old method : 0.00014162063598632812 time for calcul the mask position with numpy : 0.0073566436767578125 nb_pixel_total : 432 time to create 1 rle with old method : 0.0005116462707519531 time for calcul the mask position with numpy : 0.00742030143737793 nb_pixel_total : 1533 time to create 1 rle with old method : 0.0017366409301757812 time for calcul the mask position with numpy : 0.007414102554321289 nb_pixel_total : 230 time to create 1 rle with old method : 0.00028395652770996094 time for calcul the mask position with numpy : 0.007379770278930664 nb_pixel_total : 254 time to create 1 rle with old method : 0.00031876564025878906 time for calcul the mask position with numpy : 0.007406949996948242 nb_pixel_total : 390 time to create 1 rle with old method : 0.0004649162292480469 time for calcul the mask position with numpy : 0.0074503421783447266 nb_pixel_total : 150 time to create 1 rle with old method : 0.0002079010009765625 time for calcul the mask position with numpy : 0.007410526275634766 nb_pixel_total : 408 time to create 1 rle with old method : 0.0005021095275878906 time for calcul the mask position with numpy : 0.00740814208984375 nb_pixel_total : 1866 time to create 1 rle with old method : 0.0021028518676757812 time for calcul the mask position with numpy : 0.007374763488769531 nb_pixel_total : 186 time to create 1 rle with old method : 0.0002446174621582031 time for calcul the mask position with numpy : 0.00738978385925293 nb_pixel_total : 136 time to create 1 rle with old method : 0.00018644332885742188 time for calcul the mask position with numpy : 0.007385730743408203 nb_pixel_total : 316 time to create 1 rle with old method : 0.00040221214294433594 time for calcul the mask position with numpy : 0.007394075393676758 nb_pixel_total : 765 time to create 1 rle with old method : 0.0008785724639892578 time for calcul the mask position with numpy : 0.0074520111083984375 nb_pixel_total : 2413 time to create 1 rle with old method : 0.002658367156982422 time for calcul the mask position with numpy : 0.007418155670166016 nb_pixel_total : 175 time to create 1 rle with old method : 0.00022363662719726562 time for calcul the mask position with numpy : 0.0074443817138671875 nb_pixel_total : 94 time to create 1 rle with old method : 0.0001811981201171875 time for calcul the mask position with numpy : 0.007374763488769531 nb_pixel_total : 60 time to create 1 rle with old method : 0.00010251998901367188 time for calcul the mask position with numpy : 0.0073931217193603516 nb_pixel_total : 609 time to create 1 rle with old method : 0.0006880760192871094 time for calcul the mask position with numpy : 0.006344795227050781 nb_pixel_total : 237 time to create 1 rle with old method : 0.0003097057342529297 time for calcul the mask position with numpy : 0.00736546516418457 nb_pixel_total : 263 time to create 1 rle with old method : 0.0003693103790283203 time for calcul the mask position with numpy : 0.007403373718261719 nb_pixel_total : 224 time to create 1 rle with old method : 0.0002777576446533203 time for calcul the mask position with numpy : 0.007435798645019531 nb_pixel_total : 243 time to create 1 rle with old method : 0.0003006458282470703 time for calcul the mask position with numpy : 0.007390022277832031 nb_pixel_total : 875 time to create 1 rle with old method : 0.0009882450103759766 time for calcul the mask position with numpy : 0.007467746734619141 nb_pixel_total : 9464 time to create 1 rle with old method : 0.01018977165222168 time for calcul the mask position with numpy : 0.007403850555419922 nb_pixel_total : 1 time to create 1 rle with old method : 3.314018249511719e-05 time for calcul the mask position with numpy : 0.0073833465576171875 nb_pixel_total : 63 time to create 1 rle with old method : 0.0001220703125 time for calcul the mask position with numpy : 0.007363796234130859 nb_pixel_total : 239 time to create 1 rle with old method : 0.00029850006103515625 time for calcul the mask position with numpy : 0.007290363311767578 nb_pixel_total : 1584 time to create 1 rle with old method : 0.0017871856689453125 time for calcul the mask position with numpy : 0.007424831390380859 nb_pixel_total : 345 time to create 1 rle with old method : 0.0004296302795410156 time for calcul the mask position with numpy : 0.007385730743408203 nb_pixel_total : 509 time to create 1 rle with old method : 0.0005905628204345703 time for calcul the mask position with numpy : 0.007430076599121094 nb_pixel_total : 300 time to create 1 rle with old method : 0.00037860870361328125 time for calcul the mask position with numpy : 0.007431983947753906 nb_pixel_total : 843 time to create 1 rle with old method : 0.0009655952453613281 time for calcul the mask position with numpy : 0.007436990737915039 nb_pixel_total : 315 time to create 1 rle with old method : 0.00038504600524902344 time for calcul the mask position with numpy : 0.007407426834106445 nb_pixel_total : 396 time to create 1 rle with old method : 0.0004730224609375 time for calcul the mask position with numpy : 0.007434844970703125 nb_pixel_total : 383 time to create 1 rle with old method : 0.0005652904510498047 time for calcul the mask position with numpy : 0.007535696029663086 nb_pixel_total : 658 time to create 1 rle with old method : 0.0007627010345458984 time for calcul the mask position with numpy : 0.007561683654785156 nb_pixel_total : 2046 time to create 1 rle with old method : 0.0022606849670410156 time for calcul the mask position with numpy : 0.009076833724975586 nb_pixel_total : 191 time to create 1 rle with old method : 0.0002498626708984375 time for calcul the mask position with numpy : 0.007465839385986328 nb_pixel_total : 68 time to create 1 rle with old method : 0.00011348724365234375 time for calcul the mask position with numpy : 0.01218104362487793 nb_pixel_total : 34 time to create 1 rle with old method : 9.703636169433594e-05 time for calcul the mask position with numpy : 0.008914947509765625 nb_pixel_total : 875 time to create 1 rle with old method : 0.0009963512420654297 time for calcul the mask position with numpy : 0.012083053588867188 nb_pixel_total : 546 time to create 1 rle with old method : 0.0006322860717773438 time for calcul the mask position with numpy : 0.012067794799804688 nb_pixel_total : 247 time to create 1 rle with old method : 0.0003066062927246094 time for calcul the mask position with numpy : 0.012350320816040039 nb_pixel_total : 100 time to create 1 rle with old method : 0.0001747608184814453 time for calcul the mask position with numpy : 0.012201547622680664 nb_pixel_total : 1266 time to create 1 rle with old method : 0.00142669677734375 time for calcul the mask position with numpy : 0.012210369110107422 nb_pixel_total : 128 time to create 1 rle with old method : 0.00019311904907226562 time for calcul the mask position with numpy : 0.01382589340209961 nb_pixel_total : 387 time to create 1 rle with old method : 0.0005855560302734375 time for calcul the mask position with numpy : 0.012315988540649414 nb_pixel_total : 466 time to create 1 rle with old method : 0.0005555152893066406 time for calcul the mask position with numpy : 0.012265920639038086 nb_pixel_total : 90 time to create 1 rle with old method : 0.00013685226440429688 time for calcul the mask position with numpy : 0.012227058410644531 nb_pixel_total : 230 time to create 1 rle with old method : 0.0002906322479248047 time for calcul the mask position with numpy : 0.012251853942871094 nb_pixel_total : 64 time to create 1 rle with old method : 0.00016927719116210938 time for calcul the mask position with numpy : 0.011692523956298828 nb_pixel_total : 1327 time to create 1 rle with old method : 0.0015053749084472656 create new chi : 1.5789260864257812 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0019221305847167969 batch 1 Loaded 138 chid ids of type : 4230 Number RLEs to save : 14885 TO DO : save crop sub photo not yet done ! save time : 2.758699893951416 map_output_result : {1333763100: (0.0, 'Should be the crop_list due to order', 0.0), 1333763021: (0.0, 'Should be the crop_list due to order', 0.0), 1333762991: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1333763100, 1333763021, 1333762991] Looping around the photos to save general results len do output : 3 /1333763100.Didn't retrieve data . /1333763021.Didn't retrieve data . /1333762991.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2537948') ('4234', '20144249', '1333763100', None, None, None, None, None, '2537948') ('4234', None, None, None, None, None, None, None, '2537948') ('4234', '20144249', '1333763021', None, None, None, None, None, '2537948') ('4234', None, None, None, None, None, None, None, '2537948') ('4234', '20144249', '1333762991', None, None, None, None, None, '2537948') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.4571552276611328 save_final save missing photos in datou_result : time spend for datou_step_exec : 18.51898717880249 time spend to save output : 0.4576079845428467 total time spend for step 4 : 18.976595163345337 step5:crop_condition Sat Feb 1 20:21:21 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 3 ! batch 1 Loaded 426 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 176 About to insert : list_path_to_insert length 176 new photo from crops ! About to upload 176 photos upload in portfolio : 4869462 init cache_photo without model_param we have 176 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738437684_1430713 we have uploaded 176 photos in the portfolio 4869462 time of upload the photos Elapsed time : 36.47686052322388 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 42 About to insert : list_path_to_insert length 42 new photo from crops ! About to upload 42 photos upload in portfolio : 4869462 init cache_photo without model_param we have 42 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738437721_1430713 we have uploaded 42 photos in the portfolio 4869462 time of upload the photos Elapsed time : 8.610157251358032 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 8 About to insert : list_path_to_insert length 8 new photo from crops ! About to upload 8 photos upload in portfolio : 4869462 init cache_photo without model_param we have 8 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738437731_1430713 we have uploaded 8 photos in the portfolio 4869462 time of upload the photos Elapsed time : 4.1725804805755615 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 21 About to insert : list_path_to_insert length 21 new photo from crops ! About to upload 21 photos upload in portfolio : 4869462 init cache_photo without model_param we have 21 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738437735_1430713 we have uploaded 21 photos in the portfolio 4869462 time of upload the photos Elapsed time : 5.281739234924316 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 35 About to insert : list_path_to_insert length 35 new photo from crops ! About to upload 35 photos upload in portfolio : 4869462 init cache_photo without model_param we have 35 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738437741_1430713 we have uploaded 35 photos in the portfolio 4869462 time of upload the photos Elapsed time : 7.474408864974976 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1738437748_1430713 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.4899609088897705 we have finished the crop for the class : pet_fonce delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1333763100, 1333763021, 1333762991] Looping around the photos to save general results len do output : 283 /1333772017Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772018Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772019Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772020Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772021Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772022Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772023Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772024Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772025Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772026Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772027Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772028Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772029Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772030Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772031Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772032Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772033Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772034Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772035Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772036Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772037Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772038Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772039Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772040Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772041Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772042Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772043Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772044Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772045Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772046Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772047Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772048Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772049Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772050Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772051Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772052Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772053Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772054Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772057Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772059Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772061Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772063Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772065Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772067Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772069Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772071Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772073Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772075Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772077Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772079Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772081Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772083Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772085Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772087Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772089Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772091Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772093Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772095Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772097Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772099Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772101Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772103Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772105Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772107Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772109Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772129Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772293Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772367Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772392Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772393Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1333772416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2537948') ('4234', '20144249', '1333763100', None, None, None, None, None, '2537948') ('4234', None, None, None, None, None, None, None, '2537948') ('4234', '20144249', '1333763021', None, None, None, None, None, '2537948') ('4234', None, None, None, None, None, None, None, '2537948') ('4234', '20144249', '1333762991', None, None, None, None, None, '2537948') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 852 time used for this insertion : 0.04781460762023926 save_final save missing photos in datou_result : time spend for datou_step_exec : 67.65064883232117 time spend to save output : 0.05602884292602539 total time spend for step 5 : 67.70667767524719 step6:thcl Sat Feb 1 20:22:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.02707958221435547 time to convert the images to numpy array : 0.07114243507385254 time to import caffe and check if the image exist : 0.01860332489013672 time to convert the images to numpy array : 0.08659076690673828 time to import caffe and check if the image exist : 0.024731874465942383 time to convert the images to numpy array : 0.08591365814208984 time to import caffe and check if the image exist : 0.012854576110839844 time to convert the images to numpy array : 0.09673523902893066 time to import caffe and check if the image exist : 0.02530694007873535 time to convert the images to numpy array : 0.08889532089233398 time to import caffe and check if the image exist : 0.02073359489440918 time to convert the images to numpy array : 0.0938727855682373 time to import caffe and check if the image exist : 0.028399944305419922 time to convert the images to numpy array : 0.08851480484008789 time to import caffe and check if the image exist : 0.032553672790527344 time to convert the images to numpy array : 0.08708024024963379 time to import caffe and check if the image exist : 0.028398513793945312 time to convert the images to numpy array : 0.0923912525177002 time to import caffe and check if the image exist : 0.0324559211730957 time to convert the images to numpy array : 0.08779788017272949 total time to convert the images to numpy array : 0.4323158264160156 list photo_ids error: [] list photo_ids correct : [1333772017, 1333772018, 1333772019, 1333772020, 1333772021, 1333772022, 1333772023, 1333772024, 1333772025, 1333772026, 1333772027, 1333772028, 1333772029, 1333772030, 1333772031, 1333772032, 1333772033, 1333772034, 1333772035, 1333772036, 1333772037, 1333772038, 1333772039, 1333772040, 1333772041, 1333772042, 1333772043, 1333772044, 1333772045, 1333772097, 1333772099, 1333772101, 1333772103, 1333772105, 1333772107, 1333772109, 1333772111, 1333772113, 1333772115, 1333772117, 1333772119, 1333772121, 1333772123, 1333772125, 1333772127, 1333772129, 1333772131, 1333772133, 1333772135, 1333772137, 1333772139, 1333772141, 1333772143, 1333772145, 1333772147, 1333772149, 1333772151, 1333772153, 1333772336, 1333772337, 1333772338, 1333772339, 1333772340, 1333772341, 1333772342, 1333772343, 1333772344, 1333772345, 1333772346, 1333772347, 1333772348, 1333772349, 1333772350, 1333772351, 1333772352, 1333772353, 1333772354, 1333772355, 1333772356, 1333772357, 1333772358, 1333772359, 1333772360, 1333772361, 1333772362, 1333772363, 1333772364, 1333772394, 1333772395, 1333772396, 1333772397, 1333772398, 1333772399, 1333772400, 1333772401, 1333772402, 1333772403, 1333772404, 1333772405, 1333772406, 1333772407, 1333772408, 1333772409, 1333772410, 1333772411, 1333772413, 1333772414, 1333772415, 1333772416, 1333772046, 1333772047, 1333772048, 1333772049, 1333772050, 1333772051, 1333772052, 1333772053, 1333772054, 1333772057, 1333772059, 1333772061, 1333772063, 1333772065, 1333772067, 1333772069, 1333772071, 1333772073, 1333772075, 1333772077, 1333772079, 1333772081, 1333772083, 1333772085, 1333772087, 1333772089, 1333772091, 1333772093, 1333772095, 1333772307, 1333772308, 1333772309, 1333772310, 1333772311, 1333772312, 1333772313, 1333772314, 1333772315, 1333772316, 1333772317, 1333772318, 1333772319, 1333772320, 1333772321, 1333772322, 1333772323, 1333772324, 1333772325, 1333772326, 1333772327, 1333772328, 1333772329, 1333772330, 1333772331, 1333772332, 1333772333, 1333772334, 1333772335, 1333772155, 1333772157, 1333772159, 1333772161, 1333772163, 1333772165, 1333772167, 1333772169, 1333772171, 1333772173, 1333772175, 1333772177, 1333772179, 1333772181, 1333772183, 1333772185, 1333772187, 1333772189, 1333772191, 1333772193, 1333772195, 1333772197, 1333772199, 1333772201, 1333772203, 1333772205, 1333772207, 1333772209, 1333772211, 1333772213, 1333772215, 1333772217, 1333772219, 1333772221, 1333772223, 1333772225, 1333772227, 1333772229, 1333772231, 1333772233, 1333772235, 1333772238, 1333772240, 1333772242, 1333772244, 1333772246, 1333772248, 1333772250, 1333772252, 1333772254, 1333772256, 1333772258, 1333772260, 1333772262, 1333772264, 1333772266, 1333772268, 1333772270, 1333772272, 1333772274, 1333772276, 1333772278, 1333772280, 1333772282, 1333772284, 1333772285, 1333772286, 1333772287, 1333772288, 1333772289, 1333772290, 1333772291, 1333772292, 1333772293, 1333772294, 1333772295, 1333772296, 1333772297, 1333772298, 1333772299, 1333772300, 1333772301, 1333772302, 1333772303, 1333772304, 1333772305, 1333772306, 1333772365, 1333772366, 1333772367, 1333772368, 1333772369, 1333772370, 1333772371, 1333772372, 1333772373, 1333772374, 1333772375, 1333772376, 1333772377, 1333772378, 1333772379, 1333772380, 1333772381, 1333772382, 1333772383, 1333772384, 1333772385, 1333772386, 1333772387, 1333772388, 1333772389, 1333772390, 1333772391, 1333772392, 1333772393] number of photos to traite : 283 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10553 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10334 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 1.2947041988372803 time used to do the prediction : 1.0344955921173096 save descriptor for thcl : 3237 time to traite the descriptors : 1.6372394561767578 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1333772017 To insert : 1333772018 To insert : 1333772019 To insert : 1333772020 To insert : 1333772021 To insert : 1333772022 To insert : 1333772023 To insert : 1333772024 To insert : 1333772025 To insert : 1333772026 To insert : 1333772027 To insert : 1333772028 To insert : 1333772029 To insert : 1333772030 To insert : 1333772031 To insert : 1333772032 To insert : 1333772033 To insert : 1333772034 To insert : 1333772035 To insert : 1333772036 To insert : 1333772037 To insert : 1333772038 To insert : 1333772039 To insert : 1333772040 To insert : 1333772041 To insert : 1333772042 To insert : 1333772043 To insert : 1333772044 To insert : 1333772045 To insert : 1333772097 To insert : 1333772099 To insert : 1333772101 To insert : 1333772103 To insert : 1333772105 To insert : 1333772107 To insert : 1333772109 To insert : 1333772111 To insert : 1333772113 To insert : 1333772115 To insert : 1333772117 To insert : 1333772119 To insert : 1333772121 To insert : 1333772123 To insert : 1333772125 To insert : 1333772127 To insert : 1333772129 To insert : 1333772131 To insert : 1333772133 To insert : 1333772135 To insert : 1333772137 To insert : 1333772139 To insert : 1333772141 To insert : 1333772143 To insert : 1333772145 To insert : 1333772147 To insert : 1333772149 To insert : 1333772151 To insert : 1333772153 To insert : 1333772336 To insert : 1333772337 To insert : 1333772338 To insert : 1333772339 To insert : 1333772340 To insert : 1333772341 To insert : 1333772342 To insert : 1333772343 To insert : 1333772344 To insert : 1333772345 To insert : 1333772346 To insert : 1333772347 To insert : 1333772348 To insert : 1333772349 To insert : 1333772350 To insert : 1333772351 To insert : 1333772352 To insert : 1333772353 To insert : 1333772354 To insert : 1333772355 To insert : 1333772356 To insert : 1333772357 To insert : 1333772358 To insert : 1333772359 To insert : 1333772360 To insert : 1333772361 To insert : 1333772362 To insert : 1333772363 To insert : 1333772364 To insert : 1333772394 To insert : 1333772395 To insert : 1333772396 To insert : 1333772397 To insert : 1333772398 To insert : 1333772399 To insert : 1333772400 To insert : 1333772401 To insert : 1333772402 To insert : 1333772403 To insert : 1333772404 To insert : 1333772405 To insert : 1333772406 To insert : 1333772407 To insert : 1333772408 To insert : 1333772409 To insert : 1333772410 To insert : 1333772411 To insert : 1333772413 To insert : 1333772414 To insert : 1333772415 To insert : 1333772416 To insert : 1333772046 To insert : 1333772047 To insert : 1333772048 To insert : 1333772049 To insert : 1333772050 To insert : 1333772051 To insert : 1333772052 To insert : 1333772053 To insert : 1333772054 To insert : 1333772057 To insert : 1333772059 To insert : 1333772061 To insert : 1333772063 To insert : 1333772065 To insert : 1333772067 To insert : 1333772069 To insert : 1333772071 To insert : 1333772073 To insert : 1333772075 To insert : 1333772077 To insert : 1333772079 To insert : 1333772081 To insert : 1333772083 To insert : 1333772085 To insert : 1333772087 To insert : 1333772089 To insert : 1333772091 To insert : 1333772093 To insert : 1333772095 To insert : 1333772307 To insert : 1333772308 To insert : 1333772309 To insert : 1333772310 To insert : 1333772311 To insert : 1333772312 To insert : 1333772313 To insert : 1333772314 To insert : 1333772315 To insert : 1333772316 To insert : 1333772317 To insert : 1333772318 To insert : 1333772319 To insert : 1333772320 To insert : 1333772321 To insert : 1333772322 To insert : 1333772323 To insert : 1333772324 To insert : 1333772325 To insert : 1333772326 To insert : 1333772327 To insert : 1333772328 To insert : 1333772329 To insert : 1333772330 To insert : 1333772331 To insert : 1333772332 To insert : 1333772333 To insert : 1333772334 To insert : 1333772335 To insert : 1333772155 To insert : 1333772157 To insert : 1333772159 To insert : 1333772161 To insert : 1333772163 To insert : 1333772165 To insert : 1333772167 To insert : 1333772169 To insert : 1333772171 To insert : 1333772173 To insert : 1333772175 To insert : 1333772177 To insert : 1333772179 To insert : 1333772181 To insert : 1333772183 To insert : 1333772185 To insert : 1333772187 To insert : 1333772189 To insert : 1333772191 To insert : 1333772193 To insert : 1333772195 To insert : 1333772197 To insert : 1333772199 To insert : 1333772201 To insert : 1333772203 To insert : 1333772205 To insert : 1333772207 To insert : 1333772209 To insert : 1333772211 To insert : 1333772213 To insert : 1333772215 To insert : 1333772217 To insert : 1333772219 To insert : 1333772221 To insert : 1333772223 To insert : 1333772225 To insert : 1333772227 To insert : 1333772229 To insert : 1333772231 To insert : 1333772233 To insert : 1333772235 To insert : 1333772238 To insert : 1333772240 To insert : 1333772242 To insert : 1333772244 To insert : 1333772246 To insert : 1333772248 To insert : 1333772250 To insert : 1333772252 To insert : 1333772254 To insert : 1333772256 To insert : 1333772258 To insert : 1333772260 To insert : 1333772262 To insert : 1333772264 To insert : 1333772266 To insert : 1333772268 To insert : 1333772270 To insert : 1333772272 To insert : 1333772274 To insert : 1333772276 To insert : 1333772278 To insert : 1333772280 To insert : 1333772282 To insert : 1333772284 To insert : 1333772285 To insert : 1333772286 To insert : 1333772287 To insert : 1333772288 To insert : 1333772289 To insert : 1333772290 To insert : 1333772291 To insert : 1333772292 To insert : 1333772293 To insert : 1333772294 To insert : 1333772295 To insert : 1333772296 To insert : 1333772297 To insert : 1333772298 To insert : 1333772299 To insert : 1333772300 To insert : 1333772301 To insert : 1333772302 To insert : 1333772303 To insert : 1333772304 To insert : 1333772305 To insert : 1333772306 To insert : 1333772365 To insert : 1333772366 To insert : 1333772367 To insert : 1333772368 To insert : 1333772369 To insert : 1333772370 To insert : 1333772371 To insert : 1333772372 To insert : 1333772373 To insert : 1333772374 To insert : 1333772375 To insert : 1333772376 To insert : 1333772377 To insert : 1333772378 To insert : 1333772379 To insert : 1333772380 To insert : 1333772381 To insert : 1333772382 To insert : 1333772383 To insert : 1333772384 To insert : 1333772385 To insert : 1333772386 To insert : 1333772387 To insert : 1333772388 To insert : 1333772389 To insert : 1333772390 To insert : 1333772391 To insert : 1333772392 To insert : 1333772393 time to insert the descriptors : 45.97511267662048 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 429 time used for this insertion : 0.0361635684967041 save missing photos in datou_result : time spend for datou_step_exec : 54.511914014816284 time spend to save output : 0.08871269226074219 total time spend for step 6 : 54.600626707077026 step7:ventilate_hashtags_in_portfolio Sat Feb 1 20:23:23 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20144249 get user id for portfolio 20144249 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20144249 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','Papier','mal_croppe','refus','environnement','flou','Carton','pet_fonce','Tetrapak','autre','PET_clair','pehd','Film_plastique','pet_clair','PEHD','metal','carton','PET_fonce')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20144249 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','Papier','mal_croppe','refus','environnement','flou','Carton','pet_fonce','Tetrapak','autre','PET_clair','pehd','Film_plastique','pet_clair','PEHD','metal','carton','PET_fonce')) AND mptpi.`min_score`=0.6 To do To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20144249 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','Papier','mal_croppe','refus','environnement','flou','Carton','pet_fonce','Tetrapak','autre','PET_clair','pehd','Film_plastique','pet_clair','PEHD','metal','carton','PET_fonce')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20144249 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('papier','Papier','mal_croppe','refus','environnement','flou','Carton','pet_fonce','Tetrapak','autre','PET_clair','pehd','Film_plastique','pet_clair','PEHD','metal','carton','PET_fonce')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20144935,20144936,20144937,20144938,20144939,20144950,20144951,20144942,20144943,20144947,20144948,20144946,20144949?tags=papier,mal_croppe,refus,environnement,flou,carton,pet_fonce,tetrapak,autre,pet_clair,pehd,film_plastique,metal&datou_id_consolidate=4235&port_consolidate=20144249 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1333763100, 1333763021, 1333762991] Looping around the photos to save general results len do output : 1 /20144249. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2537948') ('4234', '20144249', '1333763100', None, None, None, None, None, '2537948') ('4234', None, None, None, None, None, None, None, '2537948') ('4234', '20144249', '1333763021', None, None, None, None, None, '2537948') ('4234', None, None, None, None, None, None, None, '2537948') ('4234', '20144249', '1333762991', None, None, None, None, None, '2537948') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.012472152709960938 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6445589065551758 time spend to save output : 0.012741804122924805 total time spend for step 7 : 1.6573007106781006 step8:final Sat Feb 1 20:23:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1333763100: ('0.2637815041517808',), 1333763021: ('0.2637815041517808',), 1333762991: ('0.2637815041517808',)} new output for save of step final : {1333763100: ('0.2637815041517808',), 1333763021: ('0.2637815041517808',), 1333762991: ('0.2637815041517808',)} [1333763100, 1333763021, 1333762991] Looping around the photos to save general results len do output : 3 /1333763100.Didn't retrieve data . /1333763021.Didn't retrieve data . /1333762991.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2537948') ('4234', '20144249', '1333763100', None, None, None, None, None, '2537948') ('4234', None, None, None, None, None, None, None, '2537948') ('4234', '20144249', '1333763021', None, None, None, None, None, '2537948') ('4234', None, None, None, None, None, None, None, '2537948') ('4234', '20144249', '1333762991', None, None, None, None, None, '2537948') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.01254725456237793 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.12979817390441895 time spend to save output : 0.012775421142578125 total time spend for step 8 : 0.14257359504699707 step9:velours_tree Sat Feb 1 20:23:25 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20144935,20144936,20144937,20144938,20144939,20144950,20144951,20144942,20144943,20144947,20144948,20144946,20144949 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20144935 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20144936 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20144937 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20144938 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20144939 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20144950 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20144951 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20144942 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20144943 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20144947 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20144948 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20144946 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20144949 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 283 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [4 3 4 4 3 1 0 1 1 1 0 3 0 3 0 1 3 3 0 0 0 3 0 0 0 1 0 3 4 0 0 4 0 0 0 3 1 0 0 0 0 0 0 3 1 4 2 2 0 1 1 1 4 0 3 4 4 4 0 2 3 4 4 3 0 1 1 1 0 0 3 0 3 0 1 3 0 0 3 0 0 3 0 1 0 0 3 0 0 0 0 1 3 0 0 1 0 5 0 3 0 0 0 0 0 0 3 3 0 3 0 1 4 4 2 1 1 1 4 0 3 4 0 5 3 4 4 4 4 1 1 1 0 4 0 3 0 3 1 0 0 0 0 3 0 0 4 0 0 0 0 3 1 0 0 0 0 3 0 1 0 4 4 2 2 0 1 0 1 1 4 0 3 4 5 0 2 0 1 1 3 3 4 1 1 2 5 4 0 1 1 1 3 4 1 1 5 2 2 0 5 2 0 1 1 1 3 4 3 0 4 1 3 1 2 2 4 0 0 1 0 0 0 1 3 0 0 0 5 4 4 5 4 0 2 5 2 0 4 4 0 2 0 0 4 5 4 5 2 3 1 5 0 4 5 5 5 5 4 5 5 2 3 5 0 4 5 5 5 5 5 2 3 0 0 4 3 5 5 5 5 4 5] Elapsed time: 0.05756211280822754 graph_id used : 75138 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20144935,20144936,20144937,20144938,20144939,20144950,20144951,20144942,20144943,20144947,20144948,20144946,20144949?tags=papier,mal_croppe,refus,environnement,flou,carton,pet_fonce,tetrapak,autre,pet_clair,pehd,film_plastique,metal&datou_id_consolidate=4235&port_consolidate=20144249&tree_id=75138 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1333763100, 1333763021, 1333762991] Looping around the photos to save general results len do output : 1 /20144249Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2537948') ('4234', '20144249', '1333763100', None, None, None, None, None, '2537948') ('4234', None, None, None, None, None, None, None, '2537948') ('4234', '20144249', '1333763021', None, None, None, None, None, '2537948') ('4234', None, None, None, None, None, None, None, '2537948') ('4234', '20144249', '1333762991', None, None, None, None, None, '2537948') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.011870622634887695 save_final save missing photos in datou_result : time spend for datou_step_exec : 19.587120532989502 time spend to save output : 0.012119770050048828 total time spend for step 9 : 19.59924030303955 step10:send_mail_cod Sat Feb 1 20:23:45 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20144249_01-02-2025_20_23_45.pdf 20144917 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201449171738437825 20144918 imagette201449181738437826 20144919 imagette201449191738437826 20144921 imagette201449211738437826 20144932 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201449321738437826 20144933 change filename to text .imagette201449331738437827 20144924 imagette201449241738437827 20144925 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201449251738437827 20144929 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201449291738437828 20144930 imagette201449301738437829 20144928 imagette201449281738437829 20144931 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette201449311738437829 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20144249 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20144935,20144936,20144937,20144938,20144939,20144950,20144951,20144942,20144943,20144947,20144948,20144946,20144949?tags=papier,mal_croppe,refus,environnement,flou,carton,pet_fonce,tetrapak,autre,pet_clair,pehd,film_plastique,metal&datou_id_consolidate=4235&port_consolidate=20144249&tree_id=75138 your option no_mail is active, we will not send the real mail to your client args[1333763100] : ((1333763100, -8.20002981190201, 492609224), (1333763100, -0.31726060508863313, 496442774), '0.2637815041517808') We are sending mail with results at cod@fotonower.com args[1333763021] : ((1333763021, -8.193745233642026, 492609224), (1333763021, -0.31765100572398536, 496442774), '0.2637815041517808') We are sending mail with results at cod@fotonower.com args[1333762991] : ((1333762991, -8.198101534809584, 492609224), (1333762991, -0.31709219510391434, 496442774), '0.2637815041517808') We are sending mail with results at cod@fotonower.com refus_total : 0.2637815041517808 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20144249 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20144249_01-02-2025_20_23_45.pdf results_Qualipapia_P20144249_01-02-2025_20_23_45.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20144249_01-02-2025_20_23_45.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20144249','results_Qualipapia_P20144249_01-02-2025_20_23_45.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20144249_01-02-2025_20_23_45.pdf','pdf','','0.18','0.2637815041517808') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1333763100, 1333763021, 1333762991] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2537948') ('4234', '20144249', '1333763100', None, None, None, None, None, '2537948') ('4234', None, None, None, None, None, None, None, '2537948') ('4234', '20144249', '1333763021', None, None, None, None, None, '2537948') ('4234', None, None, None, None, None, None, None, '2537948') ('4234', '20144249', '1333762991', None, None, None, None, None, '2537948') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.01143026351928711 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.669444799423218 time spend to save output : 0.011571645736694336 total time spend for step 10 : 5.681016445159912 step11:split_time_score Sat Feb 1 20:23:50 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('16', 3),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 01022025 20144249 Nombre de photos uploadées : 3 / 23040 (0%) 01022025 20144249 Nombre de photos taguées (types de déchets): 3 / 3 (100%) 01022025 20144249 Nombre de photos taguées (volume) : 0 / 3 (0%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.0067901611328125e-06 ??? elapsed_time : fill_and_build_computed_from_old_data 0.0002295970916748047 elapsed_time : insert_dashboard_record_day_entry 0.022517681121826172 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140596 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140597 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140598 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140599 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140600 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140601 order by id desc limit 1 Qualite : 0.2309767904458083 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20140602_01-02-2025_13_40_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140602 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20140602 AND mptpi.`type`=4230 To do Qualite : 0.22262298814595152 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20140603_01-02-2025_13_36_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140603 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20140603 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140832 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140833 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140834 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140835 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140836 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140837 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140838 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140839 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140840 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140841 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140842 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140843 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140844 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140845 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140846 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140847 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140848 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140849 order by id desc limit 1 Qualite : 0.20057559398632832 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20140850_01-02-2025_14_10_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140850 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20140850 AND mptpi.`type`=4230 To do Qualite : 0.18431451539642255 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20140851_01-02-2025_13_35_17.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140851 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20140851 AND mptpi.`type`=4230 To do Qualite : 0.19593863158258523 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20140852_01-02-2025_13_53_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20140852 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20140852 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141296 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141297 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141298 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141299 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141300 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141301 order by id desc limit 1 Qualite : 0.20015635039197005 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20141302_01-02-2025_14_32_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141302 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20141302 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141657 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141658 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141659 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141660 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141661 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141662 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141663 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141664 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141665 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141666 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141667 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141668 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141669 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141670 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141671 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141672 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141673 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141674 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141675 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141676 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141677 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141678 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141679 order by id desc limit 1 Qualite : 0.20827029105652828 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20141680_01-02-2025_15_08_13.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141680 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20141680 AND mptpi.`type`=4230 To do Qualite : 0.1946503779440649 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20141681_01-02-2025_14_44_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20141681 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20141681 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142049 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142050 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142051 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142052 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142053 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142054 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142055 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142056 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142057 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142058 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142059 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142060 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142061 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142062 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142063 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142064 order by id desc limit 1 Qualite : 0.12794507052083104 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20142065_01-02-2025_15_33_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142065 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20142065 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142066 order by id desc limit 1 Qualite : 0.19287199063881355 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20142067_01-02-2025_15_18_52.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142067 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20142067 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142451 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142452 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142453 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142454 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142455 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142456 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142457 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142458 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142459 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142460 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142461 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142462 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142463 order by id desc limit 1 Qualite : 0.18838141105926856 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20142464_01-02-2025_16_02_33.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142464 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20142464 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142465 order by id desc limit 1 Qualite : 0.22140410901851382 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20142466_01-02-2025_15_47_57.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142466 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20142466 AND mptpi.`type`=4230 To do Qualite : 0.24002910245386597 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20142467_01-02-2025_15_40_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142467 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20142467 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142783 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142784 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142785 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142786 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142787 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142788 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142789 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142790 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142791 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142792 order by id desc limit 1 Qualite : 0.3079498429232401 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20142793_01-02-2025_16_32_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142793 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20142793 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142794 order by id desc limit 1 Qualite : 0.19429584143844753 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20142795_01-02-2025_16_12_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20142795 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20142795 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143051 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143052 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143053 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143054 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143055 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143056 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143057 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143058 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143059 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143060 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143061 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143062 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143063 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143064 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143065 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143066 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143067 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143068 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143069 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143070 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143071 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143072 order by id desc limit 1 Qualite : 0.2019070967415384 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143073_01-02-2025_17_06_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143073 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143073 AND mptpi.`type`=4230 To do Qualite : 0.22595934725209532 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143074_01-02-2025_16_46_55.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143074 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143074 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143392 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143393 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143394 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143395 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143396 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143397 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143398 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143399 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143400 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143401 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143402 order by id desc limit 1 Qualite : 0.23912616429849357 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143403_01-02-2025_17_33_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143403 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143403 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143404 order by id desc limit 1 Qualite : 0.2207605871752271 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143405_01-02-2025_17_10_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143405 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143405 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143406 order by id desc limit 1 Qualite : 0.2229691740437331 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143407_01-02-2025_17_18_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143407 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143407 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143697 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143698 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143699 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143700 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143701 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143702 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143703 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143704 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143705 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143706 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143707 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143708 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143709 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143710 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143711 order by id desc limit 1 Qualite : 0.19745974180902578 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143712_01-02-2025_17_47_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143712 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143712 AND mptpi.`type`=4230 To do Qualite : 0.20609688696404269 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143713_01-02-2025_18_07_00.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143713 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143713 AND mptpi.`type`=4230 To do Qualite : 0.19161308851166237 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143823_01-02-2025_18_35_34.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143823 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143823 AND mptpi.`type`=4230 To do Qualite : 0.2021491591470001 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143824_01-02-2025_18_22_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143824 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143824 AND mptpi.`type`=4230 To do Qualite : 0.18827936840275175 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143825_01-02-2025_18_16_56.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143825 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143825 AND mptpi.`type`=4230 To do Qualite : 0.18073680563575475 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20143827_01-02-2025_18_11_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143827 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20143827 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143998 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20143999 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20144000 order by id desc limit 1 Qualite : 0.27197285969087953 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20144001_01-02-2025_19_04_26.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20144001 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20144001 AND mptpi.`type`=4230 To do Qualite : 0.234989921319678 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20144002_01-02-2025_18_34_59.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20144002 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20144002 AND mptpi.`type`=4230 To do Qualite : 0.24472504887661223 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20144003_01-02-2025_18_48_35.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20144003 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20144003 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20144248 order by id desc limit 1 Qualite : 0.2637815041517808 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20144249_01-02-2025_20_23_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20144249 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20144249 AND mptpi.`type`=4230 To do Qualite : 0.24990893233711398 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20144250_01-02-2025_20_17_20.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20144250 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20144250 AND mptpi.`type`=4230 To do Qualite : 0.23174536092969744 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20144251_01-02-2025_20_09_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20144251 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20144251 AND mptpi.`type`=4230 To do Qualite : 0.24151962499125448 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20144252_01-02-2025_19_34_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20144252 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20144252 AND mptpi.`type`=4230 To do Qualite : 0.26733816956912815 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20144253_01-02-2025_19_47_12.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20144253 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20144253 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20144254 order by id desc limit 1 Qualite : 0.2766817181650381 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20144255_01-02-2025_19_17_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20144255 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20144255 AND mptpi.`type`=4230 To do Qualite : 0.2669048612297551 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20144256_01-02-2025_19_11_01.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20144256 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20144256 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'01022025': {'nb_upload': 3, 'nb_taggue_class': 3, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1333763100, 1333763021, 1333762991] Looping around the photos to save general results len do output : 1 /20144249Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2537948') ('4234', '20144249', '1333763100', None, None, None, None, None, '2537948') ('4234', None, None, None, None, None, None, None, '2537948') ('4234', '20144249', '1333763021', None, None, None, None, None, '2537948') ('4234', None, None, None, None, None, None, None, '2537948') ('4234', '20144249', '1333762991', None, None, None, None, None, '2537948') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.013638496398925781 save_final save missing photos in datou_result : time spend for datou_step_exec : 115.09402990341187 time spend to save output : 0.013910055160522461 total time spend for step 11 : 115.10793995857239 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 3 set_done_treatment 47.94user 31.12system 5:20.82elapsed 24%CPU (0avgtext+0avgdata 2903324maxresident)k 779280inputs+19368outputs (1332major+3023585minor)pagefaults 0swaps