python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 4093161 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2648740'] with mtr_portfolio_ids : ['21146286'] and first list_photo_ids : [] new path : /proc/4093161/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFBFBFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 3 ; length of list_pids : 3 ; length of list_args : 3 time to download the photos : 0.36592793464660645 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Fri Mar 7 18:20:29 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5941 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-03-07 18:20:32.969504: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-03-07 18:20:32.995095: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-03-07 18:20:32.997223: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7f5234000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-03-07 18:20:32.997258: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-03-07 18:20:33.001637: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-03-07 18:20:33.268610: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x1380c740 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-03-07 18:20:33.268694: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-03-07 18:20:33.270243: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-07 18:20:33.270837: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-07 18:20:33.275686: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-07 18:20:33.279439: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-07 18:20:33.281093: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-07 18:20:33.286795: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-07 18:20:33.288415: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-07 18:20:33.298005: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-07 18:20:33.299832: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-07 18:20:33.299928: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-07 18:20:33.300623: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-07 18:20:33.300639: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-07 18:20:33.300649: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-07 18:20:33.301825: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5442 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-03-07 18:20:33.630573: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-07 18:20:33.630676: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-07 18:20:33.630702: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-07 18:20:33.630725: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-07 18:20:33.630750: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-07 18:20:33.630774: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-07 18:20:33.630796: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-07 18:20:33.630818: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-07 18:20:33.632126: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-07 18:20:33.633547: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-03-07 18:20:33.633624: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-03-07 18:20:33.633648: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-07 18:20:33.633668: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-03-07 18:20:33.633688: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-03-07 18:20:33.633708: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-03-07 18:20:33.633726: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-03-07 18:20:33.633746: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-03-07 18:20:33.635125: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-03-07 18:20:33.635164: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-03-07 18:20:33.635175: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-03-07 18:20:33.635185: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-03-07 18:20:33.636639: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 5442 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-03-07 18:20:42.417882: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-03-07 18:20:42.615571: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 3 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.42266 max: 145.44375 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 0.00010943412780761719 nb_pixel_total : 459 time to create 1 rle with old method : 0.000989675521850586 length of segment : 37 time for calcul the mask position with numpy : 7.653236389160156e-05 nb_pixel_total : 16 time to create 1 rle with old method : 0.0001518726348876953 length of segment : 10 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 16 time to create 1 rle with old method : 4.410743713378906e-05 length of segment : 16 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 682 time to create 1 rle with old method : 0.012241125106811523 length of segment : 48 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 777 time to create 1 rle with old method : 0.0012578964233398438 length of segment : 47 time for calcul the mask position with numpy : 9.72747802734375e-05 nb_pixel_total : 493 time to create 1 rle with old method : 0.0009081363677978516 length of segment : 47 time for calcul the mask position with numpy : 0.0001010894775390625 nb_pixel_total : 65 time to create 1 rle with old method : 0.00019812583923339844 length of segment : 18 time for calcul the mask position with numpy : 9.72747802734375e-05 nb_pixel_total : 53 time to create 1 rle with old method : 0.00018167495727539062 length of segment : 19 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 237 time to create 1 rle with old method : 0.0005474090576171875 length of segment : 31 time for calcul the mask position with numpy : 7.748603820800781e-05 nb_pixel_total : 548 time to create 1 rle with old method : 0.0012888908386230469 length of segment : 62 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.13359 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 147 time to create 1 rle with old method : 0.00035119056701660156 length of segment : 23 Processing 1 images image shape: (400, 400, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -88.86406 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.00011181831359863281 nb_pixel_total : 1304 time to create 1 rle with old method : 0.002229928970336914 length of segment : 34 time for calcul the mask position with numpy : 7.534027099609375e-05 nb_pixel_total : 1884 time to create 1 rle with old method : 0.003049135208129883 length of segment : 27 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.61797 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 424 time to create 1 rle with old method : 0.0005807876586914062 length of segment : 23 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 540 time to create 1 rle with old method : 0.0007684230804443359 length of segment : 37 time for calcul the mask position with numpy : 0.00020647048950195312 nb_pixel_total : 8311 time to create 1 rle with old method : 0.01014256477355957 length of segment : 129 time for calcul the mask position with numpy : 0.00011706352233886719 nb_pixel_total : 541 time to create 1 rle with old method : 0.001079559326171875 length of segment : 25 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 874 time to create 1 rle with old method : 0.001617431640625 length of segment : 74 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 588 time to create 1 rle with old method : 0.001188039779663086 length of segment : 27 time for calcul the mask position with numpy : 0.00022268295288085938 nb_pixel_total : 11336 time to create 1 rle with old method : 0.019617319107055664 length of segment : 97 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 141.41641 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 533 time to create 1 rle with old method : 0.0009860992431640625 length of segment : 17 time for calcul the mask position with numpy : 0.00010633468627929688 nb_pixel_total : 1402 time to create 1 rle with old method : 0.0031890869140625 length of segment : 89 time for calcul the mask position with numpy : 9.584426879882812e-05 nb_pixel_total : 563 time to create 1 rle with old method : 0.0011074542999267578 length of segment : 36 Processing 1 images image shape: (400, 400, 3) min: 20.00000 max: 193.00000 molded_images shape: (1, 640, 640, 3) min: -96.58281 max: 69.53359 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -91.46172 max: 147.16250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 1142 time to create 1 rle with old method : 0.002170085906982422 length of segment : 33 time for calcul the mask position with numpy : 0.0002193450927734375 nb_pixel_total : 8125 time to create 1 rle with old method : 0.013809919357299805 length of segment : 141 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 185 time to create 1 rle with old method : 0.00028061866760253906 length of segment : 16 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 656 time to create 1 rle with old method : 0.0009338855743408203 length of segment : 32 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 321 time to create 1 rle with old method : 0.0005104541778564453 length of segment : 18 Processing 1 images image shape: (400, 400, 3) min: 27.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -94.36406 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 7.700920104980469e-05 nb_pixel_total : 203 time to create 1 rle with old method : 0.00037384033203125 length of segment : 27 time for calcul the mask position with numpy : 0.00012922286987304688 nb_pixel_total : 5765 time to create 1 rle with old method : 0.007263898849487305 length of segment : 109 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 320 time to create 1 rle with old method : 0.0006146430969238281 length of segment : 9 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 313 time to create 1 rle with old method : 0.0005023479461669922 length of segment : 16 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 303 time to create 1 rle with old method : 0.0004436969757080078 length of segment : 23 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 598 time to create 1 rle with old method : 0.0008826255798339844 length of segment : 24 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 333 time to create 1 rle with old method : 0.0005025863647460938 length of segment : 31 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 1077 time to create 1 rle with old method : 0.0016598701477050781 length of segment : 64 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 121 time to create 1 rle with old method : 0.00021719932556152344 length of segment : 10 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 113 time to create 1 rle with old method : 0.00024080276489257812 length of segment : 15 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.00037288665771484375 length of segment : 25 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 915 time to create 1 rle with old method : 0.0012576580047607422 length of segment : 38 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 391 time to create 1 rle with old method : 0.0006108283996582031 length of segment : 60 time for calcul the mask position with numpy : 0.00016045570373535156 nb_pixel_total : 5942 time to create 1 rle with old method : 0.00768733024597168 length of segment : 107 time for calcul the mask position with numpy : 0.0006024837493896484 nb_pixel_total : 6550 time to create 1 rle with old method : 0.008502960205078125 length of segment : 309 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.35625 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 9.679794311523438e-05 nb_pixel_total : 2077 time to create 1 rle with old method : 0.0026230812072753906 length of segment : 131 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 287 time to create 1 rle with old method : 0.0004096031188964844 length of segment : 31 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 111 time to create 1 rle with old method : 0.0002613067626953125 length of segment : 12 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 1144 time to create 1 rle with old method : 0.0014960765838623047 length of segment : 39 time for calcul the mask position with numpy : 0.00014734268188476562 nb_pixel_total : 3331 time to create 1 rle with old method : 0.0042438507080078125 length of segment : 105 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 739 time to create 1 rle with old method : 0.0010912418365478516 length of segment : 63 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 252.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 130.40859 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 660 time to create 1 rle with old method : 0.0008897781372070312 length of segment : 43 time for calcul the mask position with numpy : 6.818771362304688e-05 nb_pixel_total : 590 time to create 1 rle with old method : 0.0007946491241455078 length of segment : 68 time for calcul the mask position with numpy : 7.05718994140625e-05 nb_pixel_total : 1720 time to create 1 rle with old method : 0.0021085739135742188 length of segment : 82 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 1164 time to create 1 rle with old method : 0.0015823841094970703 length of segment : 109 time for calcul the mask position with numpy : 0.00019121170043945312 nb_pixel_total : 4438 time to create 1 rle with old method : 0.005380153656005859 length of segment : 200 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 909 time to create 1 rle with old method : 0.0011496543884277344 length of segment : 92 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 638 time to create 1 rle with old method : 0.0007913112640380859 length of segment : 42 time for calcul the mask position with numpy : 0.00021147727966308594 nb_pixel_total : 5125 time to create 1 rle with old method : 0.006193399429321289 length of segment : 222 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 612 time to create 1 rle with old method : 0.0007679462432861328 length of segment : 43 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 1730 time to create 1 rle with old method : 0.0021097660064697266 length of segment : 85 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 630 time to create 1 rle with old method : 0.000823974609375 length of segment : 40 time for calcul the mask position with numpy : 0.00022482872009277344 nb_pixel_total : 5111 time to create 1 rle with old method : 0.006175518035888672 length of segment : 221 Processing 1 images image shape: (280, 400, 3) min: 16.00000 max: 190.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 71.88125 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.001178741455078125 nb_pixel_total : 104426 time to create 1 rle with old method : 0.11662769317626953 length of segment : 282 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.71328 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 7.605552673339844e-05 nb_pixel_total : 347 time to create 1 rle with old method : 0.0007233619689941406 length of segment : 24 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 398 time to create 1 rle with old method : 0.0008218288421630859 length of segment : 28 time for calcul the mask position with numpy : 0.0001220703125 nb_pixel_total : 4314 time to create 1 rle with old method : 0.007708072662353516 length of segment : 64 time for calcul the mask position with numpy : 8.726119995117188e-05 nb_pixel_total : 845 time to create 1 rle with old method : 0.0016798973083496094 length of segment : 26 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 630 time to create 1 rle with old method : 0.0011928081512451172 length of segment : 30 time for calcul the mask position with numpy : 0.00018525123596191406 nb_pixel_total : 5782 time to create 1 rle with old method : 0.010096311569213867 length of segment : 176 time for calcul the mask position with numpy : 0.00018858909606933594 nb_pixel_total : 5884 time to create 1 rle with old method : 0.007250070571899414 length of segment : 192 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 324 time to create 1 rle with old method : 0.0004911422729492188 length of segment : 24 time for calcul the mask position with numpy : 9.679794311523438e-05 nb_pixel_total : 3972 time to create 1 rle with old method : 0.005061626434326172 length of segment : 110 time for calcul the mask position with numpy : 0.00019288063049316406 nb_pixel_total : 5361 time to create 1 rle with old method : 0.0071294307708740234 length of segment : 127 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 1064 time to create 1 rle with old method : 0.0013971328735351562 length of segment : 57 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 250 time to create 1 rle with old method : 0.0003712177276611328 length of segment : 27 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 704 time to create 1 rle with old method : 0.0009577274322509766 length of segment : 37 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 1268 time to create 1 rle with old method : 0.0016775131225585938 length of segment : 38 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 1424 time to create 1 rle with old method : 0.0018665790557861328 length of segment : 39 Processing 1 images image shape: (280, 400, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.07266 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 24 time for calcul the mask position with numpy : 8.916854858398438e-05 nb_pixel_total : 122 time to create 1 rle with old method : 0.0002875328063964844 length of segment : 13 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 479 time to create 1 rle with old method : 0.0008931159973144531 length of segment : 33 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 620 time to create 1 rle with old method : 0.0011746883392333984 length of segment : 50 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 212 time to create 1 rle with old method : 0.00047779083251953125 length of segment : 21 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 91 time to create 1 rle with old method : 0.0002105236053466797 length of segment : 16 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 485 time to create 1 rle with old method : 0.0009367465972900391 length of segment : 29 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 491 time to create 1 rle with old method : 0.0007035732269287109 length of segment : 25 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003306865692138672 length of segment : 30 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.00042819976806640625 length of segment : 20 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 287 time to create 1 rle with old method : 0.0004477500915527344 length of segment : 20 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 132 time to create 1 rle with old method : 0.0002269744873046875 length of segment : 12 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 725 time to create 1 rle with old method : 0.001085042953491211 length of segment : 27 time for calcul the mask position with numpy : 5.626678466796875e-05 nb_pixel_total : 1068 time to create 1 rle with old method : 0.0014693737030029297 length of segment : 39 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 279 time to create 1 rle with old method : 0.00043082237243652344 length of segment : 23 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 638 time to create 1 rle with old method : 0.0008804798126220703 length of segment : 36 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 267 time to create 1 rle with old method : 0.0004096031188964844 length of segment : 20 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 490 time to create 1 rle with old method : 0.0006935596466064453 length of segment : 35 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 228 time to create 1 rle with old method : 0.000339508056640625 length of segment : 19 time for calcul the mask position with numpy : 0.00010752677917480469 nb_pixel_total : 2550 time to create 1 rle with old method : 0.003294229507446289 length of segment : 70 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 572 time to create 1 rle with old method : 0.0007874965667724609 length of segment : 33 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 597 time to create 1 rle with old method : 0.0009067058563232422 length of segment : 25 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 1334 time to create 1 rle with old method : 0.0017786026000976562 length of segment : 80 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 123 time to create 1 rle with old method : 0.0001952648162841797 length of segment : 14 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 536 time to create 1 rle with old method : 0.0007798671722412109 length of segment : 30 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 146.55703 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 462 time to create 1 rle with old method : 0.0006797313690185547 length of segment : 27 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 154 time to create 1 rle with old method : 0.0002932548522949219 length of segment : 11 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.0002357959747314453 length of segment : 15 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 723 time to create 1 rle with old method : 0.001100301742553711 length of segment : 73 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 483 time to create 1 rle with old method : 0.0006756782531738281 length of segment : 28 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 435 time to create 1 rle with old method : 0.0006194114685058594 length of segment : 29 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 135.72500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 560 time to create 1 rle with old method : 0.0007801055908203125 length of segment : 24 time for calcul the mask position with numpy : 7.414817810058594e-05 nb_pixel_total : 865 time to create 1 rle with old method : 0.0012462139129638672 length of segment : 68 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 554 time to create 1 rle with old method : 0.0008256435394287109 length of segment : 25 time for calcul the mask position with numpy : 8.058547973632812e-05 nb_pixel_total : 1476 time to create 1 rle with old method : 0.0018851757049560547 length of segment : 131 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.60625 max: 145.99844 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 479 time to create 1 rle with old method : 0.0006771087646484375 length of segment : 30 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 624 time to create 1 rle with old method : 0.0008907318115234375 length of segment : 50 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 594 time to create 1 rle with old method : 0.0008544921875 length of segment : 66 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 1022 time to create 1 rle with old method : 0.0014417171478271484 length of segment : 80 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 19 time to create 1 rle with old method : 8.082389831542969e-05 length of segment : 10 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 765 time to create 1 rle with old method : 0.0010247230529785156 length of segment : 50 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 405 time to create 1 rle with old method : 0.0005218982696533203 length of segment : 25 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 677 time to create 1 rle with old method : 0.0009377002716064453 length of segment : 61 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -114.58281 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 8.153915405273438e-05 nb_pixel_total : 3138 time to create 1 rle with old method : 0.003721475601196289 length of segment : 51 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 816 time to create 1 rle with old method : 0.0010440349578857422 length of segment : 36 time for calcul the mask position with numpy : 7.343292236328125e-05 nb_pixel_total : 3180 time to create 1 rle with old method : 0.003958702087402344 length of segment : 49 time for calcul the mask position with numpy : 8.96453857421875e-05 nb_pixel_total : 3828 time to create 1 rle with old method : 0.004973173141479492 length of segment : 54 Processing 1 images image shape: (400, 400, 3) min: 37.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -81.03203 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 760 time to create 1 rle with old method : 0.0009882450103759766 length of segment : 26 time for calcul the mask position with numpy : 8.344650268554688e-05 nb_pixel_total : 1204 time to create 1 rle with old method : 0.0020236968994140625 length of segment : 49 time for calcul the mask position with numpy : 8.153915405273438e-05 nb_pixel_total : 1580 time to create 1 rle with old method : 0.0023009777069091797 length of segment : 62 time for calcul the mask position with numpy : 9.679794311523438e-05 nb_pixel_total : 3199 time to create 1 rle with old method : 0.004691123962402344 length of segment : 67 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.41484 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 5.030632019042969e-05 nb_pixel_total : 474 time to create 1 rle with old method : 0.0006587505340576172 length of segment : 26 time for calcul the mask position with numpy : 5.9604644775390625e-05 nb_pixel_total : 2224 time to create 1 rle with old method : 0.0029723644256591797 length of segment : 30 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 533 time to create 1 rle with old method : 0.0007388591766357422 length of segment : 26 time for calcul the mask position with numpy : 0.00011491775512695312 nb_pixel_total : 4404 time to create 1 rle with old method : 0.006734609603881836 length of segment : 118 time for calcul the mask position with numpy : 0.00015616416931152344 nb_pixel_total : 4800 time to create 1 rle with old method : 0.005440473556518555 length of segment : 154 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.00041174888610839844 length of segment : 24 time for calcul the mask position with numpy : 0.00014257431030273438 nb_pixel_total : 5210 time to create 1 rle with old method : 0.006822824478149414 length of segment : 111 time for calcul the mask position with numpy : 0.00012993812561035156 nb_pixel_total : 6477 time to create 1 rle with old method : 0.0076901912689208984 length of segment : 128 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.91250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 554 time to create 1 rle with old method : 0.0008411407470703125 length of segment : 17 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 460 time to create 1 rle with old method : 0.0006906986236572266 length of segment : 22 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 800 time to create 1 rle with old method : 0.0010821819305419922 length of segment : 51 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 122 time to create 1 rle with old method : 0.000213623046875 length of segment : 13 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 1737 time to create 1 rle with old method : 0.002237558364868164 length of segment : 88 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 917 time to create 1 rle with old method : 0.0011441707611083984 length of segment : 106 time for calcul the mask position with numpy : 0.0006949901580810547 nb_pixel_total : 48737 time to create 1 rle with old method : 0.0800478458404541 length of segment : 338 Processing 1 images image shape: (400, 400, 3) min: 15.00000 max: 193.00000 molded_images shape: (1, 640, 640, 3) min: -94.14531 max: 69.05312 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 1.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -97.37969 max: 146.10781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 1152 time to create 1 rle with old method : 0.0015540122985839844 length of segment : 29 time for calcul the mask position with numpy : 0.00023794174194335938 nb_pixel_total : 11401 time to create 1 rle with old method : 0.013161182403564453 length of segment : 139 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 206 time to create 1 rle with old method : 0.00033283233642578125 length of segment : 17 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 1103 time to create 1 rle with old method : 0.0016057491302490234 length of segment : 38 Processing 1 images image shape: (400, 400, 3) min: 30.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -84.97734 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 7.033348083496094e-05 nb_pixel_total : 425 time to create 1 rle with old method : 0.0005538463592529297 length of segment : 46 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 163 time to create 1 rle with old method : 0.0002598762512207031 length of segment : 20 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 124 time to create 1 rle with old method : 0.00026106834411621094 length of segment : 16 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 388 time to create 1 rle with old method : 0.0005893707275390625 length of segment : 19 time for calcul the mask position with numpy : 0.00022172927856445312 nb_pixel_total : 5584 time to create 1 rle with old method : 0.007277727127075195 length of segment : 109 time for calcul the mask position with numpy : 7.772445678710938e-05 nb_pixel_total : 834 time to create 1 rle with old method : 0.0011572837829589844 length of segment : 60 time for calcul the mask position with numpy : 0.00015020370483398438 nb_pixel_total : 4477 time to create 1 rle with old method : 0.00580286979675293 length of segment : 119 time for calcul the mask position with numpy : 0.0001347064971923828 nb_pixel_total : 3757 time to create 1 rle with old method : 0.0048406124114990234 length of segment : 86 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.98125 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 0.00018835067749023438 nb_pixel_total : 556 time to create 1 rle with old method : 0.0011806488037109375 length of segment : 29 time for calcul the mask position with numpy : 0.00017189979553222656 nb_pixel_total : 2070 time to create 1 rle with old method : 0.003699064254760742 length of segment : 129 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 1146 time to create 1 rle with old method : 0.0015099048614501953 length of segment : 39 time for calcul the mask position with numpy : 0.00023221969604492188 nb_pixel_total : 9042 time to create 1 rle with old method : 0.011297464370727539 length of segment : 126 time for calcul the mask position with numpy : 9.608268737792969e-05 nb_pixel_total : 1085 time to create 1 rle with old method : 0.0015263557434082031 length of segment : 53 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 136.39297 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 0.0001068115234375 nb_pixel_total : 2080 time to create 1 rle with old method : 0.0026361942291259766 length of segment : 157 time for calcul the mask position with numpy : 0.00015020370483398438 nb_pixel_total : 2641 time to create 1 rle with old method : 0.004628419876098633 length of segment : 149 time for calcul the mask position with numpy : 8.440017700195312e-05 nb_pixel_total : 643 time to create 1 rle with old method : 0.00118255615234375 length of segment : 43 time for calcul the mask position with numpy : 6.508827209472656e-05 nb_pixel_total : 612 time to create 1 rle with old method : 0.0011637210845947266 length of segment : 38 time for calcul the mask position with numpy : 5.936622619628906e-05 nb_pixel_total : 326 time to create 1 rle with old method : 0.0006635189056396484 length of segment : 29 time for calcul the mask position with numpy : 0.00010347366333007812 nb_pixel_total : 548 time to create 1 rle with old method : 0.0010957717895507812 length of segment : 71 time for calcul the mask position with numpy : 0.00030541419982910156 nb_pixel_total : 4150 time to create 1 rle with old method : 0.007401466369628906 length of segment : 201 time for calcul the mask position with numpy : 0.0001285076141357422 nb_pixel_total : 1747 time to create 1 rle with old method : 0.0022950172424316406 length of segment : 83 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 701 time to create 1 rle with old method : 0.0009868144989013672 length of segment : 44 time for calcul the mask position with numpy : 7.534027099609375e-05 nb_pixel_total : 1272 time to create 1 rle with old method : 0.0017933845520019531 length of segment : 49 time for calcul the mask position with numpy : 9.560585021972656e-05 nb_pixel_total : 1384 time to create 1 rle with old method : 0.0018763542175292969 length of segment : 66 Processing 1 images image shape: (280, 400, 3) min: 12.00000 max: 192.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 71.93984 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 0.0014386177062988281 nb_pixel_total : 104791 time to create 1 rle with old method : 0.1524796485900879 length of segment : 284 time for calcul the mask position with numpy : 0.00012612342834472656 nb_pixel_total : 694 time to create 1 rle with old method : 0.00141143798828125 length of segment : 77 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.60781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 12 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 321 time to create 1 rle with old method : 0.0004482269287109375 length of segment : 22 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 362 time to create 1 rle with old method : 0.0005371570587158203 length of segment : 30 time for calcul the mask position with numpy : 0.00014328956604003906 nb_pixel_total : 6849 time to create 1 rle with old method : 0.00850367546081543 length of segment : 160 time for calcul the mask position with numpy : 9.131431579589844e-05 nb_pixel_total : 4010 time to create 1 rle with old method : 0.004897356033325195 length of segment : 60 time for calcul the mask position with numpy : 0.00011491775512695312 nb_pixel_total : 5011 time to create 1 rle with old method : 0.0061092376708984375 length of segment : 84 time for calcul the mask position with numpy : 0.000125885009765625 nb_pixel_total : 4852 time to create 1 rle with old method : 0.006225109100341797 length of segment : 116 time for calcul the mask position with numpy : 5.650520324707031e-05 nb_pixel_total : 1178 time to create 1 rle with old method : 0.0014226436614990234 length of segment : 50 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 73 time to create 1 rle with old method : 0.000247955322265625 length of segment : 13 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 986 time to create 1 rle with old method : 0.001322031021118164 length of segment : 29 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 486 time to create 1 rle with old method : 0.0007023811340332031 length of segment : 27 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 1270 time to create 1 rle with old method : 0.0016872882843017578 length of segment : 39 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 1114 time to create 1 rle with old method : 0.0015578269958496094 length of segment : 66 Processing 1 images image shape: (280, 400, 3) min: 11.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.88516 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 30 time for calcul the mask position with numpy : 7.557868957519531e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.00023746490478515625 length of segment : 14 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 451 time to create 1 rle with old method : 0.0006089210510253906 length of segment : 34 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 103 time to create 1 rle with old method : 0.0001766681671142578 length of segment : 15 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 283 time to create 1 rle with old method : 0.00041794776916503906 length of segment : 19 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.0003399848937988281 length of segment : 21 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 287 time to create 1 rle with old method : 0.0003943443298339844 length of segment : 25 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 567 time to create 1 rle with old method : 0.0007367134094238281 length of segment : 29 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.00033974647521972656 length of segment : 31 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.00035119056701660156 length of segment : 22 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 1047 time to create 1 rle with old method : 0.0012612342834472656 length of segment : 37 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 760 time to create 1 rle with old method : 0.0009677410125732422 length of segment : 45 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 505 time to create 1 rle with old method : 0.0006494522094726562 length of segment : 33 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 175 time to create 1 rle with old method : 0.00029158592224121094 length of segment : 15 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 879 time to create 1 rle with old method : 0.001112222671508789 length of segment : 43 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 503 time to create 1 rle with old method : 0.0006392002105712891 length of segment : 22 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 379 time to create 1 rle with old method : 0.0005004405975341797 length of segment : 23 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 555 time to create 1 rle with old method : 0.0007519721984863281 length of segment : 32 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 496 time to create 1 rle with old method : 0.0007710456848144531 length of segment : 24 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 196 time to create 1 rle with old method : 0.00027942657470703125 length of segment : 19 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 117 time to create 1 rle with old method : 0.00022840499877929688 length of segment : 16 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 461 time to create 1 rle with old method : 0.0006811618804931641 length of segment : 33 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 240 time to create 1 rle with old method : 0.0003609657287597656 length of segment : 15 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 456 time to create 1 rle with old method : 0.0005655288696289062 length of segment : 38 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 648 time to create 1 rle with old method : 0.0009469985961914062 length of segment : 24 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 371 time to create 1 rle with old method : 0.0005207061767578125 length of segment : 22 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 173 time to create 1 rle with old method : 0.00024628639221191406 length of segment : 21 time for calcul the mask position with numpy : 2.8848648071289062e-05 nb_pixel_total : 117 time to create 1 rle with old method : 0.00017881393432617188 length of segment : 13 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 350 time to create 1 rle with old method : 0.0005085468292236328 length of segment : 25 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 378 time to create 1 rle with old method : 0.0005519390106201172 length of segment : 25 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 193 time to create 1 rle with old method : 0.0002913475036621094 length of segment : 17 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.91250 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 490 time to create 1 rle with old method : 0.0006892681121826172 length of segment : 27 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 977 time to create 1 rle with old method : 0.0013957023620605469 length of segment : 94 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.00029540061950683594 length of segment : 11 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.0002219676971435547 length of segment : 14 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 487 time to create 1 rle with old method : 0.0006172657012939453 length of segment : 26 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 359 time to create 1 rle with old method : 0.0005018711090087891 length of segment : 31 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 439 time to create 1 rle with old method : 0.0005934238433837891 length of segment : 26 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 133.28750 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 568 time to create 1 rle with old method : 0.0008306503295898438 length of segment : 25 time for calcul the mask position with numpy : 6.103515625e-05 nb_pixel_total : 117 time to create 1 rle with old method : 0.0002162456512451172 length of segment : 36 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 562 time to create 1 rle with old method : 0.0008237361907958984 length of segment : 25 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.58672 max: 145.26406 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 413 time to create 1 rle with old method : 0.0005788803100585938 length of segment : 36 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 551 time to create 1 rle with old method : 0.0008566379547119141 length of segment : 63 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 610 time to create 1 rle with old method : 0.0009026527404785156 length of segment : 51 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 674 time to create 1 rle with old method : 0.0009362697601318359 length of segment : 47 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 100 time to create 1 rle with old method : 0.0002148151397705078 length of segment : 33 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 564 time to create 1 rle with old method : 0.0008287429809570312 length of segment : 58 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.48516 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 389 time to create 1 rle with old method : 0.0004754066467285156 length of segment : 44 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 2501 time to create 1 rle with old method : 0.003213167190551758 length of segment : 47 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 916 time to create 1 rle with old method : 0.001168966293334961 length of segment : 43 time for calcul the mask position with numpy : 7.224082946777344e-05 nb_pixel_total : 2798 time to create 1 rle with old method : 0.0036368370056152344 length of segment : 94 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 10 time to create 1 rle with old method : 5.745887756347656e-05 length of segment : 7 time for calcul the mask position with numpy : 2.7894973754882812e-05 nb_pixel_total : 58 time to create 1 rle with old method : 0.00011968612670898438 length of segment : 8 Processing 1 images image shape: (400, 400, 3) min: 24.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -84.03984 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 3 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 508 time to create 1 rle with old method : 0.0006661415100097656 length of segment : 21 time for calcul the mask position with numpy : 0.0001914501190185547 nb_pixel_total : 7333 time to create 1 rle with old method : 0.008486509323120117 length of segment : 118 time for calcul the mask position with numpy : 0.00029206275939941406 nb_pixel_total : 15417 time to create 1 rle with old method : 0.017578125 length of segment : 198 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.43047 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 441 time to create 1 rle with old method : 0.0007164478302001953 length of segment : 25 time for calcul the mask position with numpy : 0.0001316070556640625 nb_pixel_total : 7235 time to create 1 rle with old method : 0.008711576461791992 length of segment : 121 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.000385284423828125 length of segment : 24 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 482 time to create 1 rle with old method : 0.0006632804870605469 length of segment : 26 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 169 time to create 1 rle with old method : 0.00026869773864746094 length of segment : 20 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 163 time to create 1 rle with old method : 0.0002722740173339844 length of segment : 20 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 729 time to create 1 rle with old method : 0.0009541511535644531 length of segment : 33 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 518 time to create 1 rle with old method : 0.0007429122924804688 length of segment : 26 time for calcul the mask position with numpy : 0.00012946128845214844 nb_pixel_total : 5802 time to create 1 rle with old method : 0.006994724273681641 length of segment : 147 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 141.68594 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 5.91278076171875e-05 nb_pixel_total : 515 time to create 1 rle with old method : 0.0010821819305419922 length of segment : 16 time for calcul the mask position with numpy : 6.29425048828125e-05 nb_pixel_total : 1457 time to create 1 rle with old method : 0.0025284290313720703 length of segment : 82 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 495 time to create 1 rle with old method : 0.0009548664093017578 length of segment : 29 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 533 time to create 1 rle with old method : 0.0010273456573486328 length of segment : 29 time for calcul the mask position with numpy : 6.270408630371094e-05 nb_pixel_total : 869 time to create 1 rle with old method : 0.0015828609466552734 length of segment : 86 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 692 time to create 1 rle with old method : 0.0013031959533691406 length of segment : 48 Processing 1 images image shape: (400, 400, 3) min: 17.00000 max: 193.00000 molded_images shape: (1, 640, 640, 3) min: -96.32891 max: 67.76016 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -93.30156 max: 146.84609 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 1189 time to create 1 rle with old method : 0.0015673637390136719 length of segment : 32 time for calcul the mask position with numpy : 0.000156402587890625 nb_pixel_total : 9802 time to create 1 rle with old method : 0.012544393539428711 length of segment : 143 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 187 time to create 1 rle with old method : 0.0002818107604980469 length of segment : 18 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 363 time to create 1 rle with old method : 0.0005769729614257812 length of segment : 18 time for calcul the mask position with numpy : 5.364418029785156e-05 nb_pixel_total : 1151 time to create 1 rle with old method : 0.0016722679138183594 length of segment : 39 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 657 time to create 1 rle with old method : 0.0009403228759765625 length of segment : 32 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 188 time to create 1 rle with old method : 0.0002853870391845703 length of segment : 16 Processing 1 images image shape: (400, 400, 3) min: 18.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -82.93047 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 169 time to create 1 rle with old method : 0.00027298927307128906 length of segment : 19 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 491 time to create 1 rle with old method : 0.0007321834564208984 length of segment : 69 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 351 time to create 1 rle with old method : 0.0004792213439941406 length of segment : 20 time for calcul the mask position with numpy : 0.0001506805419921875 nb_pixel_total : 4468 time to create 1 rle with old method : 0.0059680938720703125 length of segment : 105 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 266 time to create 1 rle with old method : 0.00038051605224609375 length of segment : 23 time for calcul the mask position with numpy : 8.130073547363281e-05 nb_pixel_total : 1877 time to create 1 rle with old method : 0.002659320831298828 length of segment : 99 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003380775451660156 length of segment : 40 time for calcul the mask position with numpy : 0.0001125335693359375 nb_pixel_total : 4035 time to create 1 rle with old method : 0.005368471145629883 length of segment : 105 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -109.77813 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 9.5367431640625e-05 nb_pixel_total : 2132 time to create 1 rle with old method : 0.0028285980224609375 length of segment : 129 time for calcul the mask position with numpy : 0.00016641616821289062 nb_pixel_total : 9796 time to create 1 rle with old method : 0.012467384338378906 length of segment : 133 time for calcul the mask position with numpy : 6.866455078125e-05 nb_pixel_total : 1052 time to create 1 rle with old method : 0.0017824172973632812 length of segment : 35 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 1202 time to create 1 rle with old method : 0.0015363693237304688 length of segment : 42 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 639 time to create 1 rle with old method : 0.0009436607360839844 length of segment : 47 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 1260 time to create 1 rle with old method : 0.0017094612121582031 length of segment : 45 Processing 1 images image shape: (400, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 136.02969 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 8.225440979003906e-05 nb_pixel_total : 2262 time to create 1 rle with old method : 0.0027709007263183594 length of segment : 156 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 502 time to create 1 rle with old method : 0.0005948543548583984 length of segment : 46 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 507 time to create 1 rle with old method : 0.0007729530334472656 length of segment : 63 time for calcul the mask position with numpy : 8.177757263183594e-05 nb_pixel_total : 2826 time to create 1 rle with old method : 0.0034241676330566406 length of segment : 133 time for calcul the mask position with numpy : 6.461143493652344e-05 nb_pixel_total : 555 time to create 1 rle with old method : 0.0007677078247070312 length of segment : 40 time for calcul the mask position with numpy : 0.00021409988403320312 nb_pixel_total : 3676 time to create 1 rle with old method : 0.004766702651977539 length of segment : 179 time for calcul the mask position with numpy : 7.82012939453125e-05 nb_pixel_total : 1566 time to create 1 rle with old method : 0.001924276351928711 length of segment : 73 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 527 time to create 1 rle with old method : 0.0007333755493164062 length of segment : 46 time for calcul the mask position with numpy : 0.00029087066650390625 nb_pixel_total : 4754 time to create 1 rle with old method : 0.005835294723510742 length of segment : 222 time for calcul the mask position with numpy : 0.00014352798461914062 nb_pixel_total : 4421 time to create 1 rle with old method : 0.005318403244018555 length of segment : 216 Processing 1 images image shape: (280, 400, 3) min: 11.00000 max: 194.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 74.22500 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.0009746551513671875 nb_pixel_total : 105511 time to create 1 rle with old method : 0.11437821388244629 length of segment : 281 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.33047 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 11 time for calcul the mask position with numpy : 0.00011110305786132812 nb_pixel_total : 4364 time to create 1 rle with old method : 0.005228519439697266 length of segment : 66 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 373 time to create 1 rle with old method : 0.0005393028259277344 length of segment : 28 time for calcul the mask position with numpy : 0.00019216537475585938 nb_pixel_total : 5285 time to create 1 rle with old method : 0.006793498992919922 length of segment : 255 time for calcul the mask position with numpy : 0.00010800361633300781 nb_pixel_total : 1038 time to create 1 rle with old method : 0.001478433609008789 length of segment : 34 time for calcul the mask position with numpy : 0.0001354217529296875 nb_pixel_total : 4186 time to create 1 rle with old method : 0.00537419319152832 length of segment : 116 time for calcul the mask position with numpy : 5.888938903808594e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.0003955364227294922 length of segment : 18 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 331 time to create 1 rle with old method : 0.00047087669372558594 length of segment : 29 time for calcul the mask position with numpy : 7.104873657226562e-05 nb_pixel_total : 1352 time to create 1 rle with old method : 0.0017964839935302734 length of segment : 91 time for calcul the mask position with numpy : 0.00014066696166992188 nb_pixel_total : 4897 time to create 1 rle with old method : 0.006360769271850586 length of segment : 81 time for calcul the mask position with numpy : 0.0001747608184814453 nb_pixel_total : 6030 time to create 1 rle with old method : 0.007193803787231445 length of segment : 216 time for calcul the mask position with numpy : 6.222724914550781e-05 nb_pixel_total : 823 time to create 1 rle with old method : 0.0010902881622314453 length of segment : 48 Processing 1 images image shape: (280, 400, 3) min: 17.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 150.78359 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 32 time for calcul the mask position with numpy : 7.677078247070312e-05 nb_pixel_total : 236 time to create 1 rle with old method : 0.00036072731018066406 length of segment : 29 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 218 time to create 1 rle with old method : 0.00034499168395996094 length of segment : 21 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 433 time to create 1 rle with old method : 0.0006887912750244141 length of segment : 24 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 222 time to create 1 rle with old method : 0.00035834312438964844 length of segment : 20 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 425 time to create 1 rle with old method : 0.000614166259765625 length of segment : 32 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 287 time to create 1 rle with old method : 0.0005323886871337891 length of segment : 23 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 157 time to create 1 rle with old method : 0.00024199485778808594 length of segment : 15 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 440 time to create 1 rle with old method : 0.0006425380706787109 length of segment : 22 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 101 time to create 1 rle with old method : 0.0001690387725830078 length of segment : 16 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 536 time to create 1 rle with old method : 0.0007622241973876953 length of segment : 34 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 130 time to create 1 rle with old method : 0.0002205371856689453 length of segment : 13 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 514 time to create 1 rle with old method : 0.0007758140563964844 length of segment : 36 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 593 time to create 1 rle with old method : 0.0009138584136962891 length of segment : 23 time for calcul the mask position with numpy : 4.0531158447265625e-05 nb_pixel_total : 415 time to create 1 rle with old method : 0.0005788803100585938 length of segment : 26 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 465 time to create 1 rle with old method : 0.0006570816040039062 length of segment : 31 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 573 time to create 1 rle with old method : 0.0007808208465576172 length of segment : 29 time for calcul the mask position with numpy : 5.1975250244140625e-05 nb_pixel_total : 504 time to create 1 rle with old method : 0.0006937980651855469 length of segment : 33 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 1759 time to create 1 rle with old method : 0.0023391246795654297 length of segment : 51 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 125 time to create 1 rle with old method : 0.00022149085998535156 length of segment : 17 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 270 time to create 1 rle with old method : 0.00040030479431152344 length of segment : 48 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 339 time to create 1 rle with old method : 0.0004436969757080078 length of segment : 35 time for calcul the mask position with numpy : 4.220008850097656e-05 nb_pixel_total : 514 time to create 1 rle with old method : 0.0007421970367431641 length of segment : 33 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 747 time to create 1 rle with old method : 0.0010004043579101562 length of segment : 42 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 495 time to create 1 rle with old method : 0.0006246566772460938 length of segment : 33 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 195 time to create 1 rle with old method : 0.0002799034118652344 length of segment : 16 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 232 time to create 1 rle with old method : 0.00033783912658691406 length of segment : 19 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 432 time to create 1 rle with old method : 0.0006203651428222656 length of segment : 23 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 1010 time to create 1 rle with old method : 0.0013337135314941406 length of segment : 35 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 125 time to create 1 rle with old method : 0.00021457672119140625 length of segment : 11 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 523 time to create 1 rle with old method : 0.0006844997406005859 length of segment : 38 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 396 time to create 1 rle with old method : 0.0005433559417724609 length of segment : 34 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 625 time to create 1 rle with old method : 0.0008606910705566406 length of segment : 35 Processing 1 images image shape: (280, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 145.17031 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 10 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 144 time to create 1 rle with old method : 0.0002651214599609375 length of segment : 10 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 568 time to create 1 rle with old method : 0.0007922649383544922 length of segment : 26 time for calcul the mask position with numpy : 5.412101745605469e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.0003097057342529297 length of segment : 15 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 363 time to create 1 rle with old method : 0.0007448196411132812 length of segment : 27 time for calcul the mask position with numpy : 9.107589721679688e-05 nb_pixel_total : 1113 time to create 1 rle with old method : 0.002193927764892578 length of segment : 97 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 454 time to create 1 rle with old method : 0.0008640289306640625 length of segment : 25 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 458 time to create 1 rle with old method : 0.0008807182312011719 length of segment : 26 time for calcul the mask position with numpy : 9.298324584960938e-05 nb_pixel_total : 1770 time to create 1 rle with old method : 0.0033349990844726562 length of segment : 112 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 146 time to create 1 rle with old method : 0.0003561973571777344 length of segment : 16 time for calcul the mask position with numpy : 7.987022399902344e-05 nb_pixel_total : 562 time to create 1 rle with old method : 0.001129150390625 length of segment : 59 Processing 1 images image shape: (280, 320, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 133.85000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 8.58306884765625e-05 nb_pixel_total : 549 time to create 1 rle with old method : 0.001268148422241211 length of segment : 25 time for calcul the mask position with numpy : 0.00013136863708496094 nb_pixel_total : 50 time to create 1 rle with old method : 0.00018644332885742188 length of segment : 25 Detection mask done ! Trying to reset tf kernel 4093574 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 109 tf kernel not reseted sub process len(results) : 341 len(list_Values) 341 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 341 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 5941 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 341 chid ids of type : 4228 Number RLEs to save : 18892 save missing photos in datou_result : time spend for datou_step_exec : 29.644733905792236 time spend to save output : 5.106422185897827 total time spend for step 1 : 34.75115609169006 step2:brightness Fri Mar 7 18:21:04 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness treat image : temp/1741368029_4093161_1341454721_baefe7a2409614f5c1e1ab399a3e18a3.jpg treat image : temp/1741368029_4093161_1341454718_03cfabd40ff7cd6b26d248431dcabfc8.jpg treat image : temp/1741368029_4093161_1341454707_7e6dd39f45accc36ed2ea059786993d9.jpg Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 3 time used for this insertion : 0.017817020416259766 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 3 time used for this insertion : 0.013217687606811523 save missing photos in datou_result : time spend for datou_step_exec : 0.764960765838623 time spend to save output : 0.044799089431762695 total time spend for step 2 : 0.8097598552703857 step3:blur_detection Fri Mar 7 18:21:05 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection methode: ratio et variance treat image : temp/1741368029_4093161_1341454721_baefe7a2409614f5c1e1ab399a3e18a3.jpg resize: (1080, 1920) 1341454721 -7.43839911067332 treat image : temp/1741368029_4093161_1341454718_03cfabd40ff7cd6b26d248431dcabfc8.jpg resize: (1080, 1920) 1341454718 -7.370720652631866 treat image : temp/1741368029_4093161_1341454707_7e6dd39f45accc36ed2ea059786993d9.jpg resize: (1080, 1920) 1341454707 -7.331337583153891 Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 3 time used for this insertion : 0.34563636779785156 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 3 time used for this insertion : 0.012056350708007812 save missing photos in datou_result : time spend for datou_step_exec : 3.649473190307617 time spend to save output : 0.3625648021697998 total time spend for step 3 : 4.012037992477417 step4:rle_unique_nms_with_priority Fri Mar 7 18:21:09 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 341 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 111 nb_hashtags : 7 time to prepare the origin masks : 1.0702104568481445 time for calcul the mask position with numpy : 0.06218695640563965 nb_pixel_total : 1861743 time to create 1 rle with new method : 0.23698663711547852 time for calcul the mask position with numpy : 0.008977890014648438 nb_pixel_total : 120 time to create 1 rle with old method : 0.00019979476928710938 time for calcul the mask position with numpy : 0.009000062942504883 nb_pixel_total : 343 time to create 1 rle with old method : 0.00044846534729003906 time for calcul the mask position with numpy : 0.0089569091796875 nb_pixel_total : 493 time to create 1 rle with old method : 0.0006184577941894531 time for calcul the mask position with numpy : 0.008968591690063477 nb_pixel_total : 459 time to create 1 rle with old method : 0.0006191730499267578 time for calcul the mask position with numpy : 0.008866548538208008 nb_pixel_total : 16 time to create 1 rle with old method : 4.2438507080078125e-05 time for calcul the mask position with numpy : 0.00880575180053711 nb_pixel_total : 682 time to create 1 rle with old method : 0.0009160041809082031 time for calcul the mask position with numpy : 0.008957386016845703 nb_pixel_total : 34 time to create 1 rle with old method : 6.556510925292969e-05 time for calcul the mask position with numpy : 0.008903980255126953 nb_pixel_total : 16 time to create 1 rle with old method : 3.0517578125e-05 time for calcul the mask position with numpy : 0.00889444351196289 nb_pixel_total : 45 time to create 1 rle with old method : 0.00012445449829101562 time for calcul the mask position with numpy : 0.008662700653076172 nb_pixel_total : 377 time to create 1 rle with old method : 0.0004730224609375 time for calcul the mask position with numpy : 0.00819087028503418 nb_pixel_total : 147 time to create 1 rle with old method : 0.0001780986785888672 time for calcul the mask position with numpy : 0.008082389831542969 nb_pixel_total : 1402 time to create 1 rle with old method : 0.001615285873413086 time for calcul the mask position with numpy : 0.008142471313476562 nb_pixel_total : 608 time to create 1 rle with old method : 0.0006504058837890625 time for calcul the mask position with numpy : 0.008309364318847656 nb_pixel_total : 1304 time to create 1 rle with old method : 0.0015625953674316406 time for calcul the mask position with numpy : 0.008355855941772461 nb_pixel_total : 424 time to create 1 rle with old method : 0.0006880760192871094 time for calcul the mask position with numpy : 0.008257389068603516 nb_pixel_total : 1884 time to create 1 rle with old method : 0.002042531967163086 time for calcul the mask position with numpy : 0.008233785629272461 nb_pixel_total : 57 time to create 1 rle with old method : 0.00010347366333007812 time for calcul the mask position with numpy : 0.008026838302612305 nb_pixel_total : 541 time to create 1 rle with old method : 0.000644683837890625 time for calcul the mask position with numpy : 0.00825047492980957 nb_pixel_total : 3128 time to create 1 rle with old method : 0.0036149024963378906 time for calcul the mask position with numpy : 0.008068323135375977 nb_pixel_total : 8311 time to create 1 rle with old method : 0.008965253829956055 time for calcul the mask position with numpy : 0.008081674575805664 nb_pixel_total : 65 time to create 1 rle with old method : 7.653236389160156e-05 time for calcul the mask position with numpy : 0.008073806762695312 nb_pixel_total : 540 time to create 1 rle with old method : 0.0006136894226074219 time for calcul the mask position with numpy : 0.008265495300292969 nb_pixel_total : 533 time to create 1 rle with old method : 0.0006282329559326172 time for calcul the mask position with numpy : 0.008099079132080078 nb_pixel_total : 203 time to create 1 rle with old method : 0.0002510547637939453 time for calcul the mask position with numpy : 0.00818777084350586 nb_pixel_total : 320 time to create 1 rle with old method : 0.0003809928894042969 time for calcul the mask position with numpy : 0.008338689804077148 nb_pixel_total : 391 time to create 1 rle with old method : 0.0004642009735107422 time for calcul the mask position with numpy : 0.007885932922363281 nb_pixel_total : 6550 time to create 1 rle with old method : 0.007419109344482422 time for calcul the mask position with numpy : 0.008346080780029297 nb_pixel_total : 181 time to create 1 rle with old method : 0.0002651214599609375 time for calcul the mask position with numpy : 0.008332014083862305 nb_pixel_total : 5765 time to create 1 rle with old method : 0.006412982940673828 time for calcul the mask position with numpy : 0.008188247680664062 nb_pixel_total : 3331 time to create 1 rle with old method : 0.00396275520324707 time for calcul the mask position with numpy : 0.00834965705871582 nb_pixel_total : 1077 time to create 1 rle with old method : 0.0013523101806640625 time for calcul the mask position with numpy : 0.0083770751953125 nb_pixel_total : 113 time to create 1 rle with old method : 0.0001475811004638672 time for calcul the mask position with numpy : 0.008507013320922852 nb_pixel_total : 147 time to create 1 rle with old method : 0.00017547607421875 time for calcul the mask position with numpy : 0.008302450180053711 nb_pixel_total : 1144 time to create 1 rle with old method : 0.0012769699096679688 time for calcul the mask position with numpy : 0.008350372314453125 nb_pixel_total : 287 time to create 1 rle with old method : 0.0003619194030761719 time for calcul the mask position with numpy : 0.008334636688232422 nb_pixel_total : 7 time to create 1 rle with old method : 1.9550323486328125e-05 time for calcul the mask position with numpy : 0.008138418197631836 nb_pixel_total : 638 time to create 1 rle with old method : 0.0007181167602539062 time for calcul the mask position with numpy : 0.008337259292602539 nb_pixel_total : 8125 time to create 1 rle with old method : 0.008950471878051758 time for calcul the mask position with numpy : 0.008225202560424805 nb_pixel_total : 333 time to create 1 rle with old method : 0.00038743019104003906 time for calcul the mask position with numpy : 0.008365631103515625 nb_pixel_total : 313 time to create 1 rle with old method : 0.0003838539123535156 time for calcul the mask position with numpy : 0.00804901123046875 nb_pixel_total : 660 time to create 1 rle with old method : 0.0007228851318359375 time for calcul the mask position with numpy : 0.007915496826171875 nb_pixel_total : 18 time to create 1 rle with old method : 3.790855407714844e-05 time for calcul the mask position with numpy : 0.007966041564941406 nb_pixel_total : 230 time to create 1 rle with old method : 0.00025153160095214844 time for calcul the mask position with numpy : 0.008340597152709961 nb_pixel_total : 194 time to create 1 rle with old method : 0.00026988983154296875 time for calcul the mask position with numpy : 0.00838327407836914 nb_pixel_total : 969 time to create 1 rle with old method : 0.0011284351348876953 time for calcul the mask position with numpy : 0.008293390274047852 nb_pixel_total : 4438 time to create 1 rle with old method : 0.005182743072509766 time for calcul the mask position with numpy : 0.00833582878112793 nb_pixel_total : 590 time to create 1 rle with old method : 0.0006711483001708984 time for calcul the mask position with numpy : 0.008376836776733398 nb_pixel_total : 915 time to create 1 rle with old method : 0.0010266304016113281 time for calcul the mask position with numpy : 0.00835108757019043 nb_pixel_total : 85 time to create 1 rle with old method : 0.00016999244689941406 time for calcul the mask position with numpy : 0.00833272933959961 nb_pixel_total : 1164 time to create 1 rle with old method : 0.0014007091522216797 time for calcul the mask position with numpy : 0.008374929428100586 nb_pixel_total : 362 time to create 1 rle with old method : 0.00043129920959472656 time for calcul the mask position with numpy : 0.009430170059204102 nb_pixel_total : 121 time to create 1 rle with old method : 0.00015997886657714844 time for calcul the mask position with numpy : 0.008292675018310547 nb_pixel_total : 2077 time to create 1 rle with old method : 0.0023186206817626953 time for calcul the mask position with numpy : 0.008356809616088867 nb_pixel_total : 319 time to create 1 rle with old method : 0.0003769397735595703 time for calcul the mask position with numpy : 0.008106708526611328 nb_pixel_total : 303 time to create 1 rle with old method : 0.0003504753112792969 time for calcul the mask position with numpy : 0.008385658264160156 nb_pixel_total : 1142 time to create 1 rle with old method : 0.0013082027435302734 time for calcul the mask position with numpy : 0.008373022079467773 nb_pixel_total : 111 time to create 1 rle with old method : 0.00016641616821289062 time for calcul the mask position with numpy : 0.008337259292602539 nb_pixel_total : 83 time to create 1 rle with old method : 0.0001571178436279297 time for calcul the mask position with numpy : 0.00831747055053711 nb_pixel_total : 1720 time to create 1 rle with old method : 0.0020203590393066406 time for calcul the mask position with numpy : 0.008392095565795898 nb_pixel_total : 598 time to create 1 rle with old method : 0.0006957054138183594 time for calcul the mask position with numpy : 0.00838327407836914 nb_pixel_total : 739 time to create 1 rle with old method : 0.0008640289306640625 time for calcul the mask position with numpy : 0.009034395217895508 nb_pixel_total : 104426 time to create 1 rle with old method : 0.11398696899414062 time for calcul the mask position with numpy : 0.008216142654418945 nb_pixel_total : 128 time to create 1 rle with old method : 0.00016045570373535156 time for calcul the mask position with numpy : 0.00823211669921875 nb_pixel_total : 5346 time to create 1 rle with old method : 0.006202220916748047 time for calcul the mask position with numpy : 0.008349895477294922 nb_pixel_total : 672 time to create 1 rle with old method : 0.0008418560028076172 time for calcul the mask position with numpy : 0.008286237716674805 nb_pixel_total : 865 time to create 1 rle with old method : 0.0010249614715576172 time for calcul the mask position with numpy : 0.008181095123291016 nb_pixel_total : 1068 time to create 1 rle with old method : 0.001215219497680664 time for calcul the mask position with numpy : 0.008272886276245117 nb_pixel_total : 725 time to create 1 rle with old method : 0.0008020401000976562 time for calcul the mask position with numpy : 0.008034229278564453 nb_pixel_total : 490 time to create 1 rle with old method : 0.0005772113800048828 time for calcul the mask position with numpy : 0.008154153823852539 nb_pixel_total : 5758 time to create 1 rle with old method : 0.006183147430419922 time for calcul the mask position with numpy : 0.00821375846862793 nb_pixel_total : 396 time to create 1 rle with old method : 0.0004916191101074219 time for calcul the mask position with numpy : 0.008128643035888672 nb_pixel_total : 1 time to create 1 rle with old method : 7.3909759521484375e-06 time for calcul the mask position with numpy : 0.008023262023925781 nb_pixel_total : 228 time to create 1 rle with old method : 0.0002377033233642578 time for calcul the mask position with numpy : 0.007843971252441406 nb_pixel_total : 91 time to create 1 rle with old method : 0.00010967254638671875 time for calcul the mask position with numpy : 0.008096933364868164 nb_pixel_total : 212 time to create 1 rle with old method : 0.00026297569274902344 time for calcul the mask position with numpy : 0.008238792419433594 nb_pixel_total : 845 time to create 1 rle with old method : 0.0010197162628173828 time for calcul the mask position with numpy : 0.0077702999114990234 nb_pixel_total : 279 time to create 1 rle with old method : 0.00030875205993652344 time for calcul the mask position with numpy : 0.007709980010986328 nb_pixel_total : 3337 time to create 1 rle with old method : 0.0034902095794677734 time for calcul the mask position with numpy : 0.007973432540893555 nb_pixel_total : 287 time to create 1 rle with old method : 0.0003364086151123047 time for calcul the mask position with numpy : 0.008043527603149414 nb_pixel_total : 324 time to create 1 rle with old method : 0.0003750324249267578 time for calcul the mask position with numpy : 0.007958650588989258 nb_pixel_total : 479 time to create 1 rle with old method : 0.0005433559417724609 time for calcul the mask position with numpy : 0.008402824401855469 nb_pixel_total : 1064 time to create 1 rle with old method : 0.001215219497680664 time for calcul the mask position with numpy : 0.011461734771728516 nb_pixel_total : 620 time to create 1 rle with old method : 0.0013158321380615234 time for calcul the mask position with numpy : 0.008437395095825195 nb_pixel_total : 630 time to create 1 rle with old method : 0.0007054805755615234 time for calcul the mask position with numpy : 0.008385658264160156 nb_pixel_total : 572 time to create 1 rle with old method : 0.0006754398345947266 time for calcul the mask position with numpy : 0.008378744125366211 nb_pixel_total : 347 time to create 1 rle with old method : 0.00040721893310546875 time for calcul the mask position with numpy : 0.00837850570678711 nb_pixel_total : 4314 time to create 1 rle with old method : 0.0047757625579833984 time for calcul the mask position with numpy : 0.008395910263061523 nb_pixel_total : 123 time to create 1 rle with old method : 0.00014972686767578125 time for calcul the mask position with numpy : 0.008373022079467773 nb_pixel_total : 132 time to create 1 rle with old method : 0.00016617774963378906 time for calcul the mask position with numpy : 0.008199214935302734 nb_pixel_total : 485 time to create 1 rle with old method : 0.0005233287811279297 time for calcul the mask position with numpy : 0.008086204528808594 nb_pixel_total : 1334 time to create 1 rle with old method : 0.0014393329620361328 time for calcul the mask position with numpy : 0.008040189743041992 nb_pixel_total : 13 time to create 1 rle with old method : 4.506111145019531e-05 time for calcul the mask position with numpy : 0.008191347122192383 nb_pixel_total : 560 time to create 1 rle with old method : 0.0006561279296875 time for calcul the mask position with numpy : 0.008322954177856445 nb_pixel_total : 704 time to create 1 rle with old method : 0.0007798671722412109 time for calcul the mask position with numpy : 0.00829768180847168 nb_pixel_total : 54 time to create 1 rle with old method : 9.608268737792969e-05 time for calcul the mask position with numpy : 0.008223772048950195 nb_pixel_total : 212 time to create 1 rle with old method : 0.0002663135528564453 time for calcul the mask position with numpy : 0.008286476135253906 nb_pixel_total : 283 time to create 1 rle with old method : 0.0003845691680908203 time for calcul the mask position with numpy : 0.010602951049804688 nb_pixel_total : 239 time to create 1 rle with old method : 0.0004527568817138672 time for calcul the mask position with numpy : 0.010210752487182617 nb_pixel_total : 638 time to create 1 rle with old method : 0.0011472702026367188 time for calcul the mask position with numpy : 0.013429880142211914 nb_pixel_total : 7 time to create 1 rle with old method : 4.172325134277344e-05 time for calcul the mask position with numpy : 0.0127105712890625 nb_pixel_total : 483 time to create 1 rle with old method : 0.0005755424499511719 time for calcul the mask position with numpy : 0.008356809616088867 nb_pixel_total : 154 time to create 1 rle with old method : 0.0001881122589111328 time for calcul the mask position with numpy : 0.008383750915527344 nb_pixel_total : 122 time to create 1 rle with old method : 0.0001544952392578125 time for calcul the mask position with numpy : 0.008101463317871094 nb_pixel_total : 398 time to create 1 rle with old method : 0.0004723072052001953 time for calcul the mask position with numpy : 0.008494138717651367 nb_pixel_total : 723 time to create 1 rle with old method : 0.0008704662322998047 time for calcul the mask position with numpy : 0.008296489715576172 nb_pixel_total : 267 time to create 1 rle with old method : 0.00031447410583496094 time for calcul the mask position with numpy : 0.008336544036865234 nb_pixel_total : 2550 time to create 1 rle with old method : 0.0028345584869384766 time for calcul the mask position with numpy : 0.008254051208496094 nb_pixel_total : 91 time to create 1 rle with old method : 0.00011777877807617188 time for calcul the mask position with numpy : 0.008334636688232422 nb_pixel_total : 462 time to create 1 rle with old method : 0.0005517005920410156 time for calcul the mask position with numpy : 0.008349895477294922 nb_pixel_total : 536 time to create 1 rle with old method : 0.0006520748138427734 time for calcul the mask position with numpy : 0.008851051330566406 nb_pixel_total : 491 time to create 1 rle with old method : 0.0005850791931152344 create new chi : 1.4931750297546387 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.012424945831298828 batch 1 Loaded 112 chid ids of type : 4230 Number RLEs to save : 11331 TO DO : save crop sub photo not yet done ! save time : 1.8167104721069336 nb_obj : 112 nb_hashtags : 6 time to prepare the origin masks : 2.4128711223602295 time for calcul the mask position with numpy : 0.3462347984313965 nb_pixel_total : 1796875 time to create 1 rle with new method : 0.6142182350158691 time for calcul the mask position with numpy : 0.0074939727783203125 nb_pixel_total : 48737 time to create 1 rle with old method : 0.06493020057678223 time for calcul the mask position with numpy : 0.007862329483032227 nb_pixel_total : 147 time to create 1 rle with old method : 0.0003027915954589844 time for calcul the mask position with numpy : 0.008159399032592773 nb_pixel_total : 624 time to create 1 rle with old method : 0.0009083747863769531 time for calcul the mask position with numpy : 0.007661581039428711 nb_pixel_total : 6 time to create 1 rle with old method : 4.696846008300781e-05 time for calcul the mask position with numpy : 0.0076541900634765625 nb_pixel_total : 281 time to create 1 rle with old method : 0.00048542022705078125 time for calcul the mask position with numpy : 0.007613182067871094 nb_pixel_total : 1022 time to create 1 rle with old method : 0.0015997886657714844 time for calcul the mask position with numpy : 0.0077667236328125 nb_pixel_total : 63 time to create 1 rle with old method : 0.00015091896057128906 time for calcul the mask position with numpy : 0.007733583450317383 nb_pixel_total : 479 time to create 1 rle with old method : 0.0006759166717529297 time for calcul the mask position with numpy : 0.0074961185455322266 nb_pixel_total : 19 time to create 1 rle with old method : 5.245208740234375e-05 time for calcul the mask position with numpy : 0.007777214050292969 nb_pixel_total : 414 time to create 1 rle with old method : 0.000751495361328125 time for calcul the mask position with numpy : 0.007996559143066406 nb_pixel_total : 310 time to create 1 rle with old method : 0.0005574226379394531 time for calcul the mask position with numpy : 0.007295846939086914 nb_pixel_total : 3138 time to create 1 rle with old method : 0.004542112350463867 time for calcul the mask position with numpy : 0.012983083724975586 nb_pixel_total : 460 time to create 1 rle with old method : 0.0007312297821044922 time for calcul the mask position with numpy : 0.010127782821655273 nb_pixel_total : 4800 time to create 1 rle with old method : 0.0067141056060791016 time for calcul the mask position with numpy : 0.008858919143676758 nb_pixel_total : 1737 time to create 1 rle with old method : 0.002822399139404297 time for calcul the mask position with numpy : 0.008809566497802734 nb_pixel_total : 917 time to create 1 rle with old method : 0.0013272762298583984 time for calcul the mask position with numpy : 0.008365392684936523 nb_pixel_total : 1177 time to create 1 rle with old method : 0.001569509506225586 time for calcul the mask position with numpy : 0.00987863540649414 nb_pixel_total : 816 time to create 1 rle with old method : 0.0011186599731445312 time for calcul the mask position with numpy : 0.009961605072021484 nb_pixel_total : 760 time to create 1 rle with old method : 0.0009691715240478516 time for calcul the mask position with numpy : 0.010364532470703125 nb_pixel_total : 474 time to create 1 rle with old method : 0.0005502700805664062 time for calcul the mask position with numpy : 0.007472038269042969 nb_pixel_total : 1580 time to create 1 rle with old method : 0.001745462417602539 time for calcul the mask position with numpy : 0.008203744888305664 nb_pixel_total : 533 time to create 1 rle with old method : 0.0010313987731933594 time for calcul the mask position with numpy : 0.008877277374267578 nb_pixel_total : 3980 time to create 1 rle with old method : 0.004709959030151367 time for calcul the mask position with numpy : 0.009424924850463867 nb_pixel_total : 799 time to create 1 rle with old method : 0.0013060569763183594 time for calcul the mask position with numpy : 0.008300542831420898 nb_pixel_total : 5093 time to create 1 rle with old method : 0.005753040313720703 time for calcul the mask position with numpy : 0.007642984390258789 nb_pixel_total : 122 time to create 1 rle with old method : 0.0002205371856689453 time for calcul the mask position with numpy : 0.0075092315673828125 nb_pixel_total : 3199 time to create 1 rle with old method : 0.0040130615234375 time for calcul the mask position with numpy : 0.006805419921875 nb_pixel_total : 800 time to create 1 rle with old method : 0.0008997917175292969 time for calcul the mask position with numpy : 0.006319522857666016 nb_pixel_total : 272 time to create 1 rle with old method : 0.0003361701965332031 time for calcul the mask position with numpy : 0.006575107574462891 nb_pixel_total : 2224 time to create 1 rle with old method : 0.002517223358154297 time for calcul the mask position with numpy : 0.006577253341674805 nb_pixel_total : 554 time to create 1 rle with old method : 0.0006537437438964844 time for calcul the mask position with numpy : 0.0063610076904296875 nb_pixel_total : 834 time to create 1 rle with old method : 0.0010821819305419922 time for calcul the mask position with numpy : 0.006539583206176758 nb_pixel_total : 9042 time to create 1 rle with old method : 0.01041412353515625 time for calcul the mask position with numpy : 0.006495237350463867 nb_pixel_total : 124 time to create 1 rle with old method : 0.0001766681671142578 time for calcul the mask position with numpy : 0.006453752517700195 nb_pixel_total : 136 time to create 1 rle with old method : 0.00018644332885742188 time for calcul the mask position with numpy : 0.006220817565917969 nb_pixel_total : 1146 time to create 1 rle with old method : 0.001348257064819336 time for calcul the mask position with numpy : 0.0064809322357177734 nb_pixel_total : 11401 time to create 1 rle with old method : 0.01395273208618164 time for calcul the mask position with numpy : 0.006847381591796875 nb_pixel_total : 556 time to create 1 rle with old method : 0.0006620883941650391 time for calcul the mask position with numpy : 0.006519794464111328 nb_pixel_total : 65 time to create 1 rle with old method : 0.00011754035949707031 time for calcul the mask position with numpy : 0.006690502166748047 nb_pixel_total : 643 time to create 1 rle with old method : 0.0007009506225585938 time for calcul the mask position with numpy : 0.0066449642181396484 nb_pixel_total : 5584 time to create 1 rle with old method : 0.006565093994140625 time for calcul the mask position with numpy : 0.008184432983398438 nb_pixel_total : 478 time to create 1 rle with old method : 0.0005819797515869141 time for calcul the mask position with numpy : 0.00667119026184082 nb_pixel_total : 612 time to create 1 rle with old method : 0.0007281303405761719 time for calcul the mask position with numpy : 0.006488323211669922 nb_pixel_total : 86 time to create 1 rle with old method : 0.00016951560974121094 time for calcul the mask position with numpy : 0.007949352264404297 nb_pixel_total : 53 time to create 1 rle with old method : 0.0002181529998779297 time for calcul the mask position with numpy : 0.008161783218383789 nb_pixel_total : 2080 time to create 1 rle with old method : 0.0030455589294433594 time for calcul the mask position with numpy : 0.009424686431884766 nb_pixel_total : 789 time to create 1 rle with old method : 0.00138092041015625 time for calcul the mask position with numpy : 0.008266925811767578 nb_pixel_total : 290 time to create 1 rle with old method : 0.0004792213439941406 time for calcul the mask position with numpy : 0.008225202560424805 nb_pixel_total : 4150 time to create 1 rle with old method : 0.0054781436920166016 time for calcul the mask position with numpy : 0.007347583770751953 nb_pixel_total : 548 time to create 1 rle with old method : 0.0006580352783203125 time for calcul the mask position with numpy : 0.007711648941040039 nb_pixel_total : 425 time to create 1 rle with old method : 0.0006022453308105469 time for calcul the mask position with numpy : 0.008002519607543945 nb_pixel_total : 2070 time to create 1 rle with old method : 0.002463817596435547 time for calcul the mask position with numpy : 0.008144855499267578 nb_pixel_total : 1152 time to create 1 rle with old method : 0.001546621322631836 time for calcul the mask position with numpy : 0.007405519485473633 nb_pixel_total : 1103 time to create 1 rle with old method : 0.0017747879028320312 time for calcul the mask position with numpy : 0.00786137580871582 nb_pixel_total : 1745 time to create 1 rle with old method : 0.002050161361694336 time for calcul the mask position with numpy : 0.0073719024658203125 nb_pixel_total : 163 time to create 1 rle with old method : 0.0002410411834716797 time for calcul the mask position with numpy : 0.007344245910644531 nb_pixel_total : 1085 time to create 1 rle with old method : 0.0013391971588134766 time for calcul the mask position with numpy : 0.007410764694213867 nb_pixel_total : 2 time to create 1 rle with old method : 4.76837158203125e-05 time for calcul the mask position with numpy : 0.007005929946899414 nb_pixel_total : 388 time to create 1 rle with old method : 0.00046944618225097656 time for calcul the mask position with numpy : 0.007331371307373047 nb_pixel_total : 104791 time to create 1 rle with old method : 0.11347341537475586 time for calcul the mask position with numpy : 0.0063626766204833984 nb_pixel_total : 118 time to create 1 rle with old method : 0.00016427040100097656 time for calcul the mask position with numpy : 0.006390810012817383 nb_pixel_total : 4852 time to create 1 rle with old method : 0.00534510612487793 time for calcul the mask position with numpy : 0.006288051605224609 nb_pixel_total : 117 time to create 1 rle with old method : 0.00016188621520996094 time for calcul the mask position with numpy : 0.006324052810668945 nb_pixel_total : 73 time to create 1 rle with old method : 0.00013947486877441406 time for calcul the mask position with numpy : 0.006452322006225586 nb_pixel_total : 350 time to create 1 rle with old method : 0.00042748451232910156 time for calcul the mask position with numpy : 0.006344795227050781 nb_pixel_total : 1047 time to create 1 rle with old method : 0.0012357234954833984 time for calcul the mask position with numpy : 0.006395578384399414 nb_pixel_total : 648 time to create 1 rle with old method : 0.0008654594421386719 time for calcul the mask position with numpy : 0.00632166862487793 nb_pixel_total : 117 time to create 1 rle with old method : 0.00015282630920410156 time for calcul the mask position with numpy : 0.0064198970794677734 nb_pixel_total : 455 time to create 1 rle with old method : 0.0005397796630859375 time for calcul the mask position with numpy : 0.0063707828521728516 nb_pixel_total : 6576 time to create 1 rle with old method : 0.007571697235107422 time for calcul the mask position with numpy : 0.006241559982299805 nb_pixel_total : 19 time to create 1 rle with old method : 4.458427429199219e-05 time for calcul the mask position with numpy : 0.006308555603027344 nb_pixel_total : 986 time to create 1 rle with old method : 0.00115966796875 time for calcul the mask position with numpy : 0.006215572357177734 nb_pixel_total : 287 time to create 1 rle with old method : 0.00035834312438964844 time for calcul the mask position with numpy : 0.006654500961303711 nb_pixel_total : 211 time to create 1 rle with old method : 0.0002765655517578125 time for calcul the mask position with numpy : 0.00665283203125 nb_pixel_total : 240 time to create 1 rle with old method : 0.000301361083984375 time for calcul the mask position with numpy : 0.006610393524169922 nb_pixel_total : 371 time to create 1 rle with old method : 0.0004317760467529297 time for calcul the mask position with numpy : 0.006640434265136719 nb_pixel_total : 505 time to create 1 rle with old method : 0.0005917549133300781 time for calcul the mask position with numpy : 0.0063478946685791016 nb_pixel_total : 496 time to create 1 rle with old method : 0.0005896091461181641 time for calcul the mask position with numpy : 0.007082223892211914 nb_pixel_total : 555 time to create 1 rle with old method : 0.0006403923034667969 time for calcul the mask position with numpy : 0.0077893733978271484 nb_pixel_total : 379 time to create 1 rle with old method : 0.0004639625549316406 time for calcul the mask position with numpy : 0.00929570198059082 nb_pixel_total : 321 time to create 1 rle with old method : 0.000385284423828125 time for calcul the mask position with numpy : 0.007443428039550781 nb_pixel_total : 117 time to create 1 rle with old method : 0.0001544952392578125 time for calcul the mask position with numpy : 0.00682520866394043 nb_pixel_total : 175 time to create 1 rle with old method : 0.00021409988403320312 time for calcul the mask position with numpy : 0.006494283676147461 nb_pixel_total : 4010 time to create 1 rle with old method : 0.004467010498046875 time for calcul the mask position with numpy : 0.0068225860595703125 nb_pixel_total : 16 time to create 1 rle with old method : 4.315376281738281e-05 time for calcul the mask position with numpy : 0.006392955780029297 nb_pixel_total : 760 time to create 1 rle with old method : 0.0009071826934814453 time for calcul the mask position with numpy : 0.0069732666015625 nb_pixel_total : 451 time to create 1 rle with old method : 0.0005257129669189453 time for calcul the mask position with numpy : 0.006375789642333984 nb_pixel_total : 1270 time to create 1 rle with old method : 0.0014350414276123047 time for calcul the mask position with numpy : 0.0065271854400634766 nb_pixel_total : 11 time to create 1 rle with old method : 3.981590270996094e-05 time for calcul the mask position with numpy : 0.00647425651550293 nb_pixel_total : 196 time to create 1 rle with old method : 0.00024390220642089844 time for calcul the mask position with numpy : 0.006544351577758789 nb_pixel_total : 568 time to create 1 rle with old method : 0.0006897449493408203 time for calcul the mask position with numpy : 0.006399869918823242 nb_pixel_total : 14 time to create 1 rle with old method : 6.389617919921875e-05 time for calcul the mask position with numpy : 0.006410837173461914 nb_pixel_total : 245 time to create 1 rle with old method : 0.0002765655517578125 time for calcul the mask position with numpy : 0.006172895431518555 nb_pixel_total : 238 time to create 1 rle with old method : 0.0003039836883544922 time for calcul the mask position with numpy : 0.006369352340698242 nb_pixel_total : 487 time to create 1 rle with old method : 0.00055694580078125 time for calcul the mask position with numpy : 0.006824016571044922 nb_pixel_total : 13 time to create 1 rle with old method : 3.647804260253906e-05 time for calcul the mask position with numpy : 0.006673336029052734 nb_pixel_total : 879 time to create 1 rle with old method : 0.001069784164428711 time for calcul the mask position with numpy : 0.00666046142578125 nb_pixel_total : 164 time to create 1 rle with old method : 0.0002231597900390625 time for calcul the mask position with numpy : 0.00766301155090332 nb_pixel_total : 5011 time to create 1 rle with old method : 0.006151914596557617 time for calcul the mask position with numpy : 0.006609916687011719 nb_pixel_total : 128 time to create 1 rle with old method : 0.0001804828643798828 time for calcul the mask position with numpy : 0.0065991878509521484 nb_pixel_total : 362 time to create 1 rle with old method : 0.00047326087951660156 time for calcul the mask position with numpy : 0.007431745529174805 nb_pixel_total : 977 time to create 1 rle with old method : 0.0012209415435791016 time for calcul the mask position with numpy : 0.006562948226928711 nb_pixel_total : 62 time to create 1 rle with old method : 9.417533874511719e-05 time for calcul the mask position with numpy : 0.007310390472412109 nb_pixel_total : 359 time to create 1 rle with old method : 0.0007648468017578125 time for calcul the mask position with numpy : 0.006604671478271484 nb_pixel_total : 1178 time to create 1 rle with old method : 0.0014700889587402344 time for calcul the mask position with numpy : 0.006603240966796875 nb_pixel_total : 1114 time to create 1 rle with old method : 0.001367807388305664 time for calcul the mask position with numpy : 0.006558895111083984 nb_pixel_total : 283 time to create 1 rle with old method : 0.00034618377685546875 time for calcul the mask position with numpy : 0.006525993347167969 nb_pixel_total : 103 time to create 1 rle with old method : 0.00014829635620117188 time for calcul the mask position with numpy : 0.0065495967864990234 nb_pixel_total : 567 time to create 1 rle with old method : 0.0007202625274658203 time for calcul the mask position with numpy : 0.006502389907836914 nb_pixel_total : 490 time to create 1 rle with old method : 0.0005977153778076172 time for calcul the mask position with numpy : 0.006386756896972656 nb_pixel_total : 503 time to create 1 rle with old method : 0.0006058216094970703 time for calcul the mask position with numpy : 0.00727081298828125 nb_pixel_total : 173 time to create 1 rle with old method : 0.00021886825561523438 create new chi : 2.123418092727661 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0016224384307861328 batch 1 Loaded 113 chid ids of type : 4230 Number RLEs to save : 11729 TO DO : save crop sub photo not yet done ! save time : 0.7877175807952881 nb_obj : 117 nb_hashtags : 7 time to prepare the origin masks : 1.817389726638794 time for calcul the mask position with numpy : 0.06083989143371582 nb_pixel_total : 1831929 time to create 1 rle with new method : 0.2660956382751465 time for calcul the mask position with numpy : 0.009321451187133789 nb_pixel_total : 7333 time to create 1 rle with old method : 0.00856637954711914 time for calcul the mask position with numpy : 0.009668588638305664 nb_pixel_total : 15417 time to create 1 rle with old method : 0.01693892478942871 time for calcul the mask position with numpy : 0.00998544692993164 nb_pixel_total : 58 time to create 1 rle with old method : 9.107589721679688e-05 time for calcul the mask position with numpy : 0.009993791580200195 nb_pixel_total : 551 time to create 1 rle with old method : 0.0006651878356933594 time for calcul the mask position with numpy : 0.009950876235961914 nb_pixel_total : 348 time to create 1 rle with old method : 0.0004372596740722656 time for calcul the mask position with numpy : 0.009691953659057617 nb_pixel_total : 96 time to create 1 rle with old method : 0.00015878677368164062 time for calcul the mask position with numpy : 0.01003575325012207 nb_pixel_total : 165 time to create 1 rle with old method : 0.00024271011352539062 time for calcul the mask position with numpy : 0.009989738464355469 nb_pixel_total : 413 time to create 1 rle with old method : 0.00047397613525390625 time for calcul the mask position with numpy : 0.010381221771240234 nb_pixel_total : 4 time to create 1 rle with old method : 3.4809112548828125e-05 time for calcul the mask position with numpy : 0.009712457656860352 nb_pixel_total : 2501 time to create 1 rle with old method : 0.0027816295623779297 time for calcul the mask position with numpy : 0.00999903678894043 nb_pixel_total : 5802 time to create 1 rle with old method : 0.006310701370239258 time for calcul the mask position with numpy : 0.009951114654541016 nb_pixel_total : 495 time to create 1 rle with old method : 0.0005233287811279297 time for calcul the mask position with numpy : 0.009905576705932617 nb_pixel_total : 54 time to create 1 rle with old method : 9.560585021972656e-05 time for calcul the mask position with numpy : 0.009680032730102539 nb_pixel_total : 10 time to create 1 rle with old method : 3.9577484130859375e-05 time for calcul the mask position with numpy : 0.00885629653930664 nb_pixel_total : 1457 time to create 1 rle with old method : 0.0016350746154785156 time for calcul the mask position with numpy : 0.00910186767578125 nb_pixel_total : 163 time to create 1 rle with old method : 0.00021696090698242188 time for calcul the mask position with numpy : 0.009267330169677734 nb_pixel_total : 389 time to create 1 rle with old method : 0.0004906654357910156 time for calcul the mask position with numpy : 0.00861215591430664 nb_pixel_total : 2005 time to create 1 rle with old method : 0.002134561538696289 time for calcul the mask position with numpy : 0.009274959564208984 nb_pixel_total : 729 time to create 1 rle with old method : 0.0008263587951660156 time for calcul the mask position with numpy : 0.00939035415649414 nb_pixel_total : 916 time to create 1 rle with old method : 0.0010402202606201172 time for calcul the mask position with numpy : 0.00975489616394043 nb_pixel_total : 869 time to create 1 rle with old method : 0.0010232925415039062 time for calcul the mask position with numpy : 0.009699106216430664 nb_pixel_total : 508 time to create 1 rle with old method : 0.0006127357482910156 time for calcul the mask position with numpy : 0.0097198486328125 nb_pixel_total : 482 time to create 1 rle with old method : 0.0005924701690673828 time for calcul the mask position with numpy : 0.009678125381469727 nb_pixel_total : 441 time to create 1 rle with old method : 0.0005474090576171875 time for calcul the mask position with numpy : 0.009540081024169922 nb_pixel_total : 169 time to create 1 rle with old method : 0.00022649765014648438 time for calcul the mask position with numpy : 0.009656667709350586 nb_pixel_total : 518 time to create 1 rle with old method : 0.0005981922149658203 time for calcul the mask position with numpy : 0.009419679641723633 nb_pixel_total : 7235 time to create 1 rle with old method : 0.00842142105102539 time for calcul the mask position with numpy : 0.009953975677490234 nb_pixel_total : 692 time to create 1 rle with old method : 0.0008461475372314453 time for calcul the mask position with numpy : 0.009894847869873047 nb_pixel_total : 272 time to create 1 rle with old method : 0.00034165382385253906 time for calcul the mask position with numpy : 0.01320338249206543 nb_pixel_total : 515 time to create 1 rle with old method : 0.0006172657012939453 time for calcul the mask position with numpy : 0.009468317031860352 nb_pixel_total : 491 time to create 1 rle with old method : 0.0006279945373535156 time for calcul the mask position with numpy : 0.009407520294189453 nb_pixel_total : 9796 time to create 1 rle with old method : 0.011174440383911133 time for calcul the mask position with numpy : 0.009547948837280273 nb_pixel_total : 184 time to create 1 rle with old method : 0.0002522468566894531 time for calcul the mask position with numpy : 0.009896516799926758 nb_pixel_total : 10 time to create 1 rle with old method : 3.266334533691406e-05 time for calcul the mask position with numpy : 0.009495973587036133 nb_pixel_total : 93 time to create 1 rle with old method : 0.00014495849609375 time for calcul the mask position with numpy : 0.009857177734375 nb_pixel_total : 1202 time to create 1 rle with old method : 0.0014286041259765625 time for calcul the mask position with numpy : 0.009924650192260742 nb_pixel_total : 9802 time to create 1 rle with old method : 0.011315584182739258 time for calcul the mask position with numpy : 0.010364770889282227 nb_pixel_total : 56 time to create 1 rle with old method : 0.00010466575622558594 time for calcul the mask position with numpy : 0.010439634323120117 nb_pixel_total : 502 time to create 1 rle with old method : 0.0006144046783447266 time for calcul the mask position with numpy : 0.010250329971313477 nb_pixel_total : 4468 time to create 1 rle with old method : 0.005242109298706055 time for calcul the mask position with numpy : 0.010375022888183594 nb_pixel_total : 214 time to create 1 rle with old method : 0.00034546852111816406 time for calcul the mask position with numpy : 0.010338306427001953 nb_pixel_total : 555 time to create 1 rle with old method : 0.0006797313690185547 time for calcul the mask position with numpy : 0.010283470153808594 nb_pixel_total : 2262 time to create 1 rle with old method : 0.002928495407104492 time for calcul the mask position with numpy : 0.010466814041137695 nb_pixel_total : 57 time to create 1 rle with old method : 0.0001418590545654297 time for calcul the mask position with numpy : 0.010271549224853516 nb_pixel_total : 780 time to create 1 rle with old method : 0.0010526180267333984 time for calcul the mask position with numpy : 0.010292291641235352 nb_pixel_total : 1386 time to create 1 rle with old method : 0.0017251968383789062 time for calcul the mask position with numpy : 0.010032415390014648 nb_pixel_total : 384 time to create 1 rle with old method : 0.0005280971527099609 time for calcul the mask position with numpy : 0.00988006591796875 nb_pixel_total : 3676 time to create 1 rle with old method : 0.00440526008605957 time for calcul the mask position with numpy : 0.013548612594604492 nb_pixel_total : 507 time to create 1 rle with old method : 0.0006358623504638672 time for calcul the mask position with numpy : 0.009801149368286133 nb_pixel_total : 382 time to create 1 rle with old method : 0.0004837512969970703 time for calcul the mask position with numpy : 0.00980830192565918 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003104209899902344 time for calcul the mask position with numpy : 0.009639978408813477 nb_pixel_total : 2132 time to create 1 rle with old method : 0.0025336742401123047 time for calcul the mask position with numpy : 0.009816884994506836 nb_pixel_total : 155 time to create 1 rle with old method : 0.0002155303955078125 time for calcul the mask position with numpy : 0.009904146194458008 nb_pixel_total : 1189 time to create 1 rle with old method : 0.0014522075653076172 time for calcul the mask position with numpy : 0.010246753692626953 nb_pixel_total : 1151 time to create 1 rle with old method : 0.0014684200286865234 time for calcul the mask position with numpy : 0.011014461517333984 nb_pixel_total : 1551 time to create 1 rle with old method : 0.0022361278533935547 time for calcul the mask position with numpy : 0.012027978897094727 nb_pixel_total : 1052 time to create 1 rle with old method : 0.0014753341674804688 time for calcul the mask position with numpy : 0.012815475463867188 nb_pixel_total : 169 time to create 1 rle with old method : 0.00025725364685058594 time for calcul the mask position with numpy : 0.010500431060791016 nb_pixel_total : 639 time to create 1 rle with old method : 0.0007665157318115234 time for calcul the mask position with numpy : 0.01070547103881836 nb_pixel_total : 266 time to create 1 rle with old method : 0.0004138946533203125 time for calcul the mask position with numpy : 0.010151386260986328 nb_pixel_total : 351 time to create 1 rle with old method : 0.0004334449768066406 time for calcul the mask position with numpy : 0.010217428207397461 nb_pixel_total : 19 time to create 1 rle with old method : 5.269050598144531e-05 time for calcul the mask position with numpy : 0.007921695709228516 nb_pixel_total : 105511 time to create 1 rle with old method : 0.12549948692321777 time for calcul the mask position with numpy : 0.009933710098266602 nb_pixel_total : 128 time to create 1 rle with old method : 0.00017189979553222656 time for calcul the mask position with numpy : 0.009969949722290039 nb_pixel_total : 363 time to create 1 rle with old method : 0.0004265308380126953 time for calcul the mask position with numpy : 0.01002645492553711 nb_pixel_total : 1010 time to create 1 rle with old method : 0.0011861324310302734 time for calcul the mask position with numpy : 0.009971141815185547 nb_pixel_total : 125 time to create 1 rle with old method : 0.0001678466796875 time for calcul the mask position with numpy : 0.009954690933227539 nb_pixel_total : 40 time to create 1 rle with old method : 8.177757263183594e-05 time for calcul the mask position with numpy : 0.009857177734375 nb_pixel_total : 50 time to create 1 rle with old method : 8.58306884765625e-05 time for calcul the mask position with numpy : 0.009943723678588867 nb_pixel_total : 593 time to create 1 rle with old method : 0.0007314682006835938 time for calcul the mask position with numpy : 0.009843587875366211 nb_pixel_total : 514 time to create 1 rle with old method : 0.00061798095703125 time for calcul the mask position with numpy : 0.009926557540893555 nb_pixel_total : 940 time to create 1 rle with old method : 0.0011725425720214844 time for calcul the mask position with numpy : 0.010004997253417969 nb_pixel_total : 5020 time to create 1 rle with old method : 0.005660295486450195 time for calcul the mask position with numpy : 0.010108470916748047 nb_pixel_total : 1038 time to create 1 rle with old method : 0.001252889633178711 time for calcul the mask position with numpy : 0.009929656982421875 nb_pixel_total : 38 time to create 1 rle with old method : 6.723403930664062e-05 time for calcul the mask position with numpy : 0.009856224060058594 nb_pixel_total : 195 time to create 1 rle with old method : 0.0002460479736328125 time for calcul the mask position with numpy : 0.009910106658935547 nb_pixel_total : 218 time to create 1 rle with old method : 0.00025343894958496094 time for calcul the mask position with numpy : 0.009863853454589844 nb_pixel_total : 287 time to create 1 rle with old method : 0.00035071372985839844 time for calcul the mask position with numpy : 0.0076482295989990234 nb_pixel_total : 3354 time to create 1 rle with old method : 0.0037300586700439453 time for calcul the mask position with numpy : 0.006110191345214844 nb_pixel_total : 415 time to create 1 rle with old method : 0.0004889965057373047 time for calcul the mask position with numpy : 0.006105184555053711 nb_pixel_total : 514 time to create 1 rle with old method : 0.0006642341613769531 time for calcul the mask position with numpy : 0.006301403045654297 nb_pixel_total : 433 time to create 1 rle with old method : 0.0005545616149902344 time for calcul the mask position with numpy : 0.006157398223876953 nb_pixel_total : 35 time to create 1 rle with old method : 0.00012755393981933594 time for calcul the mask position with numpy : 0.006255626678466797 nb_pixel_total : 465 time to create 1 rle with old method : 0.00057220458984375 time for calcul the mask position with numpy : 0.006071329116821289 nb_pixel_total : 823 time to create 1 rle with old method : 0.0009913444519042969 time for calcul the mask position with numpy : 0.0060808658599853516 nb_pixel_total : 432 time to create 1 rle with old method : 0.0005397796630859375 time for calcul the mask position with numpy : 0.006081819534301758 nb_pixel_total : 373 time to create 1 rle with old method : 0.0004703998565673828 time for calcul the mask position with numpy : 0.006127834320068359 nb_pixel_total : 4364 time to create 1 rle with old method : 0.00534510612487793 time for calcul the mask position with numpy : 0.006123542785644531 nb_pixel_total : 536 time to create 1 rle with old method : 0.0006940364837646484 time for calcul the mask position with numpy : 0.006000518798828125 nb_pixel_total : 339 time to create 1 rle with old method : 0.00043892860412597656 time for calcul the mask position with numpy : 0.006083011627197266 nb_pixel_total : 157 time to create 1 rle with old method : 0.00019860267639160156 time for calcul the mask position with numpy : 0.0060002803802490234 nb_pixel_total : 504 time to create 1 rle with old method : 0.0006284713745117188 time for calcul the mask position with numpy : 0.0061681270599365234 nb_pixel_total : 747 time to create 1 rle with old method : 0.0008695125579833984 time for calcul the mask position with numpy : 0.006047487258911133 nb_pixel_total : 425 time to create 1 rle with old method : 0.0005269050598144531 time for calcul the mask position with numpy : 0.00608062744140625 nb_pixel_total : 549 time to create 1 rle with old method : 0.0006673336029052734 time for calcul the mask position with numpy : 0.006067752838134766 nb_pixel_total : 222 time to create 1 rle with old method : 0.0002949237823486328 time for calcul the mask position with numpy : 0.009644508361816406 nb_pixel_total : 112 time to create 1 rle with old method : 0.00018739700317382812 time for calcul the mask position with numpy : 0.007308006286621094 nb_pixel_total : 236 time to create 1 rle with old method : 0.0003731250762939453 time for calcul the mask position with numpy : 0.0061187744140625 nb_pixel_total : 125 time to create 1 rle with old method : 0.00018310546875 time for calcul the mask position with numpy : 0.0062487125396728516 nb_pixel_total : 625 time to create 1 rle with old method : 0.00098419189453125 time for calcul the mask position with numpy : 0.007327556610107422 nb_pixel_total : 12 time to create 1 rle with old method : 5.4836273193359375e-05 time for calcul the mask position with numpy : 0.006590366363525391 nb_pixel_total : 454 time to create 1 rle with old method : 0.0005636215209960938 time for calcul the mask position with numpy : 0.006379127502441406 nb_pixel_total : 4897 time to create 1 rle with old method : 0.0061037540435791016 time for calcul the mask position with numpy : 0.006325483322143555 nb_pixel_total : 144 time to create 1 rle with old method : 0.00019669532775878906 time for calcul the mask position with numpy : 0.0061910152435302734 nb_pixel_total : 1759 time to create 1 rle with old method : 0.002247333526611328 time for calcul the mask position with numpy : 0.006286144256591797 nb_pixel_total : 130 time to create 1 rle with old method : 0.0001800060272216797 time for calcul the mask position with numpy : 0.00629115104675293 nb_pixel_total : 230 time to create 1 rle with old method : 0.00030040740966796875 time for calcul the mask position with numpy : 0.006253957748413086 nb_pixel_total : 1113 time to create 1 rle with old method : 0.0014507770538330078 time for calcul the mask position with numpy : 0.006348133087158203 nb_pixel_total : 919 time to create 1 rle with old method : 0.0012271404266357422 time for calcul the mask position with numpy : 0.006269216537475586 nb_pixel_total : 1345 time to create 1 rle with old method : 0.0017206668853759766 time for calcul the mask position with numpy : 0.006314754486083984 nb_pixel_total : 331 time to create 1 rle with old method : 0.00043272972106933594 time for calcul the mask position with numpy : 0.00760650634765625 nb_pixel_total : 68 time to create 1 rle with old method : 0.00012612342834472656 time for calcul the mask position with numpy : 0.008395910263061523 nb_pixel_total : 396 time to create 1 rle with old method : 0.0005104541778564453 time for calcul the mask position with numpy : 0.00838017463684082 nb_pixel_total : 101 time to create 1 rle with old method : 0.0001392364501953125 time for calcul the mask position with numpy : 0.009008169174194336 nb_pixel_total : 573 time to create 1 rle with old method : 0.0009424686431884766 time for calcul the mask position with numpy : 0.009665727615356445 nb_pixel_total : 568 time to create 1 rle with old method : 0.0009434223175048828 time for calcul the mask position with numpy : 0.009638309478759766 nb_pixel_total : 440 time to create 1 rle with old method : 0.000736236572265625 create new chi : 1.6746315956115723 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.0023615360260009766 batch 1 Loaded 118 chid ids of type : 4230 Number RLEs to save : 12068 TO DO : save crop sub photo not yet done ! save time : 0.8633513450622559 map_output_result : {1341454721: (0.0, 'Should be the crop_list due to order', 0.0), 1341454718: (0.0, 'Should be the crop_list due to order', 0.0), 1341454707: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1341454721, 1341454718, 1341454707] Looping around the photos to save general results len do output : 3 /1341454721.Didn't retrieve data . /1341454718.Didn't retrieve data . /1341454707.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2648740') ('4234', '21146286', '1341454721', None, None, None, None, None, '2648740') ('4234', None, None, None, None, None, None, None, '2648740') ('4234', '21146286', '1341454718', None, None, None, None, None, '2648740') ('4234', None, None, None, None, None, None, None, '2648740') ('4234', '21146286', '1341454707', None, None, None, None, None, '2648740') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.15672922134399414 save_final save missing photos in datou_result : time spend for datou_step_exec : 14.824409484863281 time spend to save output : 0.15719270706176758 total time spend for step 4 : 14.981602191925049 step5:crop_condition Fri Mar 7 18:21:24 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 3 ! batch 1 Loaded 343 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 116 About to insert : list_path_to_insert length 116 new photo from crops ! About to upload 116 photos upload in portfolio : 4869462 init cache_photo without model_param we have 116 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741368086_4093161 we have uploaded 116 photos in the portfolio 4869462 time of upload the photos Elapsed time : 27.531397342681885 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 41 About to insert : list_path_to_insert length 41 new photo from crops ! About to upload 41 photos upload in portfolio : 4869462 init cache_photo without model_param we have 41 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741368115_4093161 we have uploaded 41 photos in the portfolio 4869462 time of upload the photos Elapsed time : 11.273501634597778 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 3 About to insert : list_path_to_insert length 3 new photo from crops ! About to upload 3 photos upload in portfolio : 4869462 init cache_photo without model_param we have 3 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741368126_4093161 we have uploaded 3 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.0537407398223877 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 21 About to insert : list_path_to_insert length 21 new photo from crops ! About to upload 21 photos upload in portfolio : 4869462 init cache_photo without model_param we have 21 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741368128_4093161 we have uploaded 21 photos in the portfolio 4869462 time of upload the photos Elapsed time : 5.595258951187134 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 32 About to insert : list_path_to_insert length 32 new photo from crops ! About to upload 32 photos upload in portfolio : 4869462 init cache_photo without model_param we have 32 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1741368134_4093161 we have uploaded 32 photos in the portfolio 4869462 time of upload the photos Elapsed time : 8.269397258758545 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1341454721, 1341454718, 1341454707] Looping around the photos to save general results len do output : 213 /1341523768Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523769Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523770Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523771Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523772Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523773Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523774Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523775Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523776Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523777Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523778Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523779Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523780Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523781Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523782Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523783Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523784Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523785Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523786Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523788Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523789Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523791Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523793Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523795Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523797Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523799Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523800Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523801Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523802Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523803Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523804Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523805Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523806Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523807Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523808Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523809Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523810Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523811Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523812Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523813Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523814Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523815Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523816Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523817Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523818Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523820Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523821Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523822Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523823Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523824Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523825Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523826Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523827Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523828Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523829Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523830Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523831Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523832Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523833Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523834Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523835Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523836Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523837Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523838Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523839Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523840Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523841Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523842Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523843Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523844Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523845Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523847Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523848Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523849Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523850Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523851Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523852Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523853Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523854Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523855Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523856Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523857Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523858Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523859Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523860Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523861Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523862Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523863Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523864Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523865Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523866Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523867Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523868Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523869Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523870Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523871Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523872Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523874Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523875Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523876Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523877Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523878Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523879Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523881Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523882Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523883Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523884Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523885Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523886Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523887Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523888Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523889Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523890Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523891Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523892Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523894Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523899Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523900Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523901Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523902Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523903Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523904Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523905Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523906Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523907Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523908Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523909Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523910Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523911Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523912Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523913Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523914Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523915Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523916Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523917Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523918Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523919Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523920Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523921Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523922Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523923Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523924Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523925Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523926Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523927Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523928Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523929Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523930Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523931Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523932Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523933Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523934Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523935Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523936Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523937Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523938Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523939Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523941Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523942Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523943Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523945Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523946Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523947Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523948Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523949Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523950Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523951Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523952Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523953Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523954Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523955Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523956Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523957Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523958Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523959Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523960Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523961Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523962Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523963Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523964Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523966Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523975Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523976Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523977Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523978Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523979Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523980Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523981Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523982Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523983Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523984Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523985Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523986Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523987Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523989Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523990Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523992Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523993Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523994Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523996Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523997Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523998Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341523999Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341524000Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341524001Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341524002Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341524003Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341524004Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341524005Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341524006Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341524007Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341524008Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1341524009Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2648740') ('4234', '21146286', '1341454721', None, None, None, None, None, '2648740') ('4234', None, None, None, None, None, None, None, '2648740') ('4234', '21146286', '1341454718', None, None, None, None, None, '2648740') ('4234', None, None, None, None, None, None, None, '2648740') ('4234', '21146286', '1341454707', None, None, None, None, None, '2648740') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 642 time used for this insertion : 0.03981328010559082 save_final save missing photos in datou_result : time spend for datou_step_exec : 58.42046141624451 time spend to save output : 0.04771900177001953 total time spend for step 5 : 58.468180418014526 step6:thcl Fri Mar 7 18:22:22 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.01085662841796875 time to convert the images to numpy array : 0.05199742317199707 time to import caffe and check if the image exist : 0.012528181076049805 time to convert the images to numpy array : 0.05263662338256836 time to import caffe and check if the image exist : 0.010004281997680664 time to convert the images to numpy array : 0.05414271354675293 time to import caffe and check if the image exist : 0.022047996520996094 time to convert the images to numpy array : 0.050522804260253906 time to import caffe and check if the image exist : 0.011380672454833984 time to convert the images to numpy array : 0.0623321533203125 time to import caffe and check if the image exist : 0.013908863067626953 time to convert the images to numpy array : 0.06226682662963867 time to import caffe and check if the image exist : 0.013949871063232422 time to convert the images to numpy array : 0.06450414657592773 time to import caffe and check if the image exist : 0.012175321578979492 time to convert the images to numpy array : 0.06598639488220215 time to import caffe and check if the image exist : 0.019667863845825195 time to convert the images to numpy array : 0.05860710144042969 time to import caffe and check if the image exist : 0.01474905014038086 time to convert the images to numpy array : 0.06405282020568848 total time to convert the images to numpy array : 0.30722594261169434 list photo_ids error: [] list photo_ids correct : [1341523768, 1341523769, 1341523770, 1341523771, 1341523772, 1341523773, 1341523774, 1341523775, 1341523776, 1341523777, 1341523778, 1341523779, 1341523780, 1341523781, 1341523782, 1341523783, 1341523784, 1341523785, 1341523786, 1341523788, 1341523789, 1341523791, 1341523864, 1341523865, 1341523866, 1341523867, 1341523868, 1341523869, 1341523870, 1341523871, 1341523872, 1341523874, 1341523875, 1341523876, 1341523877, 1341523878, 1341523879, 1341523881, 1341523882, 1341523883, 1341523884, 1341523885, 1341523886, 1341523887, 1341523994, 1341523996, 1341523997, 1341523998, 1341523999, 1341524000, 1341524001, 1341524002, 1341524003, 1341524004, 1341524005, 1341524006, 1341524007, 1341524008, 1341524009, 1341523818, 1341523820, 1341523821, 1341523822, 1341523823, 1341523824, 1341523825, 1341523826, 1341523827, 1341523828, 1341523829, 1341523830, 1341523831, 1341523832, 1341523833, 1341523834, 1341523835, 1341523836, 1341523837, 1341523838, 1341523839, 1341523840, 1341523937, 1341523938, 1341523939, 1341523941, 1341523942, 1341523943, 1341523945, 1341523946, 1341523947, 1341523948, 1341523949, 1341523950, 1341523951, 1341523952, 1341523953, 1341523954, 1341523955, 1341523956, 1341523957, 1341523958, 1341523959, 1341523960, 1341523841, 1341523842, 1341523843, 1341523844, 1341523845, 1341523847, 1341523848, 1341523849, 1341523850, 1341523851, 1341523852, 1341523853, 1341523854, 1341523855, 1341523856, 1341523857, 1341523858, 1341523859, 1341523860, 1341523861, 1341523862, 1341523863, 1341523793, 1341523795, 1341523797, 1341523799, 1341523800, 1341523801, 1341523802, 1341523803, 1341523804, 1341523805, 1341523806, 1341523807, 1341523808, 1341523809, 1341523810, 1341523811, 1341523812, 1341523813, 1341523814, 1341523815, 1341523816, 1341523817, 1341523888, 1341523889, 1341523890, 1341523891, 1341523892, 1341523894, 1341523899, 1341523900, 1341523901, 1341523902, 1341523903, 1341523904, 1341523905, 1341523906, 1341523907, 1341523908, 1341523909, 1341523910, 1341523911, 1341523912, 1341523913, 1341523914, 1341523915, 1341523916, 1341523917, 1341523918, 1341523919, 1341523920, 1341523921, 1341523922, 1341523923, 1341523924, 1341523925, 1341523926, 1341523927, 1341523928, 1341523929, 1341523930, 1341523931, 1341523932, 1341523933, 1341523934, 1341523935, 1341523936, 1341523961, 1341523962, 1341523963, 1341523964, 1341523966, 1341523975, 1341523976, 1341523977, 1341523978, 1341523979, 1341523980, 1341523981, 1341523982, 1341523983, 1341523984, 1341523985, 1341523986, 1341523987, 1341523989, 1341523990, 1341523992, 1341523993] number of photos to traite : 213 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5941 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5722 max_wait_temp : 1 max_wait : 0 dict_keys(['prob', 'pool5']) time used to do the prepocess of the images : 1.047292709350586 time used to do the prediction : 0.8785078525543213 save descriptor for thcl : 3237 time to traite the descriptors : 1.4914307594299316 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1341523768 To insert : 1341523769 To insert : 1341523770 To insert : 1341523771 To insert : 1341523772 To insert : 1341523773 To insert : 1341523774 To insert : 1341523775 To insert : 1341523776 To insert : 1341523777 To insert : 1341523778 To insert : 1341523779 To insert : 1341523780 To insert : 1341523781 To insert : 1341523782 To insert : 1341523783 To insert : 1341523784 To insert : 1341523785 To insert : 1341523786 To insert : 1341523788 To insert : 1341523789 To insert : 1341523791 To insert : 1341523864 To insert : 1341523865 To insert : 1341523866 To insert : 1341523867 To insert : 1341523868 To insert : 1341523869 To insert : 1341523870 To insert : 1341523871 To insert : 1341523872 To insert : 1341523874 To insert : 1341523875 To insert : 1341523876 To insert : 1341523877 To insert : 1341523878 To insert : 1341523879 To insert : 1341523881 To insert : 1341523882 To insert : 1341523883 To insert : 1341523884 To insert : 1341523885 To insert : 1341523886 To insert : 1341523887 To insert : 1341523994 To insert : 1341523996 To insert : 1341523997 To insert : 1341523998 To insert : 1341523999 To insert : 1341524000 To insert : 1341524001 To insert : 1341524002 To insert : 1341524003 To insert : 1341524004 To insert : 1341524005 To insert : 1341524006 To insert : 1341524007 To insert : 1341524008 To insert : 1341524009 To insert : 1341523818 To insert : 1341523820 To insert : 1341523821 To insert : 1341523822 To insert : 1341523823 To insert : 1341523824 To insert : 1341523825 To insert : 1341523826 To insert : 1341523827 To insert : 1341523828 To insert : 1341523829 To insert : 1341523830 To insert : 1341523831 To insert : 1341523832 To insert : 1341523833 To insert : 1341523834 To insert : 1341523835 To insert : 1341523836 To insert : 1341523837 To insert : 1341523838 To insert : 1341523839 To insert : 1341523840 To insert : 1341523937 To insert : 1341523938 To insert : 1341523939 To insert : 1341523941 To insert : 1341523942 To insert : 1341523943 To insert : 1341523945 To insert : 1341523946 To insert : 1341523947 To insert : 1341523948 To insert : 1341523949 To insert : 1341523950 To insert : 1341523951 To insert : 1341523952 To insert : 1341523953 To insert : 1341523954 To insert : 1341523955 To insert : 1341523956 To insert : 1341523957 To insert : 1341523958 To insert : 1341523959 To insert : 1341523960 To insert : 1341523841 To insert : 1341523842 To insert : 1341523843 To insert : 1341523844 To insert : 1341523845 To insert : 1341523847 To insert : 1341523848 To insert : 1341523849 To insert : 1341523850 To insert : 1341523851 To insert : 1341523852 To insert : 1341523853 To insert : 1341523854 To insert : 1341523855 To insert : 1341523856 To insert : 1341523857 To insert : 1341523858 To insert : 1341523859 To insert : 1341523860 To insert : 1341523861 To insert : 1341523862 To insert : 1341523863 To insert : 1341523793 To insert : 1341523795 To insert : 1341523797 To insert : 1341523799 To insert : 1341523800 To insert : 1341523801 To insert : 1341523802 To insert : 1341523803 To insert : 1341523804 To insert : 1341523805 To insert : 1341523806 To insert : 1341523807 To insert : 1341523808 To insert : 1341523809 To insert : 1341523810 To insert : 1341523811 To insert : 1341523812 To insert : 1341523813 To insert : 1341523814 To insert : 1341523815 To insert : 1341523816 To insert : 1341523817 To insert : 1341523888 To insert : 1341523889 To insert : 1341523890 To insert : 1341523891 To insert : 1341523892 To insert : 1341523894 To insert : 1341523899 To insert : 1341523900 To insert : 1341523901 To insert : 1341523902 To insert : 1341523903 To insert : 1341523904 To insert : 1341523905 To insert : 1341523906 To insert : 1341523907 To insert : 1341523908 To insert : 1341523909 To insert : 1341523910 To insert : 1341523911 To insert : 1341523912 To insert : 1341523913 To insert : 1341523914 To insert : 1341523915 To insert : 1341523916 To insert : 1341523917 To insert : 1341523918 To insert : 1341523919 To insert : 1341523920 To insert : 1341523921 To insert : 1341523922 To insert : 1341523923 To insert : 1341523924 To insert : 1341523925 To insert : 1341523926 To insert : 1341523927 To insert : 1341523928 To insert : 1341523929 To insert : 1341523930 To insert : 1341523931 To insert : 1341523932 To insert : 1341523933 To insert : 1341523934 To insert : 1341523935 To insert : 1341523936 To insert : 1341523961 To insert : 1341523962 To insert : 1341523963 To insert : 1341523964 To insert : 1341523966 To insert : 1341523975 To insert : 1341523976 To insert : 1341523977 To insert : 1341523978 To insert : 1341523979 To insert : 1341523980 To insert : 1341523981 To insert : 1341523982 To insert : 1341523983 To insert : 1341523984 To insert : 1341523985 To insert : 1341523986 To insert : 1341523987 To insert : 1341523989 To insert : 1341523990 To insert : 1341523992 To insert : 1341523993 time to insert the descriptors : 40.27797818183899 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 331 time used for this insertion : 0.028594017028808594 save missing photos in datou_result : time spend for datou_step_exec : 48.151668310165405 time spend to save output : 0.08478069305419922 total time spend for step 6 : 48.236449003219604 step7:ventilate_hashtags_in_portfolio Fri Mar 7 18:23:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 21146286 get user id for portfolio 21146286 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21146286 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','Carton','PET_clair','PET_fonce','Tetrapak','PEHD','metal','pet_clair','papier','refus','autre','Film_plastique','carton','flou','environnement','pet_fonce','mal_croppe','Papier')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21146286 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','Carton','PET_clair','PET_fonce','Tetrapak','PEHD','metal','pet_clair','papier','refus','autre','Film_plastique','carton','flou','environnement','pet_fonce','mal_croppe','Papier')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21146286 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','Carton','PET_clair','PET_fonce','Tetrapak','PEHD','metal','pet_clair','papier','refus','autre','Film_plastique','carton','flou','environnement','pet_fonce','mal_croppe','Papier')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21146286 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pehd','Carton','PET_clair','PET_fonce','Tetrapak','PEHD','metal','pet_clair','papier','refus','autre','Film_plastique','carton','flou','environnement','pet_fonce','mal_croppe','Papier')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/21152261,21152268,21152263,21152271,21152260,21152262,21152273,21152265,21152266,21152267,21152269,21152270,21152272?tags=pehd,carton,pet_clair,pet_fonce,tetrapak,metal,papier,refus,autre,film_plastique,flou,environnement,mal_croppe&datou_id_consolidate=4235&port_consolidate=21146286 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1341454721, 1341454718, 1341454707] Looping around the photos to save general results len do output : 1 /21146286. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2648740') ('4234', '21146286', '1341454721', None, None, None, None, None, '2648740') ('4234', None, None, None, None, None, None, None, '2648740') ('4234', '21146286', '1341454718', None, None, None, None, None, '2648740') ('4234', None, None, None, None, None, None, None, '2648740') ('4234', '21146286', '1341454707', None, None, None, None, None, '2648740') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.011892557144165039 save_final save missing photos in datou_result : time spend for datou_step_exec : 2.3629159927368164 time spend to save output : 0.01217031478881836 total time spend for step 7 : 2.3750863075256348 step8:final Fri Mar 7 18:23:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1341454721: ('0.1721651138393268',), 1341454718: ('0.1721651138393268',), 1341454707: ('0.1721651138393268',)} new output for save of step final : {1341454721: ('0.1721651138393268',), 1341454718: ('0.1721651138393268',), 1341454707: ('0.1721651138393268',)} [1341454721, 1341454718, 1341454707] Looping around the photos to save general results len do output : 3 /1341454721.Didn't retrieve data . /1341454718.Didn't retrieve data . /1341454707.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2648740') ('4234', '21146286', '1341454721', None, None, None, None, None, '2648740') ('4234', None, None, None, None, None, None, None, '2648740') ('4234', '21146286', '1341454718', None, None, None, None, None, '2648740') ('4234', None, None, None, None, None, None, None, '2648740') ('4234', '21146286', '1341454707', None, None, None, None, None, '2648740') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 9 time used for this insertion : 0.012228012084960938 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.1261155605316162 time spend to save output : 0.0124969482421875 total time spend for step 8 : 0.1386125087738037 step9:velours_tree Fri Mar 7 18:23:13 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 21152261,21152268,21152263,21152271,21152260,21152262,21152273,21152265,21152266,21152267,21152269,21152270,21152272 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21152261 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21152268 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21152263 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21152271 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21152260 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21152262 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21152273 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21152265 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21152266 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21152267 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21152269 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21152270 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21152272 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 213 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [2 3 3 0 0 2 3 2 1 2 3 2 4 3 2 3 3 3 2 3 3 2 3 2 3 3 4 2 2 3 3 4 1 2 3 3 4 0 0 0 2 3 0 0 2 2 3 3 3 3 3 3 3 3 3 3 3 2 3 3 3 2 2 3 3 2 3 3 4 3 0 0 0 2 3 2 3 0 4 3 2 3 0 2 4 1 3 4 3 2 2 3 2 3 3 3 3 3 3 2 3 3 3 2 2 2 2 2 3 3 1 1 4 3 4 3 1 3 2 1 5 1 0 0 3 3 4 2 2 0 4 1 5 0 2 3 3 2 1 4 4 5 1 1 3 5 3 3 2 2 3 3 0 0 3 5 1 4 4 4 3 3 0 4 2 3 3 3 3 0 3 4 0 1 1 4 3 0 0 1 0 5 5 2 4 2 2 1 1 2 1 5 5 3 2 3 1 1 1 2 1 1 5 0 4 2 1 1 1 2 2 1 1] Elapsed time: 0.04051399230957031 graph_id used : 81924 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/21152261,21152268,21152263,21152271,21152260,21152262,21152273,21152265,21152266,21152267,21152269,21152270,21152272?tags=pehd,carton,pet_clair,pet_fonce,tetrapak,metal,papier,refus,autre,film_plastique,flou,environnement,mal_croppe&datou_id_consolidate=4235&port_consolidate=21146286&tree_id=81924 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1341454721, 1341454718, 1341454707] Looping around the photos to save general results len do output : 1 /21146286Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2648740') ('4234', '21146286', '1341454721', None, None, None, None, None, '2648740') ('4234', None, None, None, None, None, None, None, '2648740') ('4234', '21146286', '1341454718', None, None, None, None, None, '2648740') ('4234', None, None, None, None, None, None, None, '2648740') ('4234', '21146286', '1341454707', None, None, None, None, None, '2648740') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.012085437774658203 save_final save missing photos in datou_result : time spend for datou_step_exec : 14.293766975402832 time spend to save output : 0.012374639511108398 total time spend for step 9 : 14.30614161491394 step10:send_mail_cod Fri Mar 7 18:23:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 Inconsistent number of input and output, step which parrallelize and manage error in input by avoiding sending an output for this data can't be used in tree dependencies of input and output complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P21146286_07-03-2025_18_23_27.pdf 21152243 imagette211522431741368207 21152250 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211522501741368207 21152245 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211522451741368210 21152253 imagette211522531741368210 21152242 imagette211522421741368210 21152244 change filename to text .change filename to text .change filename to text .imagette211522441741368210 21152255 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211522551741368211 21152247 imagette211522471741368212 21152248 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette211522481741368212 21152249 imagette211522491741368213 21152251 imagette211522511741368213 21152254 imagette211522541741368213 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=21146286 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/21152261,21152268,21152263,21152271,21152260,21152262,21152273,21152265,21152266,21152267,21152269,21152270,21152272?tags=pehd,carton,pet_clair,pet_fonce,tetrapak,metal,papier,refus,autre,film_plastique,flou,environnement,mal_croppe&datou_id_consolidate=4235&port_consolidate=21146286&tree_id=81924 your option no_mail is active, we will not send the real mail to your client args[1341454721] : ((1341454721, -7.43839911067332, 492609224), (1341454721, -0.29420479014454715, 496442774), '0.1721651138393268') We are sending mail with results at cod@fotonower.com args[1341454718] : ((1341454718, -7.370720652631866, 492609224), (1341454718, -0.30126922470531736, 496442774), '0.1721651138393268') We are sending mail with results at cod@fotonower.com args[1341454707] : ((1341454707, -7.331337583153891, 492609224), (1341454707, -0.31737401762543865, 496442774), '0.1721651138393268') We are sending mail with results at cod@fotonower.com refus_total : 0.1721651138393268 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=21146286 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21146286_07-03-2025_18_23_27.pdf results_Qualipapia_P21146286_07-03-2025_18_23_27.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21146286_07-03-2025_18_23_27.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','21146286','results_Qualipapia_P21146286_07-03-2025_18_23_27.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21146286_07-03-2025_18_23_27.pdf','pdf','','0.17','0.1721651138393268') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1341454721, 1341454718, 1341454707] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2648740') ('4234', '21146286', '1341454721', None, None, None, None, None, '2648740') ('4234', None, None, None, None, None, None, None, '2648740') ('4234', '21146286', '1341454718', None, None, None, None, None, '2648740') ('4234', None, None, None, None, None, None, None, '2648740') ('4234', '21146286', '1341454707', None, None, None, None, None, '2648740') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.012507438659667969 save_final save missing photos in datou_result : time spend for datou_step_exec : 6.2239670753479 time spend to save output : 0.01286005973815918 total time spend for step 10 : 6.23682713508606 step11:split_time_score Fri Mar 7 18:23:34 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 3),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 07032025 21146286 Nombre de photos uploadées : 3 / 23040 (0%) 07032025 21146286 Nombre de photos taguées (types de déchets): 3 / 3 (100%) 07032025 21146286 Nombre de photos taguées (volume) : 0 / 3 (0%) elapsed_time : load_data_split_time_score 2.384185791015625e-06 elapsed_time : order_list_meta_photo_and_scores 1.2636184692382812e-05 ??? elapsed_time : fill_and_build_computed_from_old_data 0.00032973289489746094 elapsed_time : insert_dashboard_record_day_entry 0.021626949310302734 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21140557 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21140557 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21140558 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21140559 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21140559 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21140560 order by id desc limit 1 Qualite : 0.1918403156698496 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21140561_07-03-2025_12_49_14.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21140561 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21140561 AND mptpi.`type`=4230 To do Qualite : 0.22789197218835494 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21140562_07-03-2025_13_49_36.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21140562 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21140562 AND mptpi.`type`=4230 To do Qualite : 0.1826647347275418 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21140563_07-03-2025_13_33_45.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21140563 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21140563 AND mptpi.`type`=4230 To do Qualite : 0.1831975423051614 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21149331_07-03-2025_17_46_53.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21149331 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21149331 AND mptpi.`type`=4230 To do Qualite : 0.19419449498175256 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21149332_07-03-2025_17_05_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21149332 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21149332 AND mptpi.`type`=4230 To do Qualite : 0.18331065415852607 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21149333_07-03-2025_17_46_31.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21149333 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21149333 AND mptpi.`type`=4230 To do Qualite : 0.21527227756058015 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21149334_07-03-2025_17_43_28.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21149334 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21149334 AND mptpi.`type`=4230 To do Qualite : 0.15854280500006754 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21147782_07-03-2025_16_47_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21147782 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21147782 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21146284 order by id desc limit 1 Qualite : 0.20107374162194588 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21146285_07-03-2025_18_18_43.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21146285 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21146285 AND mptpi.`type`=4230 To do Qualite : 0.1721651138393268 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21146286_07-03-2025_18_23_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21146286 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21146286 AND mptpi.`type`=4230 To do Qualite : 0.2117072972730678 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21146287_07-03-2025_17_41_58.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21146287 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21146287 AND mptpi.`type`=4230 To do Qualite : 0.15588842481431617 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21146288_07-03-2025_16_33_27.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21146288 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21146288 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21142350 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21142353 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21142355 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21142357 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21142359 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21142360 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21142385 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21142386 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21142411 order by id desc limit 1 Qualite : 0.24199611176401692 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21142412_07-03-2025_15_27_15.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21142412 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21142412 AND mptpi.`type`=4230 To do Qualite : 0.24608345592861575 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21142413_07-03-2025_16_01_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21142413 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21142413 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21141645 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21141647 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21141650 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21141652 order by id desc limit 1 Qualite : 0.20272673253718004 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21141655_07-03-2025_14_24_03.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21141655 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21141655 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21141657 order by id desc limit 1 Qualite : 0.2573227516824144 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21144775_07-03-2025_16_04_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21144775 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21144775 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21144776 order by id desc limit 1 Qualite : 0.2697978766835021 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21144777_07-03-2025_15_50_42.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21144777 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21144777 AND mptpi.`type`=4230 To do Qualite : 0.22169396182177664 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21144780_07-03-2025_15_36_18.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21144780 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21144780 AND mptpi.`type`=4230 To do Qualite : 0.24241363318692774 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21146289_07-03-2025_18_10_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21146289 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21146289 AND mptpi.`type`=4230 To do Qualite : 0.23482423583929876 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21146290_07-03-2025_16_17_51.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21146290 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21146290 AND mptpi.`type`=4230 To do Qualite : 0.22673665169363036 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21146291_07-03-2025_16_08_54.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21146291 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21146291 AND mptpi.`type`=4230 To do Qualite : 0.23303512842268362 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21146292_07-03-2025_16_13_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21146292 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21146292 AND mptpi.`type`=4230 To do Qualite : 0.21978202275570002 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21149336_07-03-2025_17_33_21.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21149336 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21149336 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21149339 order by id desc limit 1 Qualite : 0.2167253657467145 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21149341_07-03-2025_17_17_11.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21149341 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21149341 AND mptpi.`type`=4230 To do Qualite : 0.2410230584487329 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21149344_07-03-2025_17_09_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21149344 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21149344 AND mptpi.`type`=4230 To do Qualite : 0.20978323259808335 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P21149346_07-03-2025_17_04_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 21149346 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21149346 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'07032025': {'nb_upload': 3, 'nb_taggue_class': 3, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1341454721, 1341454718, 1341454707] Looping around the photos to save general results len do output : 1 /21146286Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2648740') ('4234', '21146286', '1341454721', None, None, None, None, None, '2648740') ('4234', None, None, None, None, None, None, None, '2648740') ('4234', '21146286', '1341454718', None, None, None, None, None, '2648740') ('4234', None, None, None, None, None, None, None, '2648740') ('4234', '21146286', '1341454707', None, None, None, None, None, '2648740') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.013497352600097656 save_final save missing photos in datou_result : time spend for datou_step_exec : 19.918355703353882 time spend to save output : 0.013751745223999023 total time spend for step 11 : 19.93210744857788 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 3 set_done_treatment 44.82user 31.31system 3:27.46elapsed 36%CPU (0avgtext+0avgdata 2503232maxresident)k 700968inputs+15664outputs (147major+3175890minor)pagefaults 0swaps