python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 10 -a ' -a 4234 -l 5 ' -s datou_current_4234 -M 0 -S 0 -U 95,95,80 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1665768 load datou : 4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? [(photo_id, hashtag_id, hashtag_type, x0, x1, y0, y1, score, seg_temp, polygons), ...] was removed should we ? chemin de la photo was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? chemin de la photo was removed should we ? donnée sous forme de texte was removed should we ? [ (photo_id, photo_id_loc, hashtag_type, x0, x1, y0, y1, score), ...] was removed should we ? [ (photo_id_loc, hashtag_id, hashtag_type, x0, x1, y0, y1, score, None), ...] was removed should we ? chemin de la photo was removed should we ? id de la photo (peut être local ou global) was removed should we ? chemin de la photo was removed should we ? (x0, y0, x1, y1) was removed should we ? chemin de la photo was removed should we ? [ (photo_id, hashtag_id_0, score_0), (photo_id, hashtag_id_1, score_1), ...] was removed should we ? output optionnel thcl was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? id de la photo (peut être local ou global) was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de nombre was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? (photo_id, hashtag_id, score_max) was removed should we ? donnée sous forme de texte was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) load thcls load THCL from format json or kwargs add thcl : 2847 in CacheModelConfig load THCL from format json or kwargs add thcl : 3237 in CacheModelConfig load pdts add pdt : 5275 in CacheModelConfig add pdt : 5561 in CacheModelConfig Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4234, datou_cur_ids : ['2577862'] with mtr_portfolio_ids : ['20462422'] and first list_photo_ids : [] new path : /proc/1665768/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! List Step Type Loaded in datou : mask_detect, brightness, blur_detection, rle_unique_nms_with_priority, crop_condition, thcl, ventilate_hashtags_in_portfolio, final, velours_tree, send_mail_cod, split_time_score list_input_json : [] origin We have 1 , BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.31210780143737793 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 11 step1:mask_detect Wed Feb 12 04:20:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Beginning of datou step mask_detect ! save_polygon : True begin detect begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 10774 max_wait_temp : 1 max_wait : 0 gpu_flag : 0 2025-02-12 04:20:33.105891: I tensorflow/core/platform/cpu_feature_guard.cc:143] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA 2025-02-12 04:20:33.131285: I tensorflow/core/platform/profile_utils/cpu_utils.cc:102] CPU Frequency: 3493065000 Hz 2025-02-12 04:20:33.133344: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x7fb238000b60 initialized for platform Host (this does not guarantee that XLA will be used). Devices: 2025-02-12 04:20:33.133401: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): Host, Default Version 2025-02-12 04:20:33.137363: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcuda.so.1 2025-02-12 04:20:33.389674: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x18a67a80 initialized for platform CUDA (this does not guarantee that XLA will be used). Devices: 2025-02-12 04:20:33.389720: I tensorflow/compiler/xla/service/service.cc:176] StreamExecutor device (0): NVIDIA GeForce RTX 2080 Ti, Compute Capability 7.5 2025-02-12 04:20:33.390708: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-12 04:20:33.391030: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-12 04:20:33.393195: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-12 04:20:33.395352: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-12 04:20:33.395678: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-12 04:20:33.398128: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-12 04:20:33.399179: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-12 04:20:33.403714: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-12 04:20:33.405241: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-12 04:20:33.405316: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-12 04:20:33.406064: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-12 04:20:33.406079: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-12 04:20:33.406089: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-12 04:20:33.407439: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) WARNING:tensorflow:From /home/admin/workarea/git/Velours/python/mtr/mask_rcnn/mask_detection.py:69: The name tf.keras.backend.set_session is deprecated. Please use tf.compat.v1.keras.backend.set_session instead. 2025-02-12 04:20:33.664473: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-12 04:20:33.664559: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-12 04:20:33.664581: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-12 04:20:33.664599: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-12 04:20:33.664617: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-12 04:20:33.664635: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-12 04:20:33.664653: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-12 04:20:33.664671: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-12 04:20:33.666231: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-12 04:20:33.667556: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1561] Found device 0 with properties: pciBusID: 0000:41:00.0 name: NVIDIA GeForce RTX 2080 Ti computeCapability: 7.5 coreClock: 1.545GHz coreCount: 68 deviceMemorySize: 10.76GiB deviceMemoryBandwidth: 573.69GiB/s 2025-02-12 04:20:33.667600: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1 2025-02-12 04:20:33.667619: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-12 04:20:33.667637: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcufft.so.10 2025-02-12 04:20:33.667653: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcurand.so.10 2025-02-12 04:20:33.667670: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusolver.so.10 2025-02-12 04:20:33.667687: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcusparse.so.10 2025-02-12 04:20:33.667704: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 2025-02-12 04:20:33.669309: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1703] Adding visible gpu devices: 0 2025-02-12 04:20:33.669340: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1102] Device interconnect StreamExecutor with strength 1 edge matrix: 2025-02-12 04:20:33.669351: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1108] 0 2025-02-12 04:20:33.669361: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1121] 0: N 2025-02-12 04:20:33.670981: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1247] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 9985 MB memory) -> physical GPU (device: 0, name: NVIDIA GeForce RTX 2080 Ti, pci bus id: 0000:41:00.0, compute capability: 7.5) Using TensorFlow backend. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:396: calling crop_and_resize_v1 (from tensorflow.python.ops.image_ops_impl) with box_ind is deprecated and will be removed in a future version. Instructions for updating: box_ind is deprecated, use box_indices instead WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:703: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. WARNING:tensorflow:From /home/admin/workarea/install/Mask_RCNN/model.py:729: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.cast` instead. Inside mask_sub_process Inside mask_detect About to load cache.load_thcl_param To do loadFromThcl(), then load ParamDescType : thcl2847 thcls : [{'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}] thcl {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'} Update svm_hashtag_type_desc : 5275 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5275, 'learn_RUBBIA_REFUS_AMIENS_23', 16384, 25088, 'learn_RUBBIA_REFUS_AMIENS_23', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 1, datetime.datetime(2021, 4, 23, 14, 19, 39), datetime.datetime(2021, 4, 23, 14, 19, 39)) {'thcl': {'id': 2847, 'mtr_user_id': 31, 'name': 'learn_RUBBIA_REFUS_AMIENS_23', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'photo_desc_type': 5275, 'type_classification': 'mask_rcnn', 'hashtag_id_list': '0,0,0,0,0,0,0,0,0'}, 'list_hashtags': ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'], 'list_hashtags_csv': 'background,papier,carton,metal,pet_clair,autre,pehd,pet_fonce,environnement', 'svm_portfolios_learning': '0,0,0,0,0,0,0,0,0', 'photo_hashtag_type': 3594, 'svm_hashtag_type_desc': 5275, 'photo_desc_type': 5275, 'pb_hashtag_id_or_classifier': 0} list_class_names : ['background', 'papier', 'carton', 'metal', 'pet_clair', 'autre', 'pehd', 'pet_fonce', 'environnement'] Configurations: BACKBONE resnet101 BACKBONE_SHAPES [[160 160] [ 80 80] [ 40 40] [ 20 20] [ 10 10]] BACKBONE_STRIDES [4, 8, 16, 32, 64] BATCH_SIZE 1 BBOX_STD_DEV [0.1 0.1 0.2 0.2] DETECTION_MAX_INSTANCES 100 DETECTION_MIN_CONFIDENCE 0.3 DETECTION_NMS_THRESHOLD 0.3 GPU_COUNT 1 IMAGES_PER_GPU 1 IMAGE_MAX_DIM 640 IMAGE_MIN_DIM 640 IMAGE_PADDING True IMAGE_SHAPE [640 640 3] LEARNING_MOMENTUM 0.9 LEARNING_RATE 0.001 LOSS_WEIGHTS {'rpn_class_loss': 1.0, 'rpn_bbox_loss': 1.0, 'mrcnn_class_loss': 1.0, 'mrcnn_bbox_loss': 1.0, 'mrcnn_mask_loss': 1.0} MASK_POOL_SIZE 14 MASK_SHAPE [28, 28] MAX_GT_INSTANCES 100 MEAN_PIXEL [123.7 116.8 103.9] MINI_MASK_SHAPE (56, 56) NAME learn_RUBBIA_REFUS_AMIENS_23 NUM_CLASSES 9 POOL_SIZE 7 POST_NMS_ROIS_INFERENCE 1000 POST_NMS_ROIS_TRAINING 2000 ROI_POSITIVE_RATIO 0.33 RPN_ANCHOR_RATIOS [0.5, 1, 2] RPN_ANCHOR_SCALES (16, 32, 64, 128, 256) RPN_ANCHOR_STRIDE 1 RPN_BBOX_STD_DEV [0.1 0.1 0.2 0.2] RPN_NMS_THRESHOLD 0.7 RPN_TRAIN_ANCHORS_PER_IMAGE 256 STEPS_PER_EPOCH 1000 TRAIN_ROIS_PER_IMAGE 200 USE_MINI_MASK True USE_RPN_ROIS True VALIDATION_STEPS 50 WEIGHT_DECAY 0.0001 model_param file didn't exist model_name : learn_RUBBIA_REFUS_AMIENS_23 model_type : mask_rcnn list file need : ['mask_model.h5'] file exist in s3 : ['mask_model.h5'] file manque in s3 : [] 2025-02-12 04:20:40.727054: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcublas.so.10 2025-02-12 04:20:40.880695: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudnn.so.7 local folder : /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23 /data/models_weight/learn_RUBBIA_REFUS_AMIENS_23/mask_model.h5 size_local : 256009536 size in s3 : 256009536 create time local : 2021-08-09 09:43:22 create time in s3 : 2021-08-06 18:54:04 mask_model.h5 already exist and didn't need to update list_images length : 1 NEW PHOTO pour l'instant on ne peut pas sauvegarder la photo dans les tile Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.91094 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 7 time for calcul the mask position with numpy : 9.655952453613281e-05 nb_pixel_total : 340 time to create 1 rle with old method : 0.0008528232574462891 length of segment : 18 time for calcul the mask position with numpy : 5.698204040527344e-05 nb_pixel_total : 269 time to create 1 rle with old method : 0.0006170272827148438 length of segment : 26 time for calcul the mask position with numpy : 7.128715515136719e-05 nb_pixel_total : 474 time to create 1 rle with old method : 0.003644704818725586 length of segment : 47 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 331 time to create 1 rle with old method : 0.0007433891296386719 length of segment : 24 time for calcul the mask position with numpy : 0.00029206275939941406 nb_pixel_total : 8146 time to create 1 rle with old method : 0.02401566505432129 length of segment : 235 time for calcul the mask position with numpy : 7.867813110351562e-05 nb_pixel_total : 341 time to create 1 rle with old method : 0.0006530284881591797 length of segment : 21 time for calcul the mask position with numpy : 0.0003802776336669922 nb_pixel_total : 17274 time to create 1 rle with old method : 0.02650308609008789 length of segment : 217 Processing 1 images image shape: (400, 400, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -115.53984 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 234 time to create 1 rle with old method : 0.0003581047058105469 length of segment : 18 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002503395080566406 length of segment : 27 time for calcul the mask position with numpy : 0.000263214111328125 nb_pixel_total : 17211 time to create 1 rle with old method : 0.021279573440551758 length of segment : 148 time for calcul the mask position with numpy : 0.0002052783966064453 nb_pixel_total : 12057 time to create 1 rle with old method : 0.015293121337890625 length of segment : 138 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 823 time to create 1 rle with old method : 0.0012454986572265625 length of segment : 59 Processing 1 images image shape: (400, 400, 3) min: 2.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -113.57891 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 6 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 1311 time to create 1 rle with old method : 0.002600431442260742 length of segment : 31 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 358 time to create 1 rle with old method : 0.0007622241973876953 length of segment : 18 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 546 time to create 1 rle with old method : 0.001055002212524414 length of segment : 39 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 705 time to create 1 rle with old method : 0.0013799667358398438 length of segment : 26 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 271 time to create 1 rle with old method : 0.0005905628204345703 length of segment : 16 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 700 time to create 1 rle with old method : 0.0013453960418701172 length of segment : 27 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.90313 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 14 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 667 time to create 1 rle with old method : 0.0009622573852539062 length of segment : 41 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 436 time to create 1 rle with old method : 0.0006232261657714844 length of segment : 31 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 614 time to create 1 rle with old method : 0.0008432865142822266 length of segment : 55 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 727 time to create 1 rle with old method : 0.0009891986846923828 length of segment : 43 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 630 time to create 1 rle with old method : 0.0008513927459716797 length of segment : 29 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 276 time to create 1 rle with old method : 0.00043010711669921875 length of segment : 22 time for calcul the mask position with numpy : 7.891654968261719e-05 nb_pixel_total : 1851 time to create 1 rle with old method : 0.002352476119995117 length of segment : 67 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 306 time to create 1 rle with old method : 0.0004711151123046875 length of segment : 24 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 686 time to create 1 rle with old method : 0.0010614395141601562 length of segment : 30 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 125 time to create 1 rle with old method : 0.00019812583923339844 length of segment : 17 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 336 time to create 1 rle with old method : 0.0005283355712890625 length of segment : 20 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 425 time to create 1 rle with old method : 0.0005846023559570312 length of segment : 29 time for calcul the mask position with numpy : 4.3392181396484375e-05 nb_pixel_total : 1042 time to create 1 rle with old method : 0.0013949871063232422 length of segment : 27 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 1013 time to create 1 rle with old method : 0.0013775825500488281 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.88750 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (400, 400, 3) min: 5.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -111.96953 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 389 time to create 1 rle with old method : 0.0007119178771972656 length of segment : 22 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 160.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 51.24844 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 0.00035643577575683594 nb_pixel_total : 26438 time to create 1 rle with old method : 0.03132295608520508 length of segment : 404 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.79375 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 15 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 384 time to create 1 rle with old method : 0.0005631446838378906 length of segment : 32 time for calcul the mask position with numpy : 5.173683166503906e-05 nb_pixel_total : 1330 time to create 1 rle with old method : 0.0017821788787841797 length of segment : 44 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 665 time to create 1 rle with old method : 0.0009109973907470703 length of segment : 39 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 623 time to create 1 rle with old method : 0.0009059906005859375 length of segment : 33 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 637 time to create 1 rle with old method : 0.0009322166442871094 length of segment : 29 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 429 time to create 1 rle with old method : 0.0006000995635986328 length of segment : 29 time for calcul the mask position with numpy : 5.0067901611328125e-05 nb_pixel_total : 1071 time to create 1 rle with old method : 0.0014374256134033203 length of segment : 68 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 232 time to create 1 rle with old method : 0.0003521442413330078 length of segment : 17 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 1354 time to create 1 rle with old method : 0.001806020736694336 length of segment : 55 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.0003139972686767578 length of segment : 18 time for calcul the mask position with numpy : 5.7220458984375e-05 nb_pixel_total : 1350 time to create 1 rle with old method : 0.0018374919891357422 length of segment : 56 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.0003714561462402344 length of segment : 18 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 136 time to create 1 rle with old method : 0.0002853870391845703 length of segment : 27 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 386 time to create 1 rle with old method : 0.0005586147308349609 length of segment : 18 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 310 time to create 1 rle with old method : 0.0004944801330566406 length of segment : 17 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -119.48906 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 29 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 944 time to create 1 rle with old method : 0.0012631416320800781 length of segment : 40 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 1467 time to create 1 rle with old method : 0.0019497871398925781 length of segment : 56 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 256 time to create 1 rle with old method : 0.0003650188446044922 length of segment : 23 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 692 time to create 1 rle with old method : 0.0009860992431640625 length of segment : 41 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 254 time to create 1 rle with old method : 0.0003838539123535156 length of segment : 17 time for calcul the mask position with numpy : 4.8160552978515625e-05 nb_pixel_total : 947 time to create 1 rle with old method : 0.0012884140014648438 length of segment : 45 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 374 time to create 1 rle with old method : 0.0005414485931396484 length of segment : 23 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 255 time to create 1 rle with old method : 0.0004069805145263672 length of segment : 21 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 244 time to create 1 rle with old method : 0.0003800392150878906 length of segment : 18 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 1361 time to create 1 rle with old method : 0.0017817020416259766 length of segment : 47 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 887 time to create 1 rle with old method : 0.0011906623840332031 length of segment : 44 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 2017 time to create 1 rle with old method : 0.002570629119873047 length of segment : 51 time for calcul the mask position with numpy : 6.747245788574219e-05 nb_pixel_total : 2137 time to create 1 rle with old method : 0.002734661102294922 length of segment : 73 time for calcul the mask position with numpy : 8.368492126464844e-05 nb_pixel_total : 2400 time to create 1 rle with old method : 0.003103017807006836 length of segment : 76 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 402 time to create 1 rle with old method : 0.0005702972412109375 length of segment : 25 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 674 time to create 1 rle with old method : 0.0009579658508300781 length of segment : 26 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 362 time to create 1 rle with old method : 0.00047206878662109375 length of segment : 34 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 1095 time to create 1 rle with old method : 0.0013706684112548828 length of segment : 37 time for calcul the mask position with numpy : 2.7179718017578125e-05 nb_pixel_total : 92 time to create 1 rle with old method : 0.0001366138458251953 length of segment : 19 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 364 time to create 1 rle with old method : 0.0005679130554199219 length of segment : 15 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 520 time to create 1 rle with old method : 0.0007252693176269531 length of segment : 29 time for calcul the mask position with numpy : 4.76837158203125e-05 nb_pixel_total : 1051 time to create 1 rle with old method : 0.0013387203216552734 length of segment : 49 time for calcul the mask position with numpy : 3.0994415283203125e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.0004055500030517578 length of segment : 17 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 137 time to create 1 rle with old method : 0.0002219676971435547 length of segment : 16 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 248 time to create 1 rle with old method : 0.0003783702850341797 length of segment : 21 time for calcul the mask position with numpy : 7.152557373046875e-05 nb_pixel_total : 2538 time to create 1 rle with old method : 0.0033240318298339844 length of segment : 71 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 823 time to create 1 rle with old method : 0.0011646747589111328 length of segment : 39 time for calcul the mask position with numpy : 5.14984130859375e-05 nb_pixel_total : 937 time to create 1 rle with old method : 0.0012478828430175781 length of segment : 50 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 1016 time to create 1 rle with old method : 0.0013916492462158203 length of segment : 37 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -112.44609 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 30 time for calcul the mask position with numpy : 0.00010657310485839844 nb_pixel_total : 1092 time to create 1 rle with old method : 0.0018949508666992188 length of segment : 43 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 312 time to create 1 rle with old method : 0.00044155120849609375 length of segment : 33 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 354 time to create 1 rle with old method : 0.0007271766662597656 length of segment : 27 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 1097 time to create 1 rle with old method : 0.0015654563903808594 length of segment : 40 time for calcul the mask position with numpy : 4.458427429199219e-05 nb_pixel_total : 408 time to create 1 rle with old method : 0.0005846023559570312 length of segment : 34 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 825 time to create 1 rle with old method : 0.001203775405883789 length of segment : 44 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 211 time to create 1 rle with old method : 0.00034499168395996094 length of segment : 12 time for calcul the mask position with numpy : 8.153915405273438e-05 nb_pixel_total : 1219 time to create 1 rle with old method : 0.0023660659790039062 length of segment : 52 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 217 time to create 1 rle with old method : 0.000347137451171875 length of segment : 20 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 378 time to create 1 rle with old method : 0.0006697177886962891 length of segment : 27 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 270 time to create 1 rle with old method : 0.00041985511779785156 length of segment : 19 time for calcul the mask position with numpy : 7.486343383789062e-05 nb_pixel_total : 2163 time to create 1 rle with old method : 0.002952098846435547 length of segment : 57 time for calcul the mask position with numpy : 6.723403930664062e-05 nb_pixel_total : 2043 time to create 1 rle with old method : 0.002742767333984375 length of segment : 70 time for calcul the mask position with numpy : 8.96453857421875e-05 nb_pixel_total : 2163 time to create 1 rle with old method : 0.002973318099975586 length of segment : 70 time for calcul the mask position with numpy : 4.363059997558594e-05 nb_pixel_total : 276 time to create 1 rle with old method : 0.0003705024719238281 length of segment : 29 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 401 time to create 1 rle with old method : 0.0005960464477539062 length of segment : 21 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 226 time to create 1 rle with old method : 0.0003666877746582031 length of segment : 14 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 857 time to create 1 rle with old method : 0.0011425018310546875 length of segment : 39 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 1438 time to create 1 rle with old method : 0.002331256866455078 length of segment : 47 time for calcul the mask position with numpy : 3.814697265625e-05 nb_pixel_total : 252 time to create 1 rle with old method : 0.0003342628479003906 length of segment : 45 time for calcul the mask position with numpy : 3.1948089599609375e-05 nb_pixel_total : 177 time to create 1 rle with old method : 0.0003409385681152344 length of segment : 9 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 620 time to create 1 rle with old method : 0.0008072853088378906 length of segment : 29 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 817 time to create 1 rle with old method : 0.0011165142059326172 length of segment : 39 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 891 time to create 1 rle with old method : 0.0011191368103027344 length of segment : 36 time for calcul the mask position with numpy : 7.081031799316406e-05 nb_pixel_total : 2109 time to create 1 rle with old method : 0.002757549285888672 length of segment : 55 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 131 time to create 1 rle with old method : 0.00018072128295898438 length of segment : 40 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 94 time to create 1 rle with old method : 0.0001652240753173828 length of segment : 22 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 197 time to create 1 rle with old method : 0.0004165172576904297 length of segment : 16 time for calcul the mask position with numpy : 6.580352783203125e-05 nb_pixel_total : 1092 time to create 1 rle with old method : 0.0014846324920654297 length of segment : 88 time for calcul the mask position with numpy : 0.0001289844512939453 nb_pixel_total : 1290 time to create 1 rle with old method : 0.001859426498413086 length of segment : 35 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.61016 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 41 time for calcul the mask position with numpy : 7.724761962890625e-05 nb_pixel_total : 257 time to create 1 rle with old method : 0.0004019737243652344 length of segment : 19 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 201 time to create 1 rle with old method : 0.0003046989440917969 length of segment : 22 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 708 time to create 1 rle with old method : 0.0010395050048828125 length of segment : 23 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 233 time to create 1 rle with old method : 0.0003566741943359375 length of segment : 16 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 766 time to create 1 rle with old method : 0.001081705093383789 length of segment : 39 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 1054 time to create 1 rle with old method : 0.0014247894287109375 length of segment : 37 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 265 time to create 1 rle with old method : 0.0003807544708251953 length of segment : 29 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 591 time to create 1 rle with old method : 0.0008344650268554688 length of segment : 38 time for calcul the mask position with numpy : 9.298324584960938e-05 nb_pixel_total : 1252 time to create 1 rle with old method : 0.001718282699584961 length of segment : 73 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 1015 time to create 1 rle with old method : 0.0013239383697509766 length of segment : 44 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 238 time to create 1 rle with old method : 0.00040459632873535156 length of segment : 15 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 321 time to create 1 rle with old method : 0.00045752525329589844 length of segment : 28 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 301 time to create 1 rle with old method : 0.0004563331604003906 length of segment : 18 time for calcul the mask position with numpy : 8.153915405273438e-05 nb_pixel_total : 1928 time to create 1 rle with old method : 0.0026552677154541016 length of segment : 51 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 118 time to create 1 rle with old method : 0.0002052783966064453 length of segment : 11 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 1233 time to create 1 rle with old method : 0.0015676021575927734 length of segment : 35 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 1952 time to create 1 rle with old method : 0.002553224563598633 length of segment : 51 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 433 time to create 1 rle with old method : 0.0006234645843505859 length of segment : 23 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 390 time to create 1 rle with old method : 0.0006198883056640625 length of segment : 19 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 541 time to create 1 rle with old method : 0.0008122920989990234 length of segment : 36 time for calcul the mask position with numpy : 6.127357482910156e-05 nb_pixel_total : 1506 time to create 1 rle with old method : 0.0018649101257324219 length of segment : 73 time for calcul the mask position with numpy : 4.410743713378906e-05 nb_pixel_total : 466 time to create 1 rle with old method : 0.0007305145263671875 length of segment : 27 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 603 time to create 1 rle with old method : 0.000843048095703125 length of segment : 32 time for calcul the mask position with numpy : 3.409385681152344e-05 nb_pixel_total : 461 time to create 1 rle with old method : 0.0006432533264160156 length of segment : 30 time for calcul the mask position with numpy : 6.437301635742188e-05 nb_pixel_total : 1347 time to create 1 rle with old method : 0.0016989707946777344 length of segment : 55 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 93 time to create 1 rle with old method : 0.0001556873321533203 length of segment : 14 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 370 time to create 1 rle with old method : 0.0005190372467041016 length of segment : 53 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 973 time to create 1 rle with old method : 0.0013349056243896484 length of segment : 36 time for calcul the mask position with numpy : 8.511543273925781e-05 nb_pixel_total : 1914 time to create 1 rle with old method : 0.002618551254272461 length of segment : 51 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 569 time to create 1 rle with old method : 0.0008111000061035156 length of segment : 34 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 268 time to create 1 rle with old method : 0.0003921985626220703 length of segment : 24 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 1355 time to create 1 rle with old method : 0.0018215179443359375 length of segment : 47 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 535 time to create 1 rle with old method : 0.0007863044738769531 length of segment : 23 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 373 time to create 1 rle with old method : 0.0005276203155517578 length of segment : 27 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 407 time to create 1 rle with old method : 0.0006008148193359375 length of segment : 29 time for calcul the mask position with numpy : 4.863739013671875e-05 nb_pixel_total : 330 time to create 1 rle with old method : 0.0006048679351806641 length of segment : 45 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 541 time to create 1 rle with old method : 0.0007891654968261719 length of segment : 22 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 427 time to create 1 rle with old method : 0.0006022453308105469 length of segment : 28 time for calcul the mask position with numpy : 5.984306335449219e-05 nb_pixel_total : 1289 time to create 1 rle with old method : 0.0016603469848632812 length of segment : 55 time for calcul the mask position with numpy : 6.198883056640625e-05 nb_pixel_total : 624 time to create 1 rle with old method : 0.0009794235229492188 length of segment : 57 time for calcul the mask position with numpy : 3.504753112792969e-05 nb_pixel_total : 359 time to create 1 rle with old method : 0.0005068778991699219 length of segment : 26 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.16484 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 20 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 270 time to create 1 rle with old method : 0.00041961669921875 length of segment : 15 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 970 time to create 1 rle with old method : 0.0013294219970703125 length of segment : 60 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 446 time to create 1 rle with old method : 0.0006568431854248047 length of segment : 25 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 790 time to create 1 rle with old method : 0.0012218952178955078 length of segment : 23 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 260 time to create 1 rle with old method : 0.0004076957702636719 length of segment : 12 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 285 time to create 1 rle with old method : 0.0004448890686035156 length of segment : 24 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 473 time to create 1 rle with old method : 0.0006499290466308594 length of segment : 27 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 617 time to create 1 rle with old method : 0.0008785724639892578 length of segment : 46 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 225 time to create 1 rle with old method : 0.0003383159637451172 length of segment : 15 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 517 time to create 1 rle with old method : 0.0007321834564208984 length of segment : 21 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 1078 time to create 1 rle with old method : 0.001627206802368164 length of segment : 46 time for calcul the mask position with numpy : 5.7697296142578125e-05 nb_pixel_total : 1153 time to create 1 rle with old method : 0.0015854835510253906 length of segment : 53 time for calcul the mask position with numpy : 5.245208740234375e-05 nb_pixel_total : 403 time to create 1 rle with old method : 0.0006480216979980469 length of segment : 35 time for calcul the mask position with numpy : 0.0001430511474609375 nb_pixel_total : 3976 time to create 1 rle with old method : 0.006491422653198242 length of segment : 72 time for calcul the mask position with numpy : 6.008148193359375e-05 nb_pixel_total : 376 time to create 1 rle with old method : 0.0006420612335205078 length of segment : 50 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 157 time to create 1 rle with old method : 0.00022912025451660156 length of segment : 21 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 1012 time to create 1 rle with old method : 0.0013766288757324219 length of segment : 37 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 126 time to create 1 rle with old method : 0.0002262592315673828 length of segment : 9 time for calcul the mask position with numpy : 4.744529724121094e-05 nb_pixel_total : 1074 time to create 1 rle with old method : 0.0014729499816894531 length of segment : 41 time for calcul the mask position with numpy : 4.100799560546875e-05 nb_pixel_total : 507 time to create 1 rle with old method : 0.0006957054138183594 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -121.32109 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 13 time for calcul the mask position with numpy : 5.841255187988281e-05 nb_pixel_total : 1212 time to create 1 rle with old method : 0.0016570091247558594 length of segment : 42 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 223 time to create 1 rle with old method : 0.0003437995910644531 length of segment : 22 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1740 time to create 1 rle with old method : 0.0022640228271484375 length of segment : 61 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.00024366378784179688 length of segment : 15 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.00040459632873535156 length of segment : 33 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 119 time to create 1 rle with old method : 0.00021696090698242188 length of segment : 9 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 672 time to create 1 rle with old method : 0.0008854866027832031 length of segment : 44 time for calcul the mask position with numpy : 4.1484832763671875e-05 nb_pixel_total : 467 time to create 1 rle with old method : 0.0007264614105224609 length of segment : 31 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 260 time to create 1 rle with old method : 0.0004372596740722656 length of segment : 18 time for calcul the mask position with numpy : 5.125999450683594e-05 nb_pixel_total : 1260 time to create 1 rle with old method : 0.0017066001892089844 length of segment : 51 time for calcul the mask position with numpy : 3.2901763916015625e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.0003452301025390625 length of segment : 19 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 1896 time to create 1 rle with old method : 0.0024230480194091797 length of segment : 69 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 224 time to create 1 rle with old method : 0.0006129741668701172 length of segment : 19 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 139.71719 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 4 time for calcul the mask position with numpy : 6.556510925292969e-05 nb_pixel_total : 1120 time to create 1 rle with old method : 0.0016570091247558594 length of segment : 78 time for calcul the mask position with numpy : 6.914138793945312e-05 nb_pixel_total : 1271 time to create 1 rle with old method : 0.0018050670623779297 length of segment : 83 time for calcul the mask position with numpy : 4.315376281738281e-05 nb_pixel_total : 735 time to create 1 rle with old method : 0.0009427070617675781 length of segment : 57 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 312 time to create 1 rle with old method : 0.00043272972106933594 length of segment : 24 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.21172 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 4.124641418457031e-05 nb_pixel_total : 296 time to create 1 rle with old method : 0.00045561790466308594 length of segment : 22 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 245 time to create 1 rle with old method : 0.0003986358642578125 length of segment : 13 time for calcul the mask position with numpy : 4.291534423828125e-05 nb_pixel_total : 874 time to create 1 rle with old method : 0.0012040138244628906 length of segment : 36 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 246 time to create 1 rle with old method : 0.0003745555877685547 length of segment : 17 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 159 time to create 1 rle with old method : 0.0003421306610107422 length of segment : 14 time for calcul the mask position with numpy : 3.24249267578125e-05 nb_pixel_total : 250 time to create 1 rle with old method : 0.0003578662872314453 length of segment : 27 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 279 time to create 1 rle with old method : 0.0007333755493164062 length of segment : 24 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 570 time to create 1 rle with old method : 0.0007898807525634766 length of segment : 29 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 554 time to create 1 rle with old method : 0.00078582763671875 length of segment : 31 Processing 1 images image shape: (400, 400, 3) min: 3.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.56328 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 357 time to create 1 rle with old method : 0.0005145072937011719 length of segment : 21 time for calcul the mask position with numpy : 3.6716461181640625e-05 nb_pixel_total : 392 time to create 1 rle with old method : 0.0005650520324707031 length of segment : 27 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 829 time to create 1 rle with old method : 0.0011456012725830078 length of segment : 34 time for calcul the mask position with numpy : 3.4332275390625e-05 nb_pixel_total : 228 time to create 1 rle with old method : 0.0003421306610107422 length of segment : 25 time for calcul the mask position with numpy : 3.147125244140625e-05 nb_pixel_total : 239 time to create 1 rle with old method : 0.0003933906555175781 length of segment : 12 time for calcul the mask position with numpy : 3.8623809814453125e-05 nb_pixel_total : 505 time to create 1 rle with old method : 0.000720977783203125 length of segment : 34 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 389 time to create 1 rle with old method : 0.0005383491516113281 length of segment : 24 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 421 time to create 1 rle with old method : 0.0005807876586914062 length of segment : 32 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 570 time to create 1 rle with old method : 0.0007915496826171875 length of segment : 28 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 321 time to create 1 rle with old method : 0.0004699230194091797 length of segment : 23 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1502 time to create 1 rle with old method : 0.0020329952239990234 length of segment : 49 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 277 time to create 1 rle with old method : 0.00042366981506347656 length of segment : 18 time for calcul the mask position with numpy : 4.482269287109375e-05 nb_pixel_total : 465 time to create 1 rle with old method : 0.0006761550903320312 length of segment : 53 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 1968 time to create 1 rle with old method : 0.002549409866333008 length of segment : 52 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 798 time to create 1 rle with old method : 0.0011200904846191406 length of segment : 30 time for calcul the mask position with numpy : 4.172325134277344e-05 nb_pixel_total : 381 time to create 1 rle with old method : 0.0005295276641845703 length of segment : 58 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 522 time to create 1 rle with old method : 0.000762939453125 length of segment : 18 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.51641 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 5.435943603515625e-05 nb_pixel_total : 393 time to create 1 rle with old method : 0.0005869865417480469 length of segment : 28 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 420 time to create 1 rle with old method : 0.0006680488586425781 length of segment : 19 time for calcul the mask position with numpy : 3.075599670410156e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.00024080276489257812 length of segment : 16 time for calcul the mask position with numpy : 4.4345855712890625e-05 nb_pixel_total : 1134 time to create 1 rle with old method : 0.0015115737915039062 length of segment : 31 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 1106 time to create 1 rle with old method : 0.001508951187133789 length of segment : 36 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 316 time to create 1 rle with old method : 0.0004439353942871094 length of segment : 45 time for calcul the mask position with numpy : 4.57763671875e-05 nb_pixel_total : 1175 time to create 1 rle with old method : 0.0016009807586669922 length of segment : 31 time for calcul the mask position with numpy : 5.5789947509765625e-05 nb_pixel_total : 160 time to create 1 rle with old method : 0.00026679039001464844 length of segment : 29 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 691 time to create 1 rle with old method : 0.0009887218475341797 length of segment : 28 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 1714 time to create 1 rle with old method : 0.0022437572479248047 length of segment : 54 time for calcul the mask position with numpy : 6.175041198730469e-05 nb_pixel_total : 2085 time to create 1 rle with old method : 0.0026845932006835938 length of segment : 49 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 488 time to create 1 rle with old method : 0.0006763935089111328 length of segment : 27 time for calcul the mask position with numpy : 6.794929504394531e-05 nb_pixel_total : 2041 time to create 1 rle with old method : 0.0025534629821777344 length of segment : 107 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 989 time to create 1 rle with old method : 0.001461029052734375 length of segment : 40 time for calcul the mask position with numpy : 3.4809112548828125e-05 nb_pixel_total : 259 time to create 1 rle with old method : 0.0003895759582519531 length of segment : 20 time for calcul the mask position with numpy : 3.552436828613281e-05 nb_pixel_total : 627 time to create 1 rle with old method : 0.0008044242858886719 length of segment : 32 time for calcul the mask position with numpy : 4.9591064453125e-05 nb_pixel_total : 1050 time to create 1 rle with old method : 0.0014522075653076172 length of segment : 37 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -116.37969 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 42 time for calcul the mask position with numpy : 9.775161743164062e-05 nb_pixel_total : 1677 time to create 1 rle with old method : 0.002166271209716797 length of segment : 49 time for calcul the mask position with numpy : 5.53131103515625e-05 nb_pixel_total : 1012 time to create 1 rle with old method : 0.0013887882232666016 length of segment : 62 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 939 time to create 1 rle with old method : 0.0012295246124267578 length of segment : 48 time for calcul the mask position with numpy : 7.343292236328125e-05 nb_pixel_total : 2851 time to create 1 rle with old method : 0.003737211227416992 length of segment : 57 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 291 time to create 1 rle with old method : 0.00043582916259765625 length of segment : 34 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 806 time to create 1 rle with old method : 0.0010998249053955078 length of segment : 30 time for calcul the mask position with numpy : 3.170967102050781e-05 nb_pixel_total : 177 time to create 1 rle with old method : 0.0002739429473876953 length of segment : 17 time for calcul the mask position with numpy : 9.202957153320312e-05 nb_pixel_total : 2951 time to create 1 rle with old method : 0.0037593841552734375 length of segment : 89 time for calcul the mask position with numpy : 0.00016641616821289062 nb_pixel_total : 6816 time to create 1 rle with old method : 0.008517742156982422 length of segment : 205 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 194 time to create 1 rle with old method : 0.00034356117248535156 length of segment : 16 time for calcul the mask position with numpy : 3.719329833984375e-05 nb_pixel_total : 489 time to create 1 rle with old method : 0.0007088184356689453 length of segment : 17 time for calcul the mask position with numpy : 4.839897155761719e-05 nb_pixel_total : 666 time to create 1 rle with old method : 0.0009784698486328125 length of segment : 32 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 1329 time to create 1 rle with old method : 0.0017871856689453125 length of segment : 29 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 923 time to create 1 rle with old method : 0.001260995864868164 length of segment : 38 time for calcul the mask position with numpy : 5.745887756347656e-05 nb_pixel_total : 1545 time to create 1 rle with old method : 0.002080202102661133 length of segment : 44 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 470 time to create 1 rle with old method : 0.0006783008575439453 length of segment : 32 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 560 time to create 1 rle with old method : 0.0008656978607177734 length of segment : 39 time for calcul the mask position with numpy : 4.267692565917969e-05 nb_pixel_total : 1005 time to create 1 rle with old method : 0.0013530254364013672 length of segment : 35 time for calcul the mask position with numpy : 7.772445678710938e-05 nb_pixel_total : 2161 time to create 1 rle with old method : 0.0028252601623535156 length of segment : 49 time for calcul the mask position with numpy : 5.221366882324219e-05 nb_pixel_total : 1079 time to create 1 rle with old method : 0.0014293193817138672 length of segment : 35 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 1092 time to create 1 rle with old method : 0.0014238357543945312 length of segment : 33 time for calcul the mask position with numpy : 0.0001494884490966797 nb_pixel_total : 4861 time to create 1 rle with old method : 0.006036996841430664 length of segment : 119 time for calcul the mask position with numpy : 3.600120544433594e-05 nb_pixel_total : 181 time to create 1 rle with old method : 0.00030303001403808594 length of segment : 18 time for calcul the mask position with numpy : 6.651878356933594e-05 nb_pixel_total : 1574 time to create 1 rle with old method : 0.0024373531341552734 length of segment : 51 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 849 time to create 1 rle with old method : 0.0012869834899902344 length of segment : 34 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 736 time to create 1 rle with old method : 0.000980377197265625 length of segment : 42 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 456 time to create 1 rle with old method : 0.0006759166717529297 length of segment : 28 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 405 time to create 1 rle with old method : 0.0005900859832763672 length of segment : 29 time for calcul the mask position with numpy : 4.673004150390625e-05 nb_pixel_total : 664 time to create 1 rle with old method : 0.0009970664978027344 length of segment : 35 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 313 time to create 1 rle with old method : 0.0005922317504882812 length of segment : 14 time for calcul the mask position with numpy : 6.151199340820312e-05 nb_pixel_total : 583 time to create 1 rle with old method : 0.0008580684661865234 length of segment : 24 time for calcul the mask position with numpy : 6.246566772460938e-05 nb_pixel_total : 965 time to create 1 rle with old method : 0.0013115406036376953 length of segment : 69 time for calcul the mask position with numpy : 5.054473876953125e-05 nb_pixel_total : 857 time to create 1 rle with old method : 0.0012574195861816406 length of segment : 34 time for calcul the mask position with numpy : 4.792213439941406e-05 nb_pixel_total : 852 time to create 1 rle with old method : 0.0011794567108154297 length of segment : 29 time for calcul the mask position with numpy : 6.961822509765625e-05 nb_pixel_total : 1842 time to create 1 rle with old method : 0.002468585968017578 length of segment : 45 time for calcul the mask position with numpy : 5.3882598876953125e-05 nb_pixel_total : 674 time to create 1 rle with old method : 0.0009014606475830078 length of segment : 41 time for calcul the mask position with numpy : 4.7206878662109375e-05 nb_pixel_total : 931 time to create 1 rle with old method : 0.0012600421905517578 length of segment : 30 time for calcul the mask position with numpy : 3.838539123535156e-05 nb_pixel_total : 430 time to create 1 rle with old method : 0.0006420612335205078 length of segment : 18 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 402 time to create 1 rle with old method : 0.0005958080291748047 length of segment : 24 time for calcul the mask position with numpy : 3.933906555175781e-05 nb_pixel_total : 394 time to create 1 rle with old method : 0.0005993843078613281 length of segment : 16 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 748 time to create 1 rle with old method : 0.0010325908660888672 length of segment : 26 time for calcul the mask position with numpy : 4.887580871582031e-05 nb_pixel_total : 1213 time to create 1 rle with old method : 0.0017254352569580078 length of segment : 28 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -122.66094 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 17 time for calcul the mask position with numpy : 5.555152893066406e-05 nb_pixel_total : 605 time to create 1 rle with old method : 0.0008800029754638672 length of segment : 25 time for calcul the mask position with numpy : 4.029273986816406e-05 nb_pixel_total : 341 time to create 1 rle with old method : 0.0005757808685302734 length of segment : 20 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 802 time to create 1 rle with old method : 0.0011513233184814453 length of segment : 43 time for calcul the mask position with numpy : 3.62396240234375e-05 nb_pixel_total : 400 time to create 1 rle with old method : 0.0005674362182617188 length of segment : 23 time for calcul the mask position with numpy : 3.337860107421875e-05 nb_pixel_total : 218 time to create 1 rle with old method : 0.0003535747528076172 length of segment : 19 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 810 time to create 1 rle with old method : 0.0010726451873779297 length of segment : 62 time for calcul the mask position with numpy : 7.343292236328125e-05 nb_pixel_total : 1004 time to create 1 rle with old method : 0.0014259815216064453 length of segment : 111 time for calcul the mask position with numpy : 5.1021575927734375e-05 nb_pixel_total : 930 time to create 1 rle with old method : 0.0012357234954833984 length of segment : 54 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 151 time to create 1 rle with old method : 0.00024080276489257812 length of segment : 16 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 261 time to create 1 rle with old method : 0.0004482269287109375 length of segment : 28 time for calcul the mask position with numpy : 6.842613220214844e-05 nb_pixel_total : 1594 time to create 1 rle with old method : 0.0020453929901123047 length of segment : 69 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 793 time to create 1 rle with old method : 0.0010218620300292969 length of segment : 43 time for calcul the mask position with numpy : 4.5299530029296875e-05 nb_pixel_total : 447 time to create 1 rle with old method : 0.0006537437438964844 length of segment : 48 time for calcul the mask position with numpy : 4.9114227294921875e-05 nb_pixel_total : 944 time to create 1 rle with old method : 0.0012578964233398438 length of segment : 49 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 312 time to create 1 rle with old method : 0.00048089027404785156 length of segment : 16 time for calcul the mask position with numpy : 6.4849853515625e-05 nb_pixel_total : 1594 time to create 1 rle with old method : 0.002047300338745117 length of segment : 69 time for calcul the mask position with numpy : 4.076957702636719e-05 nb_pixel_total : 585 time to create 1 rle with old method : 0.0008203983306884766 length of segment : 26 Processing 1 images image shape: (400, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -120.63359 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 1366 time to create 1 rle with old method : 0.0018475055694580078 length of segment : 53 time for calcul the mask position with numpy : 4.935264587402344e-05 nb_pixel_total : 1199 time to create 1 rle with old method : 0.0015499591827392578 length of segment : 57 time for calcul the mask position with numpy : 6.628036499023438e-05 nb_pixel_total : 1415 time to create 1 rle with old method : 0.001924753189086914 length of segment : 51 time for calcul the mask position with numpy : 8.034706115722656e-05 nb_pixel_total : 2866 time to create 1 rle with old method : 0.0036842823028564453 length of segment : 66 time for calcul the mask position with numpy : 4.601478576660156e-05 nb_pixel_total : 980 time to create 1 rle with old method : 0.0012841224670410156 length of segment : 48 time for calcul the mask position with numpy : 5.078315734863281e-05 nb_pixel_total : 1308 time to create 1 rle with old method : 0.0017256736755371094 length of segment : 48 time for calcul the mask position with numpy : 5.4836273193359375e-05 nb_pixel_total : 1975 time to create 1 rle with old method : 0.0026013851165771484 length of segment : 43 time for calcul the mask position with numpy : 8.988380432128906e-05 nb_pixel_total : 3493 time to create 1 rle with old method : 0.004495143890380859 length of segment : 83 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 82 time to create 1 rle with old method : 0.00021314620971679688 length of segment : 21 Processing 1 images image shape: (400, 160, 3) min: 0.00000 max: 178.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 65.11172 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 0 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 148.26797 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 2 time for calcul the mask position with numpy : 7.677078247070312e-05 nb_pixel_total : 605 time to create 1 rle with old method : 0.0014564990997314453 length of segment : 14 time for calcul the mask position with numpy : 4.982948303222656e-05 nb_pixel_total : 161 time to create 1 rle with old method : 0.0004208087921142578 length of segment : 14 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 16 time for calcul the mask position with numpy : 6.0558319091796875e-05 nb_pixel_total : 771 time to create 1 rle with old method : 0.0012056827545166016 length of segment : 28 time for calcul the mask position with numpy : 8.535385131835938e-05 nb_pixel_total : 2383 time to create 1 rle with old method : 0.0030939579010009766 length of segment : 70 time for calcul the mask position with numpy : 4.649162292480469e-05 nb_pixel_total : 423 time to create 1 rle with old method : 0.0006699562072753906 length of segment : 22 time for calcul the mask position with numpy : 4.506111145019531e-05 nb_pixel_total : 204 time to create 1 rle with old method : 0.0003387928009033203 length of segment : 16 time for calcul the mask position with numpy : 4.00543212890625e-05 nb_pixel_total : 362 time to create 1 rle with old method : 0.0006115436553955078 length of segment : 18 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 76 time to create 1 rle with old method : 0.0001468658447265625 length of segment : 10 time for calcul the mask position with numpy : 4.696846008300781e-05 nb_pixel_total : 357 time to create 1 rle with old method : 0.0005917549133300781 length of segment : 22 time for calcul the mask position with numpy : 0.0001087188720703125 nb_pixel_total : 1253 time to create 1 rle with old method : 0.0018422603607177734 length of segment : 60 time for calcul the mask position with numpy : 4.6253204345703125e-05 nb_pixel_total : 282 time to create 1 rle with old method : 0.0004439353942871094 length of segment : 19 time for calcul the mask position with numpy : 6.079673767089844e-05 nb_pixel_total : 1777 time to create 1 rle with old method : 0.002454996109008789 length of segment : 40 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 85 time to create 1 rle with old method : 0.00019812583923339844 length of segment : 6 time for calcul the mask position with numpy : 3.790855407714844e-05 nb_pixel_total : 110 time to create 1 rle with old method : 0.0002498626708984375 length of segment : 11 time for calcul the mask position with numpy : 4.1961669921875e-05 nb_pixel_total : 272 time to create 1 rle with old method : 0.0004074573516845703 length of segment : 20 time for calcul the mask position with numpy : 3.314018249511719e-05 nb_pixel_total : 158 time to create 1 rle with old method : 0.00032138824462890625 length of segment : 12 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 112 time to create 1 rle with old method : 0.0002040863037109375 length of segment : 12 time for calcul the mask position with numpy : 6.365776062011719e-05 nb_pixel_total : 135 time to create 1 rle with old method : 0.0002429485321044922 length of segment : 13 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 9 time for calcul the mask position with numpy : 7.200241088867188e-05 nb_pixel_total : 356 time to create 1 rle with old method : 0.0009477138519287109 length of segment : 19 time for calcul the mask position with numpy : 6.318092346191406e-05 nb_pixel_total : 408 time to create 1 rle with old method : 0.0007824897766113281 length of segment : 29 time for calcul the mask position with numpy : 5.459785461425781e-05 nb_pixel_total : 762 time to create 1 rle with old method : 0.0012946128845214844 length of segment : 48 time for calcul the mask position with numpy : 6.890296936035156e-05 nb_pixel_total : 330 time to create 1 rle with old method : 0.000858306884765625 length of segment : 19 time for calcul the mask position with numpy : 6.699562072753906e-05 nb_pixel_total : 642 time to create 1 rle with old method : 0.0014634132385253906 length of segment : 41 time for calcul the mask position with numpy : 2.7418136596679688e-05 nb_pixel_total : 71 time to create 1 rle with old method : 0.00012755393981933594 length of segment : 9 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 116 time to create 1 rle with old method : 0.00020933151245117188 length of segment : 11 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002918243408203125 length of segment : 23 time for calcul the mask position with numpy : 3.5762786865234375e-05 nb_pixel_total : 344 time to create 1 rle with old method : 0.0005292892456054688 length of segment : 21 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 24 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 278 time to create 1 rle with old method : 0.00040340423583984375 length of segment : 23 time for calcul the mask position with numpy : 5.602836608886719e-05 nb_pixel_total : 933 time to create 1 rle with old method : 0.0012183189392089844 length of segment : 42 time for calcul the mask position with numpy : 3.647804260253906e-05 nb_pixel_total : 352 time to create 1 rle with old method : 0.0005445480346679688 length of segment : 14 time for calcul the mask position with numpy : 3.457069396972656e-05 nb_pixel_total : 249 time to create 1 rle with old method : 0.00040221214294433594 length of segment : 10 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 1468 time to create 1 rle with old method : 0.00188446044921875 length of segment : 57 time for calcul the mask position with numpy : 4.38690185546875e-05 nb_pixel_total : 471 time to create 1 rle with old method : 0.0007126331329345703 length of segment : 34 time for calcul the mask position with numpy : 3.981590270996094e-05 nb_pixel_total : 236 time to create 1 rle with old method : 0.0003421306610107422 length of segment : 22 time for calcul the mask position with numpy : 7.796287536621094e-05 nb_pixel_total : 1439 time to create 1 rle with old method : 0.0018825531005859375 length of segment : 59 time for calcul the mask position with numpy : 3.886222839355469e-05 nb_pixel_total : 342 time to create 1 rle with old method : 0.00044989585876464844 length of segment : 23 time for calcul the mask position with numpy : 3.695487976074219e-05 nb_pixel_total : 162 time to create 1 rle with old method : 0.0002601146697998047 length of segment : 21 time for calcul the mask position with numpy : 4.553794860839844e-05 nb_pixel_total : 737 time to create 1 rle with old method : 0.0010218620300292969 length of segment : 43 time for calcul the mask position with numpy : 5.507469177246094e-05 nb_pixel_total : 1657 time to create 1 rle with old method : 0.0021991729736328125 length of segment : 47 time for calcul the mask position with numpy : 3.218650817871094e-05 nb_pixel_total : 313 time to create 1 rle with old method : 0.0004687309265136719 length of segment : 22 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 178 time to create 1 rle with old method : 0.00026535987854003906 length of segment : 23 time for calcul the mask position with numpy : 3.3855438232421875e-05 nb_pixel_total : 240 time to create 1 rle with old method : 0.0003516674041748047 length of segment : 22 time for calcul the mask position with numpy : 2.86102294921875e-05 nb_pixel_total : 97 time to create 1 rle with old method : 0.00016951560974121094 length of segment : 10 time for calcul the mask position with numpy : 3.0279159545898438e-05 nb_pixel_total : 128 time to create 1 rle with old method : 0.0002040863037109375 length of segment : 15 time for calcul the mask position with numpy : 2.9802322387695312e-05 nb_pixel_total : 241 time to create 1 rle with old method : 0.0003554821014404297 length of segment : 22 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 389 time to create 1 rle with old method : 0.0005097389221191406 length of segment : 21 time for calcul the mask position with numpy : 5.2928924560546875e-05 nb_pixel_total : 1418 time to create 1 rle with old method : 0.001734018325805664 length of segment : 53 time for calcul the mask position with numpy : 2.8133392333984375e-05 nb_pixel_total : 230 time to create 1 rle with old method : 0.0003216266632080078 length of segment : 19 time for calcul the mask position with numpy : 3.361701965332031e-05 nb_pixel_total : 331 time to create 1 rle with old method : 0.00048422813415527344 length of segment : 21 time for calcul the mask position with numpy : 3.743171691894531e-05 nb_pixel_total : 496 time to create 1 rle with old method : 0.0006957054138183594 length of segment : 29 time for calcul the mask position with numpy : 0.0001327991485595703 nb_pixel_total : 6195 time to create 1 rle with old method : 0.007547616958618164 length of segment : 153 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 151.10000 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 8 time for calcul the mask position with numpy : 3.7670135498046875e-05 nb_pixel_total : 274 time to create 1 rle with old method : 0.00041866302490234375 length of segment : 18 time for calcul the mask position with numpy : 3.266334533691406e-05 nb_pixel_total : 270 time to create 1 rle with old method : 0.00041413307189941406 length of segment : 17 time for calcul the mask position with numpy : 2.9325485229492188e-05 nb_pixel_total : 114 time to create 1 rle with old method : 0.0002067089080810547 length of segment : 11 time for calcul the mask position with numpy : 0.00010347366333007812 nb_pixel_total : 6410 time to create 1 rle with old method : 0.007993936538696289 length of segment : 66 time for calcul the mask position with numpy : 3.9577484130859375e-05 nb_pixel_total : 591 time to create 1 rle with old method : 0.0008065700531005859 length of segment : 22 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 122 time to create 1 rle with old method : 0.00019669532775878906 length of segment : 16 time for calcul the mask position with numpy : 3.0040740966796875e-05 nb_pixel_total : 125 time to create 1 rle with old method : 0.00020170211791992188 length of segment : 16 time for calcul the mask position with numpy : 4.2438507080078125e-05 nb_pixel_total : 880 time to create 1 rle with old method : 0.0012192726135253906 length of segment : 28 Processing 1 images image shape: (240, 400, 3) min: 0.00000 max: 255.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 149.10781 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 5 time for calcul the mask position with numpy : 5.8650970458984375e-05 nb_pixel_total : 2079 time to create 1 rle with old method : 0.0026798248291015625 length of segment : 51 time for calcul the mask position with numpy : 3.0517578125e-05 nb_pixel_total : 164 time to create 1 rle with old method : 0.0002682209014892578 length of segment : 13 time for calcul the mask position with numpy : 0.00037384033203125 nb_pixel_total : 31363 time to create 1 rle with old method : 0.03821229934692383 length of segment : 166 time for calcul the mask position with numpy : 3.910064697265625e-05 nb_pixel_total : 384 time to create 1 rle with old method : 0.0005543231964111328 length of segment : 21 time for calcul the mask position with numpy : 3.123283386230469e-05 nb_pixel_total : 193 time to create 1 rle with old method : 0.0003237724304199219 length of segment : 12 Processing 1 images image shape: (240, 160, 3) min: 0.00000 max: 217.00000 molded_images shape: (1, 640, 640, 3) min: -123.70000 max: 103.87496 image_metas shape: (1, 17) min: 0.00000 max: 640.00000 nb d'objets trouves : 1 time for calcul the mask position with numpy : 3.528594970703125e-05 nb_pixel_total : 110 time to create 1 rle with old method : 0.00018167495727539062 length of segment : 15 Detection mask done ! Trying to reset tf kernel 1666381 begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 4686 tf kernel not reseted sub process len(results) : 362 len(list_Values) 362 None max_time_sub_proc : 3600 parent process len(results) : 0 len(list_Values) 362 process is alive finish correctly or not : True after detect begin to check gpu status inside check gpu memory l 3610 free memory gpu now : 9975 Inside saveOutput : final : False verbose : 0 eke 12-6-18 : saveMask need to be cleaned for new output ! Catched exception ! Connect or reconnect ! Number saved : None batch 1 Loaded 477 chid ids of type : 4228 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Number RLEs to save : 4483 save missing photos in datou_result : time spend for datou_step_exec : 22.131986379623413 time spend to save output : 26.482681274414062 total time spend for step 1 : 48.614667654037476 step2:brightness Wed Feb 12 04:21:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step calcul brightness toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 1 time used for this insertion : 0.00914621353149414 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 1 time used for this insertion : 0.007941246032714844 save missing photos in datou_result : time spend for datou_step_exec : 0.15529870986938477 time spend to save output : 0.023021697998046875 total time spend for step 2 : 0.17832040786743164 step3:blur_detection Wed Feb 12 04:21:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure inside step blur_detection toutes les photos sont déjà traitées, on saute les calculs Inside saveOutput : final : False verbose : 0 begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 1 time used for this insertion : 0.008131265640258789 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 1 time used for this insertion : 0.007984161376953125 save missing photos in datou_result : time spend for datou_step_exec : 0.024173498153686523 time spend to save output : 0.020024538040161133 total time spend for step 3 : 0.044198036193847656 step4:rle_unique_nms_with_priority Wed Feb 12 04:21:19 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Begin step rle-unique-nms batch 1 Loaded 477 chid ids of type : 4228 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++nb_obj : 469 nb_hashtags : 7 time to prepare the origin masks : 1.9132566452026367 time for calcul the mask position with numpy : 0.8115236759185791 nb_pixel_total : 3336548 time to create 1 rle with new method : 0.21079039573669434 time for calcul the mask position with numpy : 0.015175104141235352 nb_pixel_total : 26395 time to create 1 rle with old method : 0.030792713165283203 time for calcul the mask position with numpy : 0.014996528625488281 nb_pixel_total : 8180 time to create 1 rle with old method : 0.0097503662109375 time for calcul the mask position with numpy : 0.015279054641723633 nb_pixel_total : 9612 time to create 1 rle with old method : 0.011353492736816406 time for calcul the mask position with numpy : 0.015887737274169922 nb_pixel_total : 389 time to create 1 rle with old method : 0.0004951953887939453 time for calcul the mask position with numpy : 0.015122175216674805 nb_pixel_total : 358 time to create 1 rle with old method : 0.0004425048828125 time for calcul the mask position with numpy : 0.015645503997802734 nb_pixel_total : 20 time to create 1 rle with old method : 4.935264587402344e-05 time for calcul the mask position with numpy : 0.014997482299804688 nb_pixel_total : 1311 time to create 1 rle with old method : 0.0016162395477294922 time for calcul the mask position with numpy : 0.014869451522827148 nb_pixel_total : 30 time to create 1 rle with old method : 8.392333984375e-05 time for calcul the mask position with numpy : 0.014899969100952148 nb_pixel_total : 1041 time to create 1 rle with old method : 0.00125885009765625 time for calcul the mask position with numpy : 0.014885902404785156 nb_pixel_total : 474 time to create 1 rle with old method : 0.0005433559417724609 time for calcul the mask position with numpy : 0.015360593795776367 nb_pixel_total : 5843 time to create 1 rle with old method : 0.006961345672607422 time for calcul the mask position with numpy : 0.015181541442871094 nb_pixel_total : 11819 time to create 1 rle with old method : 0.013014078140258789 time for calcul the mask position with numpy : 0.014476776123046875 nb_pixel_total : 305 time to create 1 rle with old method : 0.0003609657287597656 time for calcul the mask position with numpy : 0.015100479125976562 nb_pixel_total : 235 time to create 1 rle with old method : 0.00029015541076660156 time for calcul the mask position with numpy : 0.014843225479125977 nb_pixel_total : 727 time to create 1 rle with old method : 0.0008440017700195312 time for calcul the mask position with numpy : 0.014706850051879883 nb_pixel_total : 1850 time to create 1 rle with old method : 0.002172708511352539 time for calcul the mask position with numpy : 0.014801979064941406 nb_pixel_total : 614 time to create 1 rle with old method : 0.0007390975952148438 time for calcul the mask position with numpy : 0.014929771423339844 nb_pixel_total : 685 time to create 1 rle with old method : 0.000820159912109375 time for calcul the mask position with numpy : 0.014909982681274414 nb_pixel_total : 269 time to create 1 rle with old method : 0.0003209114074707031 time for calcul the mask position with numpy : 0.014929533004760742 nb_pixel_total : 336 time to create 1 rle with old method : 0.00041294097900390625 time for calcul the mask position with numpy : 0.014936447143554688 nb_pixel_total : 340 time to create 1 rle with old method : 0.00040459632873535156 time for calcul the mask position with numpy : 0.014934539794921875 nb_pixel_total : 667 time to create 1 rle with old method : 0.0010633468627929688 time for calcul the mask position with numpy : 0.014788627624511719 nb_pixel_total : 630 time to create 1 rle with old method : 0.0007386207580566406 time for calcul the mask position with numpy : 0.014980792999267578 nb_pixel_total : 1 time to create 1 rle with old method : 1.5020370483398438e-05 time for calcul the mask position with numpy : 0.014990806579589844 nb_pixel_total : 546 time to create 1 rle with old method : 0.0006916522979736328 time for calcul the mask position with numpy : 0.014882087707519531 nb_pixel_total : 171 time to create 1 rle with old method : 0.00022482872009277344 time for calcul the mask position with numpy : 0.014785051345825195 nb_pixel_total : 331 time to create 1 rle with old method : 0.00040149688720703125 time for calcul the mask position with numpy : 0.014590263366699219 nb_pixel_total : 276 time to create 1 rle with old method : 0.0003521442413330078 time for calcul the mask position with numpy : 0.014482498168945312 nb_pixel_total : 125 time to create 1 rle with old method : 0.00015664100646972656 time for calcul the mask position with numpy : 0.014822721481323242 nb_pixel_total : 436 time to create 1 rle with old method : 0.0005414485931396484 time for calcul the mask position with numpy : 0.014748811721801758 nb_pixel_total : 6 time to create 1 rle with old method : 2.6941299438476562e-05 time for calcul the mask position with numpy : 0.014608383178710938 nb_pixel_total : 31 time to create 1 rle with old method : 6.961822509765625e-05 time for calcul the mask position with numpy : 0.01473546028137207 nb_pixel_total : 705 time to create 1 rle with old method : 0.0008537769317626953 time for calcul the mask position with numpy : 0.014937162399291992 nb_pixel_total : 254 time to create 1 rle with old method : 0.0003345012664794922 time for calcul the mask position with numpy : 0.014963626861572266 nb_pixel_total : 354 time to create 1 rle with old method : 0.0004429817199707031 time for calcul the mask position with numpy : 0.014785289764404297 nb_pixel_total : 269 time to create 1 rle with old method : 0.0003306865692138672 time for calcul the mask position with numpy : 0.014403343200683594 nb_pixel_total : 157 time to create 1 rle with old method : 0.00020003318786621094 time for calcul the mask position with numpy : 0.01450490951538086 nb_pixel_total : 21 time to create 1 rle with old method : 7.677078247070312e-05 time for calcul the mask position with numpy : 0.01457834243774414 nb_pixel_total : 1354 time to create 1 rle with old method : 0.0016832351684570312 time for calcul the mask position with numpy : 0.014589071273803711 nb_pixel_total : 6 time to create 1 rle with old method : 3.886222839355469e-05 time for calcul the mask position with numpy : 0.014211177825927734 nb_pixel_total : 159 time to create 1 rle with old method : 0.0001957416534423828 time for calcul the mask position with numpy : 0.01471710205078125 nb_pixel_total : 1 time to create 1 rle with old method : 7.319450378417969e-05 time for calcul the mask position with numpy : 0.014915943145751953 nb_pixel_total : 22 time to create 1 rle with old method : 5.936622619628906e-05 time for calcul the mask position with numpy : 0.014633417129516602 nb_pixel_total : 593 time to create 1 rle with old method : 0.0006690025329589844 time for calcul the mask position with numpy : 0.014538288116455078 nb_pixel_total : 38 time to create 1 rle with old method : 8.082389831542969e-05 time for calcul the mask position with numpy : 0.014768838882446289 nb_pixel_total : 373 time to create 1 rle with old method : 0.0004639625549316406 time for calcul the mask position with numpy : 0.01471257209777832 nb_pixel_total : 403 time to create 1 rle with old method : 0.0004963874816894531 time for calcul the mask position with numpy : 0.014850616455078125 nb_pixel_total : 137 time to create 1 rle with old method : 0.000156402587890625 time for calcul the mask position with numpy : 0.014272928237915039 nb_pixel_total : 136 time to create 1 rle with old method : 0.00019502639770507812 time for calcul the mask position with numpy : 0.014723539352416992 nb_pixel_total : 211 time to create 1 rle with old method : 0.00026416778564453125 time for calcul the mask position with numpy : 0.014223814010620117 nb_pixel_total : 255 time to create 1 rle with old method : 0.00030040740966796875 time for calcul the mask position with numpy : 0.014276742935180664 nb_pixel_total : 520 time to create 1 rle with old method : 0.0005979537963867188 time for calcul the mask position with numpy : 0.014481782913208008 nb_pixel_total : 113 time to create 1 rle with old method : 0.00013875961303710938 time for calcul the mask position with numpy : 0.014534950256347656 nb_pixel_total : 1097 time to create 1 rle with old method : 0.001909494400024414 time for calcul the mask position with numpy : 0.017113685607910156 nb_pixel_total : 604 time to create 1 rle with old method : 0.001024007797241211 time for calcul the mask position with numpy : 0.017122745513916016 nb_pixel_total : 238 time to create 1 rle with old method : 0.0004267692565917969 time for calcul the mask position with numpy : 0.01711440086364746 nb_pixel_total : 257 time to create 1 rle with old method : 0.0004494190216064453 time for calcul the mask position with numpy : 0.017497539520263672 nb_pixel_total : 378 time to create 1 rle with old method : 0.0006508827209472656 time for calcul the mask position with numpy : 0.016492366790771484 nb_pixel_total : 7 time to create 1 rle with old method : 3.0040740966796875e-05 time for calcul the mask position with numpy : 0.01484060287475586 nb_pixel_total : 197 time to create 1 rle with old method : 0.0002238750457763672 time for calcul the mask position with numpy : 0.014516353607177734 nb_pixel_total : 225 time to create 1 rle with old method : 0.0002446174621582031 time for calcul the mask position with numpy : 0.014294862747192383 nb_pixel_total : 211 time to create 1 rle with old method : 0.00026535987854003906 time for calcul the mask position with numpy : 0.01436924934387207 nb_pixel_total : 224 time to create 1 rle with old method : 0.0002532005310058594 time for calcul the mask position with numpy : 0.014629125595092773 nb_pixel_total : 708 time to create 1 rle with old method : 0.0008091926574707031 time for calcul the mask position with numpy : 0.014571905136108398 nb_pixel_total : 321 time to create 1 rle with old method : 0.000347137451171875 time for calcul the mask position with numpy : 0.014688253402709961 nb_pixel_total : 822 time to create 1 rle with old method : 0.0009729862213134766 time for calcul the mask position with numpy : 0.014679908752441406 nb_pixel_total : 446 time to create 1 rle with old method : 0.0005540847778320312 time for calcul the mask position with numpy : 0.014549970626831055 nb_pixel_total : 645 time to create 1 rle with old method : 0.0007581710815429688 time for calcul the mask position with numpy : 0.014484405517578125 nb_pixel_total : 1484 time to create 1 rle with old method : 0.0016884803771972656 time for calcul the mask position with numpy : 0.014230012893676758 nb_pixel_total : 433 time to create 1 rle with old method : 0.0004744529724121094 time for calcul the mask position with numpy : 0.014297246932983398 nb_pixel_total : 401 time to create 1 rle with old method : 0.00045108795166015625 time for calcul the mask position with numpy : 0.013867855072021484 nb_pixel_total : 268 time to create 1 rle with old method : 0.0003325939178466797 time for calcul the mask position with numpy : 0.013831615447998047 nb_pixel_total : 825 time to create 1 rle with old method : 0.0009050369262695312 time for calcul the mask position with numpy : 0.014230489730834961 nb_pixel_total : 767 time to create 1 rle with old method : 0.0009047985076904297 time for calcul the mask position with numpy : 0.01424860954284668 nb_pixel_total : 134 time to create 1 rle with old method : 0.00017952919006347656 time for calcul the mask position with numpy : 0.014249086380004883 nb_pixel_total : 217 time to create 1 rle with old method : 0.0002675056457519531 time for calcul the mask position with numpy : 0.014642000198364258 nb_pixel_total : 7 time to create 1 rle with old method : 4.315376281738281e-05 time for calcul the mask position with numpy : 0.014280080795288086 nb_pixel_total : 118 time to create 1 rle with old method : 0.00015115737915039062 time for calcul the mask position with numpy : 0.01460409164428711 nb_pixel_total : 1095 time to create 1 rle with old method : 0.0012657642364501953 time for calcul the mask position with numpy : 0.014526844024658203 nb_pixel_total : 301 time to create 1 rle with old method : 0.00036716461181640625 time for calcul the mask position with numpy : 0.01661086082458496 nb_pixel_total : 126 time to create 1 rle with old method : 0.0001583099365234375 time for calcul the mask position with numpy : 0.014755964279174805 nb_pixel_total : 1347 time to create 1 rle with old method : 0.0015826225280761719 time for calcul the mask position with numpy : 0.014429330825805664 nb_pixel_total : 10 time to create 1 rle with old method : 4.220008850097656e-05 time for calcul the mask position with numpy : 0.014739513397216797 nb_pixel_total : 376 time to create 1 rle with old method : 0.0004775524139404297 time for calcul the mask position with numpy : 0.014930963516235352 nb_pixel_total : 285 time to create 1 rle with old method : 0.0003457069396972656 time for calcul the mask position with numpy : 0.014584541320800781 nb_pixel_total : 1153 time to create 1 rle with old method : 0.0013344287872314453 time for calcul the mask position with numpy : 0.014647483825683594 nb_pixel_total : 856 time to create 1 rle with old method : 0.001024484634399414 time for calcul the mask position with numpy : 0.014487743377685547 nb_pixel_total : 1015 time to create 1 rle with old method : 0.0011301040649414062 time for calcul the mask position with numpy : 0.014404535293579102 nb_pixel_total : 1467 time to create 1 rle with old method : 0.0016515254974365234 time for calcul the mask position with numpy : 0.014051437377929688 nb_pixel_total : 408 time to create 1 rle with old method : 0.0004374980926513672 time for calcul the mask position with numpy : 0.013919591903686523 nb_pixel_total : 223 time to create 1 rle with old method : 0.000263214111328125 time for calcul the mask position with numpy : 0.014267444610595703 nb_pixel_total : 65 time to create 1 rle with old method : 0.00011491775512695312 time for calcul the mask position with numpy : 0.014859676361083984 nb_pixel_total : 1260 time to create 1 rle with old method : 0.0015749931335449219 time for calcul the mask position with numpy : 0.01485896110534668 nb_pixel_total : 637 time to create 1 rle with old method : 0.0007503032684326172 time for calcul the mask position with numpy : 0.014597177505493164 nb_pixel_total : 3 time to create 1 rle with old method : 1.621246337890625e-05 time for calcul the mask position with numpy : 0.014943599700927734 nb_pixel_total : 15 time to create 1 rle with old method : 4.601478576660156e-05 time for calcul the mask position with numpy : 0.014970541000366211 nb_pixel_total : 541 time to create 1 rle with old method : 0.0007014274597167969 time for calcul the mask position with numpy : 0.014975786209106445 nb_pixel_total : 617 time to create 1 rle with old method : 0.0007655620574951172 time for calcul the mask position with numpy : 0.014951705932617188 nb_pixel_total : 94 time to create 1 rle with old method : 0.0001327991485595703 time for calcul the mask position with numpy : 0.014923810958862305 nb_pixel_total : 403 time to create 1 rle with old method : 0.0005061626434326172 time for calcul the mask position with numpy : 0.014959335327148438 nb_pixel_total : 270 time to create 1 rle with old method : 0.0003294944763183594 time for calcul the mask position with numpy : 0.014861583709716797 nb_pixel_total : 152 time to create 1 rle with old method : 0.0002727508544921875 time for calcul the mask position with numpy : 0.015405893325805664 nb_pixel_total : 773 time to create 1 rle with old method : 0.0008790493011474609 time for calcul the mask position with numpy : 0.013931035995483398 nb_pixel_total : 1212 time to create 1 rle with old method : 0.0013298988342285156 time for calcul the mask position with numpy : 0.013934850692749023 nb_pixel_total : 1 time to create 1 rle with old method : 9.298324584960938e-06 time for calcul the mask position with numpy : 0.013941764831542969 nb_pixel_total : 1051 time to create 1 rle with old method : 0.0011599063873291016 time for calcul the mask position with numpy : 0.01383209228515625 nb_pixel_total : 1926 time to create 1 rle with old method : 0.0021338462829589844 time for calcul the mask position with numpy : 0.01393270492553711 nb_pixel_total : 364 time to create 1 rle with old method : 0.00045752525329589844 time for calcul the mask position with numpy : 0.014101266860961914 nb_pixel_total : 20 time to create 1 rle with old method : 6.818771362304688e-05 time for calcul the mask position with numpy : 0.013877630233764648 nb_pixel_total : 1219 time to create 1 rle with old method : 0.0013802051544189453 time for calcul the mask position with numpy : 0.013909101486206055 nb_pixel_total : 22 time to create 1 rle with old method : 0.00011682510375976562 time for calcul the mask position with numpy : 0.014068126678466797 nb_pixel_total : 201 time to create 1 rle with old method : 0.0002288818359375 time for calcul the mask position with numpy : 0.014064550399780273 nb_pixel_total : 623 time to create 1 rle with old method : 0.0007078647613525391 time for calcul the mask position with numpy : 0.015168190002441406 nb_pixel_total : 2 time to create 1 rle with old method : 2.3603439331054688e-05 time for calcul the mask position with numpy : 0.01569676399230957 nb_pixel_total : 364 time to create 1 rle with old method : 0.0004591941833496094 time for calcul the mask position with numpy : 0.014374256134033203 nb_pixel_total : 1951 time to create 1 rle with old method : 0.0023076534271240234 time for calcul the mask position with numpy : 0.014426946640014648 nb_pixel_total : 427 time to create 1 rle with old method : 0.0005733966827392578 time for calcul the mask position with numpy : 0.014232158660888672 nb_pixel_total : 1330 time to create 1 rle with old method : 0.0015377998352050781 time for calcul the mask position with numpy : 0.014307737350463867 nb_pixel_total : 7 time to create 1 rle with old method : 3.24249267578125e-05 time for calcul the mask position with numpy : 0.01416635513305664 nb_pixel_total : 384 time to create 1 rle with old method : 0.0004405975341796875 time for calcul the mask position with numpy : 0.01395273208618164 nb_pixel_total : 1054 time to create 1 rle with old method : 0.001199483871459961 time for calcul the mask position with numpy : 0.014219522476196289 nb_pixel_total : 973 time to create 1 rle with old method : 0.0010981559753417969 time for calcul the mask position with numpy : 0.014360666275024414 nb_pixel_total : 92 time to create 1 rle with old method : 0.00011181831359863281 time for calcul the mask position with numpy : 0.014152765274047852 nb_pixel_total : 790 time to create 1 rle with old method : 0.0009529590606689453 time for calcul the mask position with numpy : 0.014866113662719727 nb_pixel_total : 259 time to create 1 rle with old method : 0.0003333091735839844 time for calcul the mask position with numpy : 0.014748811721801758 nb_pixel_total : 72 time to create 1 rle with old method : 0.0001289844512939453 time for calcul the mask position with numpy : 0.01446843147277832 nb_pixel_total : 678 time to create 1 rle with old method : 0.0008006095886230469 time for calcul the mask position with numpy : 0.014466047286987305 nb_pixel_total : 260 time to create 1 rle with old method : 0.00029087066650390625 time for calcul the mask position with numpy : 0.014458179473876953 nb_pixel_total : 1078 time to create 1 rle with old method : 0.0013053417205810547 time for calcul the mask position with numpy : 0.014886617660522461 nb_pixel_total : 7 time to create 1 rle with old method : 4.57763671875e-05 time for calcul the mask position with numpy : 0.014600038528442383 nb_pixel_total : 1438 time to create 1 rle with old method : 0.0017023086547851562 time for calcul the mask position with numpy : 0.014744997024536133 nb_pixel_total : 277 time to create 1 rle with old method : 0.0003807544708251953 time for calcul the mask position with numpy : 0.014594316482543945 nb_pixel_total : 375 time to create 1 rle with old method : 0.0004603862762451172 time for calcul the mask position with numpy : 0.015053033828735352 nb_pixel_total : 107 time to create 1 rle with old method : 0.00017118453979492188 time for calcul the mask position with numpy : 0.014969348907470703 nb_pixel_total : 1012 time to create 1 rle with old method : 0.0013213157653808594 time for calcul the mask position with numpy : 0.015128374099731445 nb_pixel_total : 27 time to create 1 rle with old method : 7.414817810058594e-05 time for calcul the mask position with numpy : 0.015091896057128906 nb_pixel_total : 1740 time to create 1 rle with old method : 0.0021283626556396484 time for calcul the mask position with numpy : 0.015057086944580078 nb_pixel_total : 232 time to create 1 rle with old method : 0.00033354759216308594 time for calcul the mask position with numpy : 0.015075922012329102 nb_pixel_total : 429 time to create 1 rle with old method : 0.0005164146423339844 time for calcul the mask position with numpy : 0.014955282211303711 nb_pixel_total : 226 time to create 1 rle with old method : 0.00027441978454589844 time for calcul the mask position with numpy : 0.014916181564331055 nb_pixel_total : 467 time to create 1 rle with old method : 0.0005719661712646484 time for calcul the mask position with numpy : 0.014950752258300781 nb_pixel_total : 1092 time to create 1 rle with old method : 0.0012247562408447266 time for calcul the mask position with numpy : 0.013837337493896484 nb_pixel_total : 20 time to create 1 rle with old method : 6.341934204101562e-05 time for calcul the mask position with numpy : 0.014264106750488281 nb_pixel_total : 67 time to create 1 rle with old method : 0.0001163482666015625 time for calcul the mask position with numpy : 0.013901948928833008 nb_pixel_total : 887 time to create 1 rle with old method : 0.0010094642639160156 time for calcul the mask position with numpy : 0.014007806777954102 nb_pixel_total : 310 time to create 1 rle with old method : 0.0003638267517089844 time for calcul the mask position with numpy : 0.014774084091186523 nb_pixel_total : 620 time to create 1 rle with old method : 0.0007252693176269531 time for calcul the mask position with numpy : 0.014363765716552734 nb_pixel_total : 4006 time to create 1 rle with old method : 0.004599332809448242 time for calcul the mask position with numpy : 0.014018058776855469 nb_pixel_total : 947 time to create 1 rle with old method : 0.0010335445404052734 time for calcul the mask position with numpy : 0.013960838317871094 nb_pixel_total : 473 time to create 1 rle with old method : 0.0005376338958740234 time for calcul the mask position with numpy : 0.01407170295715332 nb_pixel_total : 12 time to create 1 rle with old method : 0.000118255615234375 time for calcul the mask position with numpy : 0.013905525207519531 nb_pixel_total : 1376 time to create 1 rle with old method : 0.001474618911743164 time for calcul the mask position with numpy : 0.014083147048950195 nb_pixel_total : 970 time to create 1 rle with old method : 0.0011661052703857422 time for calcul the mask position with numpy : 0.014114141464233398 nb_pixel_total : 261 time to create 1 rle with old method : 0.0003094673156738281 time for calcul the mask position with numpy : 0.014843463897705078 nb_pixel_total : 251 time to create 1 rle with old method : 0.0004398822784423828 time for calcul the mask position with numpy : 0.017122507095336914 nb_pixel_total : 2163 time to create 1 rle with old method : 0.003737926483154297 time for calcul the mask position with numpy : 0.017101526260375977 nb_pixel_total : 13 time to create 1 rle with old method : 3.5762786865234375e-05 time for calcul the mask position with numpy : 0.0172119140625 nb_pixel_total : 892 time to create 1 rle with old method : 0.0015583038330078125 time for calcul the mask position with numpy : 0.017179489135742188 nb_pixel_total : 1311 time to create 1 rle with old method : 0.0015997886657714844 time for calcul the mask position with numpy : 0.01523590087890625 nb_pixel_total : 691 time to create 1 rle with old method : 0.0008435249328613281 time for calcul the mask position with numpy : 0.014986753463745117 nb_pixel_total : 1291 time to create 1 rle with old method : 0.001554727554321289 time for calcul the mask position with numpy : 0.014940977096557617 nb_pixel_total : 1252 time to create 1 rle with old method : 0.001504659652709961 time for calcul the mask position with numpy : 0.014582157135009766 nb_pixel_total : 265 time to create 1 rle with old method : 0.0003304481506347656 time for calcul the mask position with numpy : 0.014522552490234375 nb_pixel_total : 2539 time to create 1 rle with old method : 0.002925395965576172 time for calcul the mask position with numpy : 0.014570236206054688 nb_pixel_total : 9 time to create 1 rle with old method : 5.221366882324219e-05 time for calcul the mask position with numpy : 0.01456141471862793 nb_pixel_total : 4 time to create 1 rle with old method : 4.315376281738281e-05 time for calcul the mask position with numpy : 0.01472163200378418 nb_pixel_total : 39 time to create 1 rle with old method : 0.00011706352233886719 time for calcul the mask position with numpy : 0.016251087188720703 nb_pixel_total : 113 time to create 1 rle with old method : 0.00016427040100097656 time for calcul the mask position with numpy : 0.014959096908569336 nb_pixel_total : 60 time to create 1 rle with old method : 0.0001418590545654297 time for calcul the mask position with numpy : 0.014995574951171875 nb_pixel_total : 162 time to create 1 rle with old method : 0.0002655982971191406 time for calcul the mask position with numpy : 0.014969348907470703 nb_pixel_total : 165 time to create 1 rle with old method : 0.0002579689025878906 time for calcul the mask position with numpy : 0.014934778213500977 nb_pixel_total : 89 time to create 1 rle with old method : 0.00021386146545410156 time for calcul the mask position with numpy : 0.014935970306396484 nb_pixel_total : 2043 time to create 1 rle with old method : 0.002473592758178711 time for calcul the mask position with numpy : 0.01488804817199707 nb_pixel_total : 1347 time to create 1 rle with old method : 0.0016887187957763672 time for calcul the mask position with numpy : 0.014939069747924805 nb_pixel_total : 2086 time to create 1 rle with old method : 0.0024623870849609375 time for calcul the mask position with numpy : 0.014907121658325195 nb_pixel_total : 249 time to create 1 rle with old method : 0.00031113624572753906 time for calcul the mask position with numpy : 0.01496124267578125 nb_pixel_total : 38 time to create 1 rle with old method : 7.557868957519531e-05 time for calcul the mask position with numpy : 0.014578580856323242 nb_pixel_total : 674 time to create 1 rle with old method : 0.000843048095703125 time for calcul the mask position with numpy : 0.02095508575439453 nb_pixel_total : 296 time to create 1 rle with old method : 0.00046944618225097656 time for calcul the mask position with numpy : 0.018837690353393555 nb_pixel_total : 5 time to create 1 rle with old method : 3.0279159545898438e-05 time for calcul the mask position with numpy : 0.015105009078979492 nb_pixel_total : 672 time to create 1 rle with old method : 0.0007746219635009766 time for calcul the mask position with numpy : 0.014133214950561523 nb_pixel_total : 230 time to create 1 rle with old method : 0.0002739429473876953 time for calcul the mask position with numpy : 0.014103889465332031 nb_pixel_total : 10 time to create 1 rle with old method : 3.2901763916015625e-05 time for calcul the mask position with numpy : 0.013936996459960938 nb_pixel_total : 818 time to create 1 rle with old method : 0.0009307861328125 time for calcul the mask position with numpy : 0.013773202896118164 nb_pixel_total : 370 time to create 1 rle with old method : 0.00046563148498535156 time for calcul the mask position with numpy : 0.014306068420410156 nb_pixel_total : 946 time to create 1 rle with old method : 0.0011181831359863281 time for calcul the mask position with numpy : 0.014603137969970703 nb_pixel_total : 7 time to create 1 rle with old method : 2.3365020751953125e-05 time for calcul the mask position with numpy : 0.014705181121826172 nb_pixel_total : 7 time to create 1 rle with old method : 3.933906555175781e-05 time for calcul the mask position with numpy : 0.015053510665893555 nb_pixel_total : 1896 time to create 1 rle with old method : 0.0032444000244140625 time for calcul the mask position with numpy : 0.017605304718017578 nb_pixel_total : 397 time to create 1 rle with old method : 0.0006780624389648438 time for calcul the mask position with numpy : 0.01709604263305664 nb_pixel_total : 43 time to create 1 rle with old method : 0.00012803077697753906 time for calcul the mask position with numpy : 0.01568460464477539 nb_pixel_total : 312 time to create 1 rle with old method : 0.00039267539978027344 time for calcul the mask position with numpy : 0.01591038703918457 nb_pixel_total : 1 time to create 1 rle with old method : 3.337860107421875e-05 time for calcul the mask position with numpy : 0.023648500442504883 nb_pixel_total : 14 time to create 1 rle with old method : 6.747245788574219e-05 time for calcul the mask position with numpy : 0.0408320426940918 nb_pixel_total : 321 time to create 1 rle with old method : 0.0005311965942382812 time for calcul the mask position with numpy : 0.01769280433654785 nb_pixel_total : 15 time to create 1 rle with old method : 5.8650970458984375e-05 time for calcul the mask position with numpy : 0.019176483154296875 nb_pixel_total : 2301 time to create 1 rle with old method : 0.004311323165893555 time for calcul the mask position with numpy : 0.01919841766357422 nb_pixel_total : 245 time to create 1 rle with old method : 0.0005555152893066406 time for calcul the mask position with numpy : 0.019573450088500977 nb_pixel_total : 9 time to create 1 rle with old method : 5.6743621826171875e-05 time for calcul the mask position with numpy : 0.019681453704833984 nb_pixel_total : 248 time to create 1 rle with old method : 0.00046515464782714844 time for calcul the mask position with numpy : 0.01934027671813965 nb_pixel_total : 248 time to create 1 rle with old method : 0.0005211830139160156 time for calcul the mask position with numpy : 0.019417762756347656 nb_pixel_total : 2016 time to create 1 rle with old method : 0.003744840621948242 time for calcul the mask position with numpy : 0.019551515579223633 nb_pixel_total : 1070 time to create 1 rle with old method : 0.002056121826171875 time for calcul the mask position with numpy : 0.018793344497680664 nb_pixel_total : 507 time to create 1 rle with old method : 0.0006101131439208984 time for calcul the mask position with numpy : 0.015202760696411133 nb_pixel_total : 517 time to create 1 rle with old method : 0.0006239414215087891 time for calcul the mask position with numpy : 0.015044212341308594 nb_pixel_total : 466 time to create 1 rle with old method : 0.0005946159362792969 time for calcul the mask position with numpy : 0.015146017074584961 nb_pixel_total : 93 time to create 1 rle with old method : 0.0001277923583984375 time for calcul the mask position with numpy : 0.01528167724609375 nb_pixel_total : 1235 time to create 1 rle with old method : 0.001495361328125 time for calcul the mask position with numpy : 0.015103340148925781 nb_pixel_total : 233 time to create 1 rle with old method : 0.00031495094299316406 time for calcul the mask position with numpy : 0.015167951583862305 nb_pixel_total : 33 time to create 1 rle with old method : 8.368492126464844e-05 time for calcul the mask position with numpy : 0.015097618103027344 nb_pixel_total : 405 time to create 1 rle with old method : 0.0004911422729492188 time for calcul the mask position with numpy : 0.015443563461303711 nb_pixel_total : 2 time to create 1 rle with old method : 4.6253204345703125e-05 time for calcul the mask position with numpy : 0.015393733978271484 nb_pixel_total : 877 time to create 1 rle with old method : 0.0010323524475097656 time for calcul the mask position with numpy : 0.015178442001342773 nb_pixel_total : 656 time to create 1 rle with old method : 0.0007905960083007812 time for calcul the mask position with numpy : 0.015233755111694336 nb_pixel_total : 194 time to create 1 rle with old method : 0.0002598762512207031 time for calcul the mask position with numpy : 0.015115976333618164 nb_pixel_total : 4 time to create 1 rle with old method : 4.00543212890625e-05 time for calcul the mask position with numpy : 0.01601433753967285 nb_pixel_total : 798 time to create 1 rle with old method : 0.0014510154724121094 time for calcul the mask position with numpy : 0.018429040908813477 nb_pixel_total : 10 time to create 1 rle with old method : 9.799003601074219e-05 time for calcul the mask position with numpy : 0.01781749725341797 nb_pixel_total : 13 time to create 1 rle with old method : 6.127357482910156e-05 time for calcul the mask position with numpy : 0.01786351203918457 nb_pixel_total : 264 time to create 1 rle with old method : 0.0005109310150146484 time for calcul the mask position with numpy : 0.01699542999267578 nb_pixel_total : 602 time to create 1 rle with old method : 0.0007503032684326172 time for calcul the mask position with numpy : 0.015767574310302734 nb_pixel_total : 674 time to create 1 rle with old method : 0.0011820793151855469 time for calcul the mask position with numpy : 0.0175173282623291 nb_pixel_total : 96 time to create 1 rle with old method : 0.00021147727966308594 time for calcul the mask position with numpy : 0.017307281494140625 nb_pixel_total : 535 time to create 1 rle with old method : 0.0009171962738037109 time for calcul the mask position with numpy : 0.02131342887878418 nb_pixel_total : 84 time to create 1 rle with old method : 0.00019621849060058594 time for calcul the mask position with numpy : 0.022996902465820312 nb_pixel_total : 208 time to create 1 rle with old method : 0.00037479400634765625 time for calcul the mask position with numpy : 0.017791271209716797 nb_pixel_total : 177 time to create 1 rle with old method : 0.00032782554626464844 time for calcul the mask position with numpy : 0.018018722534179688 nb_pixel_total : 312 time to create 1 rle with old method : 0.0005805492401123047 time for calcul the mask position with numpy : 0.017507076263427734 nb_pixel_total : 456 time to create 1 rle with old method : 0.0008285045623779297 time for calcul the mask position with numpy : 0.017974853515625 nb_pixel_total : 340 time to create 1 rle with old method : 0.0006098747253417969 time for calcul the mask position with numpy : 0.01785588264465332 nb_pixel_total : 6 time to create 1 rle with old method : 5.841255187988281e-05 time for calcul the mask position with numpy : 0.017937660217285156 nb_pixel_total : 49 time to create 1 rle with old method : 0.00013256072998046875 time for calcul the mask position with numpy : 0.018102645874023438 nb_pixel_total : 10 time to create 1 rle with old method : 6.413459777832031e-05 time for calcul the mask position with numpy : 0.018031835556030273 nb_pixel_total : 209 time to create 1 rle with old method : 0.00041985511779785156 time for calcul the mask position with numpy : 0.017948627471923828 nb_pixel_total : 390 time to create 1 rle with old method : 0.0006914138793945312 time for calcul the mask position with numpy : 0.018079042434692383 nb_pixel_total : 7 time to create 1 rle with old method : 6.4849853515625e-05 time for calcul the mask position with numpy : 0.017937421798706055 nb_pixel_total : 4 time to create 1 rle with old method : 3.1948089599609375e-05 time for calcul the mask position with numpy : 0.01794910430908203 nb_pixel_total : 1245 time to create 1 rle with old method : 0.002107381820678711 time for calcul the mask position with numpy : 0.018722057342529297 nb_pixel_total : 420 time to create 1 rle with old method : 0.0007350444793701172 time for calcul the mask position with numpy : 0.018172740936279297 nb_pixel_total : 23 time to create 1 rle with old method : 0.00011372566223144531 time for calcul the mask position with numpy : 0.0188140869140625 nb_pixel_total : 806 time to create 1 rle with old method : 0.0009996891021728516 time for calcul the mask position with numpy : 0.015358686447143555 nb_pixel_total : 1 time to create 1 rle with old method : 2.6702880859375e-05 time for calcul the mask position with numpy : 0.015333890914916992 nb_pixel_total : 5 time to create 1 rle with old method : 4.124641418457031e-05 time for calcul the mask position with numpy : 0.015653371810913086 nb_pixel_total : 40 time to create 1 rle with old method : 8.916854858398438e-05 time for calcul the mask position with numpy : 0.015270709991455078 nb_pixel_total : 1 time to create 1 rle with old method : 2.9087066650390625e-05 time for calcul the mask position with numpy : 0.015012025833129883 nb_pixel_total : 387 time to create 1 rle with old method : 0.0004987716674804688 time for calcul the mask position with numpy : 0.015121936798095703 nb_pixel_total : 2 time to create 1 rle with old method : 3.1948089599609375e-05 time for calcul the mask position with numpy : 0.015443086624145508 nb_pixel_total : 88 time to create 1 rle with old method : 0.0001633167266845703 time for calcul the mask position with numpy : 0.015419244766235352 nb_pixel_total : 1018 time to create 1 rle with old method : 0.0013384819030761719 time for calcul the mask position with numpy : 0.015456914901733398 nb_pixel_total : 1319 time to create 1 rle with old method : 0.0016183853149414062 time for calcul the mask position with numpy : 0.0168459415435791 nb_pixel_total : 279 time to create 1 rle with old method : 0.00038552284240722656 time for calcul the mask position with numpy : 0.015294790267944336 nb_pixel_total : 240 time to create 1 rle with old method : 0.0003502368927001953 time for calcul the mask position with numpy : 0.015227556228637695 nb_pixel_total : 158 time to create 1 rle with old method : 0.00021386146545410156 time for calcul the mask position with numpy : 0.015267372131347656 nb_pixel_total : 7 time to create 1 rle with old method : 4.6253204345703125e-05 time for calcul the mask position with numpy : 0.015291929244995117 nb_pixel_total : 317 time to create 1 rle with old method : 0.0004925727844238281 time for calcul the mask position with numpy : 0.015219449996948242 nb_pixel_total : 62 time to create 1 rle with old method : 0.00012803077697753906 time for calcul the mask position with numpy : 0.015218734741210938 nb_pixel_total : 666 time to create 1 rle with old method : 0.0008623600006103516 time for calcul the mask position with numpy : 0.015390872955322266 nb_pixel_total : 10 time to create 1 rle with old method : 5.078315734863281e-05 time for calcul the mask position with numpy : 0.01509547233581543 nb_pixel_total : 488 time to create 1 rle with old method : 0.0005974769592285156 time for calcul the mask position with numpy : 0.015265464782714844 nb_pixel_total : 1852 time to create 1 rle with old method : 0.0022542476654052734 time for calcul the mask position with numpy : 0.015655040740966797 nb_pixel_total : 25 time to create 1 rle with old method : 0.00010514259338378906 time for calcul the mask position with numpy : 0.01566624641418457 nb_pixel_total : 430 time to create 1 rle with old method : 0.0005538463592529297 time for calcul the mask position with numpy : 0.01569533348083496 nb_pixel_total : 584 time to create 1 rle with old method : 0.0007588863372802734 time for calcul the mask position with numpy : 0.015619039535522461 nb_pixel_total : 250 time to create 1 rle with old method : 0.00035309791564941406 time for calcul the mask position with numpy : 0.015582084655761719 nb_pixel_total : 15 time to create 1 rle with old method : 0.000141143798828125 time for calcul the mask position with numpy : 0.015244722366333008 nb_pixel_total : 185 time to create 1 rle with old method : 0.0002598762512207031 time for calcul the mask position with numpy : 0.015377044677734375 nb_pixel_total : 33 time to create 1 rle with old method : 0.00011157989501953125 time for calcul the mask position with numpy : 0.015235662460327148 nb_pixel_total : 1593 time to create 1 rle with old method : 0.0019702911376953125 time for calcul the mask position with numpy : 0.015684843063354492 nb_pixel_total : 810 time to create 1 rle with old method : 0.0010187625885009766 time for calcul the mask position with numpy : 0.015644550323486328 nb_pixel_total : 29 time to create 1 rle with old method : 0.0001785755157470703 time for calcul the mask position with numpy : 0.01563405990600586 nb_pixel_total : 160 time to create 1 rle with old method : 0.0002894401550292969 time for calcul the mask position with numpy : 0.017868518829345703 nb_pixel_total : 44 time to create 1 rle with old method : 0.0001575946807861328 time for calcul the mask position with numpy : 0.0154571533203125 nb_pixel_total : 34 time to create 1 rle with old method : 9.512901306152344e-05 time for calcul the mask position with numpy : 0.015134096145629883 nb_pixel_total : 316 time to create 1 rle with old method : 0.00040411949157714844 time for calcul the mask position with numpy : 0.015395641326904297 nb_pixel_total : 3394 time to create 1 rle with old method : 0.004048824310302734 time for calcul the mask position with numpy : 0.014984369277954102 nb_pixel_total : 1576 time to create 1 rle with old method : 0.0018911361694335938 time for calcul the mask position with numpy : 0.015430927276611328 nb_pixel_total : 75 time to create 1 rle with old method : 0.00019359588623046875 time for calcul the mask position with numpy : 0.015137195587158203 nb_pixel_total : 313 time to create 1 rle with old method : 0.0004019737243652344 time for calcul the mask position with numpy : 0.015549421310424805 nb_pixel_total : 25 time to create 1 rle with old method : 0.00011897087097167969 time for calcul the mask position with numpy : 0.015701770782470703 nb_pixel_total : 372 time to create 1 rle with old method : 0.0004687309265136719 time for calcul the mask position with numpy : 0.015573978424072266 nb_pixel_total : 106 time to create 1 rle with old method : 0.0002837181091308594 time for calcul the mask position with numpy : 0.01563739776611328 nb_pixel_total : 2940 time to create 1 rle with old method : 0.0037221908569335938 time for calcul the mask position with numpy : 0.015846967697143555 nb_pixel_total : 400 time to create 1 rle with old method : 0.0006799697875976562 time for calcul the mask position with numpy : 0.01658034324645996 nb_pixel_total : 7703 time to create 1 rle with old method : 0.009946823120117188 time for calcul the mask position with numpy : 0.015902996063232422 nb_pixel_total : 1100 time to create 1 rle with old method : 0.0013995170593261719 time for calcul the mask position with numpy : 0.015710830688476562 nb_pixel_total : 67 time to create 1 rle with old method : 0.00018644332885742188 time for calcul the mask position with numpy : 0.015812397003173828 nb_pixel_total : 1677 time to create 1 rle with old method : 0.0020384788513183594 time for calcul the mask position with numpy : 0.015625715255737305 nb_pixel_total : 191 time to create 1 rle with old method : 0.00029015541076660156 time for calcul the mask position with numpy : 0.015571832656860352 nb_pixel_total : 33 time to create 1 rle with old method : 0.00011920928955078125 time for calcul the mask position with numpy : 0.015592098236083984 nb_pixel_total : 232 time to create 1 rle with old method : 0.0004303455352783203 time for calcul the mask position with numpy : 0.015719890594482422 nb_pixel_total : 15 time to create 1 rle with old method : 0.00012159347534179688 time for calcul the mask position with numpy : 0.015673160552978516 nb_pixel_total : 1106 time to create 1 rle with old method : 0.0013663768768310547 time for calcul the mask position with numpy : 0.01570582389831543 nb_pixel_total : 53 time to create 1 rle with old method : 0.00016045570373535156 time for calcul the mask position with numpy : 0.01591181755065918 nb_pixel_total : 22 time to create 1 rle with old method : 0.00012874603271484375 time for calcul the mask position with numpy : 0.01576972007751465 nb_pixel_total : 434 time to create 1 rle with old method : 0.0006003379821777344 time for calcul the mask position with numpy : 0.015663623809814453 nb_pixel_total : 1843 time to create 1 rle with old method : 0.002246856689453125 time for calcul the mask position with numpy : 0.015371084213256836 nb_pixel_total : 1126 time to create 1 rle with old method : 0.0014410018920898438 time for calcul the mask position with numpy : 0.015598773956298828 nb_pixel_total : 1323 time to create 1 rle with old method : 0.001651763916015625 time for calcul the mask position with numpy : 0.015656232833862305 nb_pixel_total : 22 time to create 1 rle with old method : 9.632110595703125e-05 time for calcul the mask position with numpy : 0.01568889617919922 nb_pixel_total : 299 time to create 1 rle with old method : 0.00038886070251464844 time for calcul the mask position with numpy : 0.015664100646972656 nb_pixel_total : 8 time to create 1 rle with old method : 6.151199340820312e-05 time for calcul the mask position with numpy : 0.01573467254638672 nb_pixel_total : 66 time to create 1 rle with old method : 0.0001468658447265625 time for calcul the mask position with numpy : 0.015685081481933594 nb_pixel_total : 549 time to create 1 rle with old method : 0.0007789134979248047 time for calcul the mask position with numpy : 0.015543222427368164 nb_pixel_total : 70 time to create 1 rle with old method : 0.00013256072998046875 time for calcul the mask position with numpy : 0.015450477600097656 nb_pixel_total : 511 time to create 1 rle with old method : 0.0006527900695800781 time for calcul the mask position with numpy : 0.014778614044189453 nb_pixel_total : 504 time to create 1 rle with old method : 0.0006096363067626953 time for calcul the mask position with numpy : 0.015207052230834961 nb_pixel_total : 554 time to create 1 rle with old method : 0.0007469654083251953 time for calcul the mask position with numpy : 0.015352010726928711 nb_pixel_total : 736 time to create 1 rle with old method : 0.0009300708770751953 time for calcul the mask position with numpy : 0.01526641845703125 nb_pixel_total : 1975 time to create 1 rle with old method : 0.0024182796478271484 time for calcul the mask position with numpy : 0.01765155792236328 nb_pixel_total : 84 time to create 1 rle with old method : 0.0001933574676513672 time for calcul the mask position with numpy : 0.01528310775756836 nb_pixel_total : 1545 time to create 1 rle with old method : 0.001870870590209961 time for calcul the mask position with numpy : 0.015585899353027344 nb_pixel_total : 239 time to create 1 rle with old method : 0.00034499168395996094 time for calcul the mask position with numpy : 0.01535797119140625 nb_pixel_total : 1008 time to create 1 rle with old method : 0.0013136863708496094 time for calcul the mask position with numpy : 0.015324831008911133 nb_pixel_total : 151 time to create 1 rle with old method : 0.00020837783813476562 time for calcul the mask position with numpy : 0.015405654907226562 nb_pixel_total : 712 time to create 1 rle with old method : 0.0009305477142333984 time for calcul the mask position with numpy : 0.015362262725830078 nb_pixel_total : 58 time to create 1 rle with old method : 0.00014638900756835938 time for calcul the mask position with numpy : 0.015273571014404297 nb_pixel_total : 392 time to create 1 rle with old method : 0.0005071163177490234 time for calcul the mask position with numpy : 0.015251398086547852 nb_pixel_total : 357 time to create 1 rle with old method : 0.0004603862762451172 time for calcul the mask position with numpy : 0.015226125717163086 nb_pixel_total : 1308 time to create 1 rle with old method : 0.0015842914581298828 time for calcul the mask position with numpy : 0.015124797821044922 nb_pixel_total : 583 time to create 1 rle with old method : 0.00072479248046875 time for calcul the mask position with numpy : 0.014944076538085938 nb_pixel_total : 1760 time to create 1 rle with old method : 0.002112150192260742 time for calcul the mask position with numpy : 0.015209674835205078 nb_pixel_total : 150 time to create 1 rle with old method : 0.0002446174621582031 time for calcul the mask position with numpy : 0.014917135238647461 nb_pixel_total : 292 time to create 1 rle with old method : 0.0003714561462402344 time for calcul the mask position with numpy : 0.015265226364135742 nb_pixel_total : 321 time to create 1 rle with old method : 0.00041294097900390625 time for calcul the mask position with numpy : 0.015031576156616211 nb_pixel_total : 1372 time to create 1 rle with old method : 0.0016238689422607422 time for calcul the mask position with numpy : 0.014587640762329102 nb_pixel_total : 4861 time to create 1 rle with old method : 0.005538463592529297 time for calcul the mask position with numpy : 0.01495218276977539 nb_pixel_total : 38 time to create 1 rle with old method : 0.00011205673217773438 time for calcul the mask position with numpy : 0.01467132568359375 nb_pixel_total : 19 time to create 1 rle with old method : 5.7697296142578125e-05 time for calcul the mask position with numpy : 0.014623641967773438 nb_pixel_total : 149 time to create 1 rle with old method : 0.00023651123046875 time for calcul the mask position with numpy : 0.01463627815246582 nb_pixel_total : 54 time to create 1 rle with old method : 0.0001251697540283203 time for calcul the mask position with numpy : 0.014822721481323242 nb_pixel_total : 1918 time to create 1 rle with old method : 0.002323150634765625 time for calcul the mask position with numpy : 0.01478433609008789 nb_pixel_total : 1 time to create 1 rle with old method : 2.4080276489257812e-05 time for calcul the mask position with numpy : 0.014659881591796875 nb_pixel_total : 55 time to create 1 rle with old method : 0.00012230873107910156 time for calcul the mask position with numpy : 0.014904499053955078 nb_pixel_total : 1366 time to create 1 rle with old method : 0.0015437602996826172 time for calcul the mask position with numpy : 0.014719724655151367 nb_pixel_total : 570 time to create 1 rle with old method : 0.0006992816925048828 time for calcul the mask position with numpy : 0.014930486679077148 nb_pixel_total : 40 time to create 1 rle with old method : 7.295608520507812e-05 time for calcul the mask position with numpy : 0.01452326774597168 nb_pixel_total : 66 time to create 1 rle with old method : 0.00012826919555664062 time for calcul the mask position with numpy : 0.01440572738647461 nb_pixel_total : 791 time to create 1 rle with old method : 0.00098419189453125 time for calcul the mask position with numpy : 0.014332294464111328 nb_pixel_total : 1790 time to create 1 rle with old method : 0.0021042823791503906 time for calcul the mask position with numpy : 0.014597415924072266 nb_pixel_total : 1175 time to create 1 rle with old method : 0.0014216899871826172 time for calcul the mask position with numpy : 0.01479196548461914 nb_pixel_total : 13 time to create 1 rle with old method : 7.534027099609375e-05 time for calcul the mask position with numpy : 0.015104293823242188 nb_pixel_total : 989 time to create 1 rle with old method : 0.0012366771697998047 time for calcul the mask position with numpy : 0.015028715133666992 nb_pixel_total : 585 time to create 1 rle with old method : 0.0007150173187255859 time for calcul the mask position with numpy : 0.016115188598632812 nb_pixel_total : 1003 time to create 1 rle with old method : 0.001672983169555664 time for calcul the mask position with numpy : 0.017379283905029297 nb_pixel_total : 40 time to create 1 rle with old method : 0.00012111663818359375 time for calcul the mask position with numpy : 0.01722264289855957 nb_pixel_total : 87 time to create 1 rle with old method : 0.00020432472229003906 time for calcul the mask position with numpy : 0.017268657684326172 nb_pixel_total : 1573 time to create 1 rle with old method : 0.0026712417602539062 time for calcul the mask position with numpy : 0.016928911209106445 nb_pixel_total : 10 time to create 1 rle with old method : 6.127357482910156e-05 time for calcul the mask position with numpy : 0.015450239181518555 nb_pixel_total : 1079 time to create 1 rle with old method : 0.0013158321380615234 time for calcul the mask position with numpy : 0.015389442443847656 nb_pixel_total : 565 time to create 1 rle with old method : 0.0007021427154541016 time for calcul the mask position with numpy : 0.015383481979370117 nb_pixel_total : 1048 time to create 1 rle with old method : 0.0012531280517578125 time for calcul the mask position with numpy : 0.015351295471191406 nb_pixel_total : 20 time to create 1 rle with old method : 0.00010538101196289062 time for calcul the mask position with numpy : 0.01517629623413086 nb_pixel_total : 4 time to create 1 rle with old method : 4.649162292480469e-05 time for calcul the mask position with numpy : 0.015257596969604492 nb_pixel_total : 3 time to create 1 rle with old method : 2.9802322387695312e-05 time for calcul the mask position with numpy : 0.014965295791625977 nb_pixel_total : 829 time to create 1 rle with old method : 0.0010209083557128906 time for calcul the mask position with numpy : 0.015293359756469727 nb_pixel_total : 818 time to create 1 rle with old method : 0.001020669937133789 time for calcul the mask position with numpy : 0.015276908874511719 nb_pixel_total : 224 time to create 1 rle with old method : 0.0003387928009033203 time for calcul the mask position with numpy : 0.015280961990356445 nb_pixel_total : 1012 time to create 1 rle with old method : 0.0012962818145751953 time for calcul the mask position with numpy : 0.015435934066772461 nb_pixel_total : 31 time to create 1 rle with old method : 0.00013899803161621094 time for calcul the mask position with numpy : 0.015431642532348633 nb_pixel_total : 2875 time to create 1 rle with old method : 0.003480672836303711 time for calcul the mask position with numpy : 0.015563011169433594 nb_pixel_total : 249 time to create 1 rle with old method : 0.00032806396484375 time for calcul the mask position with numpy : 0.015482902526855469 nb_pixel_total : 468 time to create 1 rle with old method : 0.0006794929504394531 time for calcul the mask position with numpy : 0.017463207244873047 nb_pixel_total : 1262 time to create 1 rle with old method : 0.0015742778778076172 time for calcul the mask position with numpy : 0.015979528427124023 nb_pixel_total : 1262 time to create 1 rle with old method : 0.001512289047241211 time for calcul the mask position with numpy : 0.015622138977050781 nb_pixel_total : 6 time to create 1 rle with old method : 6.866455078125e-05 time for calcul the mask position with numpy : 0.01566147804260254 nb_pixel_total : 470 time to create 1 rle with old method : 0.0006039142608642578 time for calcul the mask position with numpy : 0.022713661193847656 nb_pixel_total : 18 time to create 1 rle with old method : 6.914138793945312e-05 time for calcul the mask position with numpy : 0.015858888626098633 nb_pixel_total : 50 time to create 1 rle with old method : 0.00010752677917480469 time for calcul the mask position with numpy : 0.015740394592285156 nb_pixel_total : 930 time to create 1 rle with old method : 0.0011305809020996094 time for calcul the mask position with numpy : 0.01538705825805664 nb_pixel_total : 1005 time to create 1 rle with old method : 0.0012106895446777344 time for calcul the mask position with numpy : 0.015276432037353516 nb_pixel_total : 2085 time to create 1 rle with old method : 0.002519369125366211 time for calcul the mask position with numpy : 0.015324831008911133 nb_pixel_total : 14 time to create 1 rle with old method : 6.031990051269531e-05 time for calcul the mask position with numpy : 0.015292644500732422 nb_pixel_total : 408 time to create 1 rle with old method : 0.0007724761962890625 time for calcul the mask position with numpy : 0.015485048294067383 nb_pixel_total : 8 time to create 1 rle with old method : 4.863739013671875e-05 time for calcul the mask position with numpy : 0.015398979187011719 nb_pixel_total : 393 time to create 1 rle with old method : 0.000492095947265625 time for calcul the mask position with numpy : 0.016414880752563477 nb_pixel_total : 249 time to create 1 rle with old method : 0.0005772113800048828 time for calcul the mask position with numpy : 0.015619993209838867 nb_pixel_total : 82 time to create 1 rle with old method : 0.0001277923583984375 time for calcul the mask position with numpy : 0.015334606170654297 nb_pixel_total : 902 time to create 1 rle with old method : 0.0011663436889648438 time for calcul the mask position with numpy : 0.015269756317138672 nb_pixel_total : 931 time to create 1 rle with old method : 0.0011343955993652344 time for calcul the mask position with numpy : 0.014826297760009766 nb_pixel_total : 6 time to create 1 rle with old method : 3.1948089599609375e-05 time for calcul the mask position with numpy : 0.015065670013427734 nb_pixel_total : 1502 time to create 1 rle with old method : 0.0017611980438232422 time for calcul the mask position with numpy : 0.014797210693359375 nb_pixel_total : 618 time to create 1 rle with old method : 0.0007672309875488281 time for calcul the mask position with numpy : 0.015642642974853516 nb_pixel_total : 400 time to create 1 rle with old method : 0.0005273818969726562 time for calcul the mask position with numpy : 0.015163421630859375 nb_pixel_total : 1188 time to create 1 rle with old method : 0.0014171600341796875 time for calcul the mask position with numpy : 0.015306711196899414 nb_pixel_total : 180 time to create 1 rle with old method : 0.00024247169494628906 time for calcul the mask position with numpy : 0.015257835388183594 nb_pixel_total : 276 time to create 1 rle with old method : 0.0003657341003417969 time for calcul the mask position with numpy : 0.014908313751220703 nb_pixel_total : 923 time to create 1 rle with old method : 0.0011191368103027344 time for calcul the mask position with numpy : 0.015187501907348633 nb_pixel_total : 228 time to create 1 rle with old method : 0.0003113746643066406 time for calcul the mask position with numpy : 0.015174627304077148 nb_pixel_total : 3 time to create 1 rle with old method : 3.814697265625e-05 time for calcul the mask position with numpy : 0.014492511749267578 nb_pixel_total : 691 time to create 1 rle with old method : 0.0008456707000732422 time for calcul the mask position with numpy : 0.014621734619140625 nb_pixel_total : 11 time to create 1 rle with old method : 3.981590270996094e-05 time for calcul the mask position with numpy : 0.014781713485717773 nb_pixel_total : 798 time to create 1 rle with old method : 0.001008749008178711 time for calcul the mask position with numpy : 0.014795064926147461 nb_pixel_total : 852 time to create 1 rle with old method : 0.0010385513305664062 time for calcul the mask position with numpy : 0.014575481414794922 nb_pixel_total : 8 time to create 1 rle with old method : 5.459785461425781e-05 time for calcul the mask position with numpy : 0.01438283920288086 nb_pixel_total : 9 time to create 1 rle with old method : 3.719329833984375e-05 time for calcul the mask position with numpy : 0.014247655868530273 nb_pixel_total : 605 time to create 1 rle with old method : 0.0007295608520507812 time for calcul the mask position with numpy : 0.014536619186401367 nb_pixel_total : 4 time to create 1 rle with old method : 1.5735626220703125e-05 time for calcul the mask position with numpy : 0.01420903205871582 nb_pixel_total : 28 time to create 1 rle with old method : 6.389617919921875e-05 time for calcul the mask position with numpy : 0.014066457748413086 nb_pixel_total : 4 time to create 1 rle with old method : 1.2636184692382812e-05 time for calcul the mask position with numpy : 0.014445066452026367 nb_pixel_total : 489 time to create 1 rle with old method : 0.0005338191986083984 time for calcul the mask position with numpy : 0.014197349548339844 nb_pixel_total : 522 time to create 1 rle with old method : 0.0005924701690673828 time for calcul the mask position with numpy : 0.014590263366699219 nb_pixel_total : 157 time to create 1 rle with old method : 0.00021147727966308594 time for calcul the mask position with numpy : 0.013985157012939453 nb_pixel_total : 15 time to create 1 rle with old method : 4.506111145019531e-05 time for calcul the mask position with numpy : 0.01463937759399414 nb_pixel_total : 21 time to create 1 rle with old method : 5.078315734863281e-05 time for calcul the mask position with numpy : 0.014957189559936523 nb_pixel_total : 1 time to create 1 rle with old method : 9.775161743164062e-06 time for calcul the mask position with numpy : 0.014889240264892578 nb_pixel_total : 110 time to create 1 rle with old method : 0.0001494884490966797 time for calcul the mask position with numpy : 0.01497960090637207 nb_pixel_total : 85 time to create 1 rle with old method : 0.00011610984802246094 time for calcul the mask position with numpy : 0.014484405517578125 nb_pixel_total : 642 time to create 1 rle with old method : 0.0007734298706054688 time for calcul the mask position with numpy : 0.01439809799194336 nb_pixel_total : 249 time to create 1 rle with old method : 0.00029587745666503906 time for calcul the mask position with numpy : 0.014040946960449219 nb_pixel_total : 343 time to create 1 rle with old method : 0.0003807544708251953 time for calcul the mask position with numpy : 0.014610528945922852 nb_pixel_total : 352 time to create 1 rle with old method : 0.00042939186096191406 time for calcul the mask position with numpy : 0.014347553253173828 nb_pixel_total : 1657 time to create 1 rle with old method : 0.0018651485443115234 time for calcul the mask position with numpy : 0.014380931854248047 nb_pixel_total : 1252 time to create 1 rle with old method : 0.0015363693237304688 time for calcul the mask position with numpy : 0.014834165573120117 nb_pixel_total : 116 time to create 1 rle with old method : 0.00015401840209960938 time for calcul the mask position with numpy : 0.014774560928344727 nb_pixel_total : 1468 time to create 1 rle with old method : 0.0018153190612792969 time for calcul the mask position with numpy : 0.015019893646240234 nb_pixel_total : 313 time to create 1 rle with old method : 0.0003902912139892578 time for calcul the mask position with numpy : 0.014782905578613281 nb_pixel_total : 591 time to create 1 rle with old method : 0.0007243156433105469 time for calcul the mask position with numpy : 0.014910697937011719 nb_pixel_total : 6405 time to create 1 rle with old method : 0.007465362548828125 time for calcul the mask position with numpy : 0.015125036239624023 nb_pixel_total : 29715 time to create 1 rle with old method : 0.03408551216125488 time for calcul the mask position with numpy : 0.015046358108520508 nb_pixel_total : 188 time to create 1 rle with old method : 0.000762939453125 time for calcul the mask position with numpy : 0.015128612518310547 nb_pixel_total : 8 time to create 1 rle with old method : 3.337860107421875e-05 time for calcul the mask position with numpy : 0.016356468200683594 nb_pixel_total : 2383 time to create 1 rle with old method : 0.003429889678955078 time for calcul the mask position with numpy : 0.015218734741210938 nb_pixel_total : 933 time to create 1 rle with old method : 0.001161813735961914 time for calcul the mask position with numpy : 0.015472650527954102 nb_pixel_total : 163 time to create 1 rle with old method : 0.0002779960632324219 time for calcul the mask position with numpy : 0.016153812408447266 nb_pixel_total : 270 time to create 1 rle with old method : 0.00034308433532714844 time for calcul the mask position with numpy : 0.015143632888793945 nb_pixel_total : 13 time to create 1 rle with old method : 4.839897155761719e-05 time for calcul the mask position with numpy : 0.014840364456176758 nb_pixel_total : 737 time to create 1 rle with old method : 0.0008699893951416016 time for calcul the mask position with numpy : 0.014792680740356445 nb_pixel_total : 114 time to create 1 rle with old method : 0.00014972686767578125 time for calcul the mask position with numpy : 0.014580488204956055 nb_pixel_total : 15 time to create 1 rle with old method : 4.649162292480469e-05 time for calcul the mask position with numpy : 0.014590024948120117 nb_pixel_total : 330 time to create 1 rle with old method : 0.0003731250762939453 time for calcul the mask position with numpy : 0.01476907730102539 nb_pixel_total : 761 time to create 1 rle with old method : 0.0009381771087646484 time for calcul the mask position with numpy : 0.014805078506469727 nb_pixel_total : 236 time to create 1 rle with old method : 0.00029969215393066406 time for calcul the mask position with numpy : 0.0164642333984375 nb_pixel_total : 278 time to create 1 rle with old method : 0.00034499168395996094 time for calcul the mask position with numpy : 0.014902830123901367 nb_pixel_total : 16 time to create 1 rle with old method : 4.363059997558594e-05 time for calcul the mask position with numpy : 0.014998435974121094 nb_pixel_total : 285 time to create 1 rle with old method : 0.00036454200744628906 time for calcul the mask position with numpy : 0.015042304992675781 nb_pixel_total : 1443 time to create 1 rle with old method : 0.0017328262329101562 time for calcul the mask position with numpy : 0.02201390266418457 nb_pixel_total : 173 time to create 1 rle with old method : 0.0002608299255371094 time for calcul the mask position with numpy : 0.014988183975219727 nb_pixel_total : 880 time to create 1 rle with old method : 0.0010426044464111328 time for calcul the mask position with numpy : 0.014970779418945312 nb_pixel_total : 164 time to create 1 rle with old method : 0.00021147727966308594 time for calcul the mask position with numpy : 0.015038728713989258 nb_pixel_total : 771 time to create 1 rle with old method : 0.001257181167602539 time for calcul the mask position with numpy : 0.015061378479003906 nb_pixel_total : 235 time to create 1 rle with old method : 0.00033974647521972656 time for calcul the mask position with numpy : 0.014967679977416992 nb_pixel_total : 162 time to create 1 rle with old method : 0.00020694732666015625 time for calcul the mask position with numpy : 0.014902830123901367 nb_pixel_total : 178 time to create 1 rle with old method : 0.00020456314086914062 time for calcul the mask position with numpy : 0.014636516571044922 nb_pixel_total : 226 time to create 1 rle with old method : 0.0002880096435546875 time for calcul the mask position with numpy : 0.01484227180480957 nb_pixel_total : 361 time to create 1 rle with old method : 0.0004220008850097656 time for calcul the mask position with numpy : 0.014811515808105469 nb_pixel_total : 408 time to create 1 rle with old method : 0.0004901885986328125 time for calcul the mask position with numpy : 0.01480865478515625 nb_pixel_total : 273 time to create 1 rle with old method : 0.0003314018249511719 time for calcul the mask position with numpy : 0.014937877655029297 nb_pixel_total : 72 time to create 1 rle with old method : 0.00011777877807617188 time for calcul the mask position with numpy : 0.014954566955566406 nb_pixel_total : 331 time to create 1 rle with old method : 0.0003936290740966797 time for calcul the mask position with numpy : 0.014921903610229492 nb_pixel_total : 389 time to create 1 rle with old method : 0.0004923343658447266 time for calcul the mask position with numpy : 0.014947891235351562 nb_pixel_total : 128 time to create 1 rle with old method : 0.0001628398895263672 time for calcul the mask position with numpy : 0.014983177185058594 nb_pixel_total : 171 time to create 1 rle with old method : 0.0002357959747314453 time for calcul the mask position with numpy : 0.014948129653930664 nb_pixel_total : 97 time to create 1 rle with old method : 0.00012826919555664062 time for calcul the mask position with numpy : 0.014937639236450195 nb_pixel_total : 158 time to create 1 rle with old method : 0.0002002716064453125 time for calcul the mask position with numpy : 0.014881134033203125 nb_pixel_total : 6203 time to create 1 rle with old method : 0.0071375370025634766 time for calcul the mask position with numpy : 0.014770269393920898 nb_pixel_total : 2077 time to create 1 rle with old method : 0.0024347305297851562 time for calcul the mask position with numpy : 0.014548063278198242 nb_pixel_total : 1379 time to create 1 rle with old method : 0.0015537738800048828 time for calcul the mask position with numpy : 0.014859676361083984 nb_pixel_total : 423 time to create 1 rle with old method : 0.00048804283142089844 time for calcul the mask position with numpy : 0.014908075332641602 nb_pixel_total : 161 time to create 1 rle with old method : 0.0001995563507080078 time for calcul the mask position with numpy : 0.014544963836669922 nb_pixel_total : 204 time to create 1 rle with old method : 0.0002512931823730469 time for calcul the mask position with numpy : 0.015015363693237305 nb_pixel_total : 4 time to create 1 rle with old method : 2.7894973754882812e-05 time for calcul the mask position with numpy : 0.014838695526123047 nb_pixel_total : 282 time to create 1 rle with old method : 0.00036525726318359375 time for calcul the mask position with numpy : 0.014533758163452148 nb_pixel_total : 356 time to create 1 rle with old method : 0.0004246234893798828 time for calcul the mask position with numpy : 0.014905452728271484 nb_pixel_total : 71 time to create 1 rle with old method : 9.822845458984375e-05 time for calcul the mask position with numpy : 0.014412403106689453 nb_pixel_total : 135 time to create 1 rle with old method : 0.00020647048950195312 time for calcul the mask position with numpy : 0.014337539672851562 nb_pixel_total : 110 time to create 1 rle with old method : 0.0001251697540283203 time for calcul the mask position with numpy : 0.0146636962890625 nb_pixel_total : 2 time to create 1 rle with old method : 1.33514404296875e-05 time for calcul the mask position with numpy : 0.014953136444091797 nb_pixel_total : 357 time to create 1 rle with old method : 0.000415802001953125 time for calcul the mask position with numpy : 0.014717578887939453 nb_pixel_total : 607 time to create 1 rle with old method : 0.0007402896881103516 create new chi : 8.722790956497192 after preparing all the mask , begin to delete the rle from the crop_hashtag_id => VR 28-11-20 : il faut déplacer cela apres le save_crop_hashtag_ids_obj de la ligne 9514 ! we have 0 chi objets contains the rles time to delete rle : 0.013977289199829102 batch 1 Loaded 518 chid ids of type : 4230 Number RLEs to save : 28972 TO DO : save crop sub photo not yet done ! save time : 197.84750986099243 map_output_result : {1336717164: (0.0, 'Should be the crop_list due to order', 0.0)} End step rle-unique-nms Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : rle_unique_nms_with_priority we use saveGeneral [1336717164] Looping around the photos to save general results len do output : 1 /1336717164.Didn't retrieve data . before output type Used above Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2577862') ('4234', '20462422', '1336717164', None, None, None, None, None, '2577862') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.013800859451293945 save_final save missing photos in datou_result : time spend for datou_step_exec : 208.99297904968262 time spend to save output : 0.014163732528686523 total time spend for step 4 : 209.0071427822113 step5:crop_condition Wed Feb 12 04:24:48 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure some photos are not treated, begin crop_condition Loading chi in step crop with photo_hashtag_type : 4230 Loading chi in step crop for list_pids : 1 ! batch 1 Loaded 518 chid ids of type : 4230 begin to crop the class : papier param for this class : {'min_score': 0.6} filtre for class : papier hashtag_id of this class : 492668766 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 278 About to insert : list_path_to_insert length 278 new photo from crops ! About to upload 278 photos upload in portfolio : 4869462 init cache_photo without model_param we have 278 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739330693_1665768 we have uploaded 278 photos in the portfolio 4869462 time of upload the photos Elapsed time : 65.19701814651489 we have finished the crop for the class : papier begin to crop the class : carton param for this class : {'min_score': 0.6} filtre for class : carton hashtag_id of this class : 492774966 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 65 About to insert : list_path_to_insert length 65 new photo from crops ! About to upload 65 photos upload in portfolio : 4869462 init cache_photo without model_param we have 65 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739330760_1665768 we have uploaded 65 photos in the portfolio 4869462 time of upload the photos Elapsed time : 15.68024754524231 we have finished the crop for the class : carton begin to crop the class : metal param for this class : {'min_score': 0.6} filtre for class : metal hashtag_id of this class : 492628673 Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 2 About to insert : list_path_to_insert length 2 new photo from crops ! About to upload 2 photos upload in portfolio : 4869462 init cache_photo without model_param we have 2 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739330775_1665768 we have uploaded 2 photos in the portfolio 4869462 time of upload the photos Elapsed time : 0.8154325485229492 we have finished the crop for the class : metal begin to crop the class : pet_clair param for this class : {'min_score': 0.6} filtre for class : pet_clair hashtag_id of this class : 2107755846 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 4869462 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739330777_1665768 we have uploaded 14 photos in the portfolio 4869462 time of upload the photos Elapsed time : 3.3341188430786133 we have finished the crop for the class : pet_clair begin to crop the class : autre param for this class : {'min_score': 0.6} filtre for class : autre hashtag_id of this class : 494826614 Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! Next one ! map_result returned by crop_photo_return_map_crop : length : 14 About to insert : list_path_to_insert length 14 new photo from crops ! About to upload 14 photos upload in portfolio : 4869462 init cache_photo without model_param we have 14 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739330781_1665768 we have uploaded 14 photos in the portfolio 4869462 time of upload the photos Elapsed time : 3.443912982940674 we have finished the crop for the class : autre begin to crop the class : pehd param for this class : {'min_score': 0.6} filtre for class : pehd hashtag_id of this class : 628944319 begin to crop the class : pet_fonce param for this class : {'min_score': 0.6} filtre for class : pet_fonce hashtag_id of this class : 2107755900 Next one ! map_result returned by crop_photo_return_map_crop : length : 1 About to insert : list_path_to_insert length 1 new photo from crops ! About to upload 1 photos upload in portfolio : 4869462 init cache_photo without model_param we have 1 photo to upload uploaded to storage server : ovh folder_temporaire : temp/1739330784_1665768 we have uploaded 1 photos in the portfolio 4869462 time of upload the photos Elapsed time : 1.5289549827575684 we have finished the crop for the class : pet_fonce delete rles for these photos Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : crop_condition we use saveGeneral [1336717164] Looping around the photos to save general results len do output : 374 /1336997110Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997111Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997112Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997113Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997114Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997115Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997116Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997117Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997118Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997119Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997120Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997121Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997122Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997123Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997124Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997125Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997126Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997127Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997128Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997130Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997131Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997132Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997133Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997134Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997135Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997137Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997138Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997139Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997140Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997141Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997142Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997143Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997144Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997145Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997146Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997147Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997148Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997149Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997150Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997151Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997152Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997153Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997154Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997155Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997156Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997157Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997158Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997159Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997160Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997161Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997162Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997163Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997164Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997165Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997166Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997167Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997168Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997169Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997170Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997171Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997172Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997173Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997174Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997175Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997176Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997177Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997178Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997179Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997180Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997181Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997182Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997183Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997184Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997185Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997186Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997187Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997188Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997189Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997190Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997191Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997192Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997193Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997194Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997195Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997196Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997197Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997198Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997199Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997200Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997201Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997202Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997203Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997204Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997205Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997207Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997208Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997209Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997210Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997211Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997212Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997213Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997214Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997215Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997216Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997217Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997218Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997219Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997220Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997221Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997222Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997223Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997224Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997225Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997226Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997227Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997228Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997229Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997230Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997231Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997232Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997233Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997234Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997235Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997236Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997237Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997238Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997239Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997240Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997241Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997242Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997243Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997244Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997245Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997246Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997247Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997248Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997249Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997250Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997251Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997252Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997253Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997254Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997255Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997256Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997257Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997258Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997259Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997260Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997261Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997262Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997263Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997264Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997265Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997266Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997267Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997268Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997269Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997270Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997271Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997272Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997273Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997274Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997275Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997276Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997277Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997278Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997279Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997280Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997281Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997282Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997283Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997284Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997285Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997286Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997287Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997288Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997289Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997290Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997291Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997292Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997294Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997295Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997296Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997297Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997298Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997299Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997300Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997301Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997302Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997303Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997304Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997305Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997306Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997307Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997308Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997309Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997310Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997311Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997312Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997313Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997314Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997315Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997316Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997317Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997318Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997319Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997320Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997321Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997322Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997323Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997324Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997325Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997326Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997327Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997328Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997329Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997330Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997331Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997332Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997333Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997334Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997335Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997336Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997337Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997338Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997339Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997340Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997341Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997342Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997343Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997344Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997345Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997346Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997347Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997348Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997349Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997350Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997351Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997352Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997353Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997354Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997355Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997356Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997357Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997358Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997359Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997360Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997361Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997362Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997363Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997364Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997365Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997366Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997368Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997369Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997370Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997371Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997372Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997373Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997374Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997375Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997376Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997377Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997378Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997379Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997380Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997381Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997382Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997383Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997384Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997385Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997386Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997387Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997388Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997389Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997390Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997391Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997394Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997395Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997396Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997397Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997398Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997399Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997400Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997401Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997402Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997403Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997404Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997405Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997406Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997407Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997408Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997409Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997410Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997411Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997412Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997413Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997414Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997415Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997416Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997417Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997419Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997420Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997421Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997422Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997423Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997424Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997425Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997426Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997427Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997428Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997429Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997430Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997431Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997432Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997433Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997434Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997435Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997436Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997437Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997438Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997439Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997440Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997441Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997442Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997443Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997444Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997445Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997446Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997447Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997448Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997449Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997450Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997451Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997452Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997453Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997454Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997455Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997456Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997457Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997458Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997459Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997460Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997461Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997463Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997464Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997465Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997466Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997467Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997468Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997469Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997470Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997471Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997472Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997473Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997474Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997475Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997476Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997478Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997479Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997480Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997481Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997482Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997483Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997484Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997485Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997486Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997487Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997488Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997489Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997490Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997491Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . /1336997493Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2577862') ('4234', '20462422', '1336717164', None, None, None, None, None, '2577862') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1123 time used for this insertion : 4.10430121421814 save_final save missing photos in datou_result : time spend for datou_step_exec : 103.55543684959412 time spend to save output : 4.117220878601074 total time spend for step 5 : 107.67265772819519 step6:thcl Wed Feb 12 04:26:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step Thcl ! we are using the classfication for only one thcl 3237 time to import caffe and check if the image exist : 0.024361848831176758 time to convert the images to numpy array : 0.13483476638793945 time to import caffe and check if the image exist : 0.029721736907958984 time to convert the images to numpy array : 0.13405847549438477 time to import caffe and check if the image exist : 0.025786161422729492 time to convert the images to numpy array : 0.14916372299194336 time to import caffe and check if the image exist : 0.03299689292907715 time to convert the images to numpy array : 0.14494824409484863 time to import caffe and check if the image exist : 0.023493051528930664 time to convert the images to numpy array : 0.1546473503112793 time to import caffe and check if the image exist : 0.030383825302124023 time to convert the images to numpy array : 0.1581721305847168 time to import caffe and check if the image exist : 0.037599802017211914 time to convert the images to numpy array : 0.1594984531402588 time to import caffe and check if the image exist : 0.05207180976867676 time to convert the images to numpy array : 0.14574527740478516 time to import caffe and check if the image exist : 0.04873919486999512 time to convert the images to numpy array : 0.15178275108337402 time to import caffe and check if the image exist : 0.0568089485168457 time to convert the images to numpy array : 0.14263582229614258 total time to convert the images to numpy array : 0.4940989017486572 list photo_ids error: [] list photo_ids correct : [1336997459, 1336997460, 1336997461, 1336997463, 1336997464, 1336997465, 1336997466, 1336997467, 1336997468, 1336997469, 1336997470, 1336997471, 1336997472, 1336997473, 1336997474, 1336997475, 1336997476, 1336997478, 1336997479, 1336997480, 1336997481, 1336997482, 1336997483, 1336997484, 1336997485, 1336997486, 1336997487, 1336997488, 1336997489, 1336997490, 1336997491, 1336997493, 1336997187, 1336997188, 1336997189, 1336997190, 1336997191, 1336997192, 1336997193, 1336997194, 1336997195, 1336997196, 1336997197, 1336997198, 1336997199, 1336997200, 1336997201, 1336997202, 1336997203, 1336997204, 1336997205, 1336997207, 1336997208, 1336997209, 1336997210, 1336997211, 1336997212, 1336997213, 1336997214, 1336997215, 1336997216, 1336997217, 1336997218, 1336997219, 1336997220, 1336997221, 1336997222, 1336997223, 1336997224, 1336997225, 1336997226, 1336997227, 1336997228, 1336997229, 1336997230, 1336997231, 1336997232, 1336997233, 1336997234, 1336997235, 1336997236, 1336997237, 1336997238, 1336997239, 1336997240, 1336997241, 1336997242, 1336997243, 1336997244, 1336997245, 1336997246, 1336997247, 1336997248, 1336997249, 1336997250, 1336997251, 1336997252, 1336997253, 1336997254, 1336997255, 1336997256, 1336997257, 1336997258, 1336997259, 1336997260, 1336997261, 1336997262, 1336997263, 1336997149, 1336997150, 1336997151, 1336997152, 1336997153, 1336997154, 1336997155, 1336997156, 1336997157, 1336997158, 1336997159, 1336997160, 1336997161, 1336997162, 1336997163, 1336997164, 1336997165, 1336997166, 1336997167, 1336997168, 1336997169, 1336997170, 1336997171, 1336997172, 1336997173, 1336997174, 1336997175, 1336997176, 1336997177, 1336997178, 1336997179, 1336997180, 1336997181, 1336997182, 1336997183, 1336997184, 1336997185, 1336997186, 1336997264, 1336997265, 1336997266, 1336997267, 1336997268, 1336997269, 1336997270, 1336997271, 1336997272, 1336997273, 1336997274, 1336997275, 1336997276, 1336997277, 1336997278, 1336997279, 1336997280, 1336997281, 1336997282, 1336997283, 1336997284, 1336997285, 1336997286, 1336997287, 1336997288, 1336997289, 1336997290, 1336997291, 1336997292, 1336997294, 1336997295, 1336997296, 1336997297, 1336997298, 1336997299, 1336997300, 1336997301, 1336997302, 1336997110, 1336997111, 1336997112, 1336997113, 1336997114, 1336997115, 1336997116, 1336997117, 1336997118, 1336997119, 1336997120, 1336997121, 1336997122, 1336997123, 1336997124, 1336997125, 1336997126, 1336997127, 1336997128, 1336997130, 1336997131, 1336997132, 1336997133, 1336997134, 1336997135, 1336997136, 1336997137, 1336997138, 1336997139, 1336997140, 1336997141, 1336997142, 1336997143, 1336997144, 1336997145, 1336997146, 1336997147, 1336997148, 1336997341, 1336997342, 1336997343, 1336997344, 1336997345, 1336997346, 1336997347, 1336997348, 1336997349, 1336997350, 1336997351, 1336997352, 1336997353, 1336997354, 1336997355, 1336997356, 1336997357, 1336997358, 1336997359, 1336997360, 1336997361, 1336997362, 1336997363, 1336997364, 1336997365, 1336997366, 1336997368, 1336997369, 1336997370, 1336997371, 1336997372, 1336997373, 1336997374, 1336997375, 1336997376, 1336997377, 1336997378, 1336997379, 1336997380, 1336997381, 1336997382, 1336997383, 1336997384, 1336997385, 1336997386, 1336997387, 1336997388, 1336997389, 1336997390, 1336997391, 1336997394, 1336997395, 1336997396, 1336997397, 1336997398, 1336997399, 1336997400, 1336997401, 1336997402, 1336997403, 1336997404, 1336997405, 1336997406, 1336997407, 1336997408, 1336997409, 1336997410, 1336997411, 1336997412, 1336997413, 1336997414, 1336997415, 1336997416, 1336997417, 1336997419, 1336997420, 1336997421, 1336997422, 1336997423, 1336997424, 1336997425, 1336997426, 1336997427, 1336997428, 1336997429, 1336997430, 1336997431, 1336997432, 1336997433, 1336997434, 1336997435, 1336997436, 1336997437, 1336997438, 1336997439, 1336997440, 1336997441, 1336997442, 1336997443, 1336997444, 1336997445, 1336997446, 1336997447, 1336997448, 1336997449, 1336997450, 1336997451, 1336997452, 1336997453, 1336997454, 1336997455, 1336997456, 1336997457, 1336997458, 1336997303, 1336997304, 1336997305, 1336997306, 1336997307, 1336997308, 1336997309, 1336997310, 1336997311, 1336997312, 1336997313, 1336997314, 1336997315, 1336997316, 1336997317, 1336997318, 1336997319, 1336997320, 1336997321, 1336997322, 1336997323, 1336997324, 1336997325, 1336997326, 1336997327, 1336997328, 1336997329, 1336997330, 1336997331, 1336997332, 1336997333, 1336997334, 1336997335, 1336997336, 1336997337, 1336997338, 1336997339, 1336997340] number of photos to traite : 374 try to delete the photos incorrect in DB tagging for thcl : 3237 To do loadFromThcl(), then load ParamDescType : thcl3237 thcls : [{'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'}] thcl {'id': 3237, 'mtr_user_id': 31, 'name': 'learn_rubbia_refus_2500', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'Carton,Film_plastique,PEHD,PET_clair,PET_fonce,Papier,Tetrapak,flou,mal_croppe,metal,refus', 'svm_portfolios_learning': '4865689,4865690,4865686,4865684,4865685,4865688,4865691,4865693,4865692,4865687,4865683', 'photo_hashtag_type': 4158, 'photo_desc_type': 5561, 'type_classification': 'caffe', 'hashtag_id_list': '492774966,2107756122,628944319,2107755846,2107755900,492668766,609991870,492777938,2107755527,492628673,538914404'} Update svm_hashtag_type_desc : 5561 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) To loadFromThcl() : net_5561 begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5485 max_wait_temp : 1 max_wait : 0 FOUND : 1 Here is data_from_sql_as_vec to set the ParamDescriptorType : (5561, 'learn_rubbia_refus_2500', 2048, 2048, 'learn_rubbia_refus_2500', 'pool5', 10.0, None, None, 256, None, 0, None, 8, None, None, -1000.0, 3, datetime.datetime(2021, 12, 2, 19, 10, 8), datetime.datetime(2021, 12, 2, 19, 10, 8)) None mean_file_type : mean_file_path : prototxt_file_path : model : learn_rubbia_refus_2500 Inside get_net Inside get_net before cache_data_model model_param file didn't exist Inside get_net before CDM.load_model_par_type model_name : learn_rubbia_refus_2500 model_type : caffe list file need : ['caffemodel', 'deploy_conv_normal.prototxt', 'deploy_fc.prototxt', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file exist in s3 : ['caffemodel', 'deploy.prototxt', 'mean.npy', 'synset_words.txt'] file manque in s3 : ['deploy_conv_normal.prototxt', 'deploy_fc.prototxt'] local folder : /data/models_weight/learn_rubbia_refus_2500 /data/models_weight/learn_rubbia_refus_2500/caffemodel size_local : 94358479 size in s3 : 94358479 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:16 caffemodel already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt size_local : 32544 size in s3 : 32544 create time local : 2021-12-03 18:29:39 create time in s3 : 2021-12-02 17:49:15 deploy.prototxt already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/mean.npy size_local : 1572992 size in s3 : 1572992 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:09:52 mean.npy already exist and didn't need to update /data/models_weight/learn_rubbia_refus_2500/synset_words.txt size_local : 334 size in s3 : 334 create time local : 2021-12-03 18:29:40 create time in s3 : 2021-12-02 18:10:06 synset_words.txt already exist and didn't need to update Inside get_net after CDM.load_model_par_type After if not only_with_local_cache: /home/admin/workarea/install/caffe_cuda8_python3/python/:/home/admin/workarea/install/darknet/:/home/admin/workarea/git/Velours/python:/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python:/home/admin/mtr/.credentials:/home/admin/workarea/install/caffe/python:/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools/:/home/admin/workarea/git/fotonowerpip/:/home/admin/workarea/install/segment-anything:/home/admin//workarea/git/pyfvs/ Here before set mode gpu Doing nothing but we could set mode gpu after set mode gpu prototxt_filename : /data/models_weight/learn_rubbia_refus_2500/deploy.prototxt caffemodel_filename : /data/models_weight/learn_rubbia_refus_2500/caffemodel now we set caffe to gpu mode before predict begin to check gpu status inside check gpu memory l 3637 free memory gpu now : 5266 max_wait_temp : 1 max_wait : 0 dict_keys(['pool5', 'prob']) time used to do the prepocess of the images : 1.8722548484802246 time used to do the prediction : 1.4042038917541504 save descriptor for thcl : 3237 time to traite the descriptors : 2.305856466293335 Catched exception ! Connect or reconnect ! storage_type for insertDescriptorsMulti : 3 To insert : 1336997459 To insert : 1336997460 To insert : 1336997461 To insert : 1336997463 To insert : 1336997464 To insert : 1336997465 To insert : 1336997466 To insert : 1336997467 To insert : 1336997468 To insert : 1336997469 To insert : 1336997470 To insert : 1336997471 To insert : 1336997472 To insert : 1336997473 To insert : 1336997474 To insert : 1336997475 To insert : 1336997476 To insert : 1336997478 To insert : 1336997479 To insert : 1336997480 To insert : 1336997481 To insert : 1336997482 To insert : 1336997483 To insert : 1336997484 To insert : 1336997485 To insert : 1336997486 To insert : 1336997487 To insert : 1336997488 To insert : 1336997489 To insert : 1336997490 To insert : 1336997491 To insert : 1336997493 To insert : 1336997187 To insert : 1336997188 To insert : 1336997189 To insert : 1336997190 To insert : 1336997191 To insert : 1336997192 To insert : 1336997193 To insert : 1336997194 To insert : 1336997195 To insert : 1336997196 To insert : 1336997197 To insert : 1336997198 To insert : 1336997199 To insert : 1336997200 To insert : 1336997201 To insert : 1336997202 To insert : 1336997203 To insert : 1336997204 To insert : 1336997205 To insert : 1336997207 To insert : 1336997208 To insert : 1336997209 To insert : 1336997210 To insert : 1336997211 To insert : 1336997212 To insert : 1336997213 To insert : 1336997214 To insert : 1336997215 To insert : 1336997216 To insert : 1336997217 To insert : 1336997218 To insert : 1336997219 To insert : 1336997220 To insert : 1336997221 To insert : 1336997222 To insert : 1336997223 To insert : 1336997224 To insert : 1336997225 To insert : 1336997226 To insert : 1336997227 To insert : 1336997228 To insert : 1336997229 To insert : 1336997230 To insert : 1336997231 To insert : 1336997232 To insert : 1336997233 To insert : 1336997234 To insert : 1336997235 To insert : 1336997236 To insert : 1336997237 To insert : 1336997238 To insert : 1336997239 To insert : 1336997240 To insert : 1336997241 To insert : 1336997242 To insert : 1336997243 To insert : 1336997244 To insert : 1336997245 To insert : 1336997246 To insert : 1336997247 To insert : 1336997248 To insert : 1336997249 To insert : 1336997250 To insert : 1336997251 To insert : 1336997252 To insert : 1336997253 To insert : 1336997254 To insert : 1336997255 To insert : 1336997256 To insert : 1336997257 To insert : 1336997258 To insert : 1336997259 To insert : 1336997260 To insert : 1336997261 To insert : 1336997262 To insert : 1336997263 To insert : 1336997149 To insert : 1336997150 To insert : 1336997151 To insert : 1336997152 To insert : 1336997153 To insert : 1336997154 To insert : 1336997155 To insert : 1336997156 To insert : 1336997157 To insert : 1336997158 To insert : 1336997159 To insert : 1336997160 To insert : 1336997161 To insert : 1336997162 To insert : 1336997163 To insert : 1336997164 To insert : 1336997165 To insert : 1336997166 To insert : 1336997167 To insert : 1336997168 To insert : 1336997169 To insert : 1336997170 To insert : 1336997171 To insert : 1336997172 To insert : 1336997173 To insert : 1336997174 To insert : 1336997175 To insert : 1336997176 To insert : 1336997177 To insert : 1336997178 To insert : 1336997179 To insert : 1336997180 To insert : 1336997181 To insert : 1336997182 To insert : 1336997183 To insert : 1336997184 To insert : 1336997185 To insert : 1336997186 To insert : 1336997264 To insert : 1336997265 To insert : 1336997266 To insert : 1336997267 To insert : 1336997268 To insert : 1336997269 To insert : 1336997270 To insert : 1336997271 To insert : 1336997272 To insert : 1336997273 To insert : 1336997274 To insert : 1336997275 To insert : 1336997276 To insert : 1336997277 To insert : 1336997278 To insert : 1336997279 To insert : 1336997280 To insert : 1336997281 To insert : 1336997282 To insert : 1336997283 To insert : 1336997284 To insert : 1336997285 To insert : 1336997286 To insert : 1336997287 To insert : 1336997288 To insert : 1336997289 To insert : 1336997290 To insert : 1336997291 To insert : 1336997292 To insert : 1336997294 To insert : 1336997295 To insert : 1336997296 To insert : 1336997297 To insert : 1336997298 To insert : 1336997299 To insert : 1336997300 To insert : 1336997301 To insert : 1336997302 To insert : 1336997110 To insert : 1336997111 To insert : 1336997112 To insert : 1336997113 To insert : 1336997114 To insert : 1336997115 To insert : 1336997116 To insert : 1336997117 To insert : 1336997118 To insert : 1336997119 To insert : 1336997120 To insert : 1336997121 To insert : 1336997122 To insert : 1336997123 To insert : 1336997124 To insert : 1336997125 To insert : 1336997126 To insert : 1336997127 To insert : 1336997128 To insert : 1336997130 To insert : 1336997131 To insert : 1336997132 To insert : 1336997133 To insert : 1336997134 To insert : 1336997135 To insert : 1336997136 To insert : 1336997137 To insert : 1336997138 To insert : 1336997139 To insert : 1336997140 To insert : 1336997141 To insert : 1336997142 To insert : 1336997143 To insert : 1336997144 To insert : 1336997145 To insert : 1336997146 To insert : 1336997147 To insert : 1336997148 To insert : 1336997341 To insert : 1336997342 To insert : 1336997343 To insert : 1336997344 To insert : 1336997345 To insert : 1336997346 To insert : 1336997347 To insert : 1336997348 To insert : 1336997349 To insert : 1336997350 To insert : 1336997351 To insert : 1336997352 To insert : 1336997353 To insert : 1336997354 To insert : 1336997355 To insert : 1336997356 To insert : 1336997357 To insert : 1336997358 To insert : 1336997359 To insert : 1336997360 To insert : 1336997361 To insert : 1336997362 To insert : 1336997363 To insert : 1336997364 To insert : 1336997365 To insert : 1336997366 To insert : 1336997368 To insert : 1336997369 To insert : 1336997370 To insert : 1336997371 To insert : 1336997372 To insert : 1336997373 To insert : 1336997374 To insert : 1336997375 To insert : 1336997376 To insert : 1336997377 To insert : 1336997378 To insert : 1336997379 To insert : 1336997380 To insert : 1336997381 To insert : 1336997382 To insert : 1336997383 To insert : 1336997384 To insert : 1336997385 To insert : 1336997386 To insert : 1336997387 To insert : 1336997388 To insert : 1336997389 To insert : 1336997390 To insert : 1336997391 To insert : 1336997394 To insert : 1336997395 To insert : 1336997396 To insert : 1336997397 To insert : 1336997398 To insert : 1336997399 To insert : 1336997400 To insert : 1336997401 To insert : 1336997402 To insert : 1336997403 To insert : 1336997404 To insert : 1336997405 To insert : 1336997406 To insert : 1336997407 To insert : 1336997408 To insert : 1336997409 To insert : 1336997410 To insert : 1336997411 To insert : 1336997412 To insert : 1336997413 To insert : 1336997414 To insert : 1336997415 To insert : 1336997416 To insert : 1336997417 To insert : 1336997419 To insert : 1336997420 To insert : 1336997421 To insert : 1336997422 To insert : 1336997423 To insert : 1336997424 To insert : 1336997425 To insert : 1336997426 To insert : 1336997427 To insert : 1336997428 To insert : 1336997429 To insert : 1336997430 To insert : 1336997431 To insert : 1336997432 To insert : 1336997433 To insert : 1336997434 To insert : 1336997435 To insert : 1336997436 To insert : 1336997437 To insert : 1336997438 To insert : 1336997439 To insert : 1336997440 To insert : 1336997441 To insert : 1336997442 To insert : 1336997443 To insert : 1336997444 To insert : 1336997445 To insert : 1336997446 To insert : 1336997447 To insert : 1336997448 To insert : 1336997449 To insert : 1336997450 To insert : 1336997451 To insert : 1336997452 To insert : 1336997453 To insert : 1336997454 To insert : 1336997455 To insert : 1336997456 To insert : 1336997457 To insert : 1336997458 To insert : 1336997303 To insert : 1336997304 To insert : 1336997305 To insert : 1336997306 To insert : 1336997307 To insert : 1336997308 To insert : 1336997309 To insert : 1336997310 To insert : 1336997311 To insert : 1336997312 To insert : 1336997313 To insert : 1336997314 To insert : 1336997315 To insert : 1336997316 To insert : 1336997317 To insert : 1336997318 To insert : 1336997319 To insert : 1336997320 To insert : 1336997321 To insert : 1336997322 To insert : 1336997323 To insert : 1336997324 To insert : 1336997325 To insert : 1336997326 To insert : 1336997327 To insert : 1336997328 To insert : 1336997329 To insert : 1336997330 To insert : 1336997331 To insert : 1336997332 To insert : 1336997333 To insert : 1336997334 To insert : 1336997335 To insert : 1336997336 To insert : 1336997337 To insert : 1336997338 To insert : 1336997339 To insert : 1336997340 time to insert the descriptors : 61.05443501472473 Inside saveOutput : final : False verbose : 0 time used to find the portfolios of the photos SAVE THCL : begin to insert list_values into class_photo_scores : length of list_valuse in save_photo_hashtag_id_thcl_score : 536 time used for this insertion : 0.07694172859191895 save missing photos in datou_result : time spend for datou_step_exec : 71.30574131011963 time spend to save output : 0.13765215873718262 total time spend for step 6 : 71.44339346885681 step7:ventilate_hashtags_in_portfolio Wed Feb 12 04:27:47 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure beginning of datou step ventilate_hashtags_in_portfolio : To implement ! Iterating over portfolio : 20462422 get user id for portfolio 20462422 SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20462422 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','Papier','autre','environnement','papier','Film_plastique','mal_croppe','Carton','refus','Tetrapak','pehd','pet_clair','PET_clair','flou','metal','PEHD','carton','PET_fonce')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20462422 AND mptpi.`type`=4230 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','Papier','autre','environnement','papier','Film_plastique','mal_croppe','Carton','refus','Tetrapak','pehd','pet_clair','PET_clair','flou','metal','PEHD','carton','PET_fonce')) AND mptpi.`min_score`=0.6 To do Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") Catched exception ! Connect or reconnect ! (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ')\n and cspi.crop_hashtag_id = chi.id' at line 3") To do ! Use context local managing function ! SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20462422 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','Papier','autre','environnement','papier','Film_plastique','mal_croppe','Carton','refus','Tetrapak','pehd','pet_clair','PET_clair','flou','metal','PEHD','carton','PET_fonce')) AND mptpi.`min_score`=0.6 To do To do SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20462422 AND mptpi.`type`=4231 AND mptpi.`hashtag_id` in (select hashtag_id FROM MTRBack.hashtags where hashtag in ('pet_fonce','Papier','autre','environnement','papier','Film_plastique','mal_croppe','Carton','refus','Tetrapak','pehd','pet_clair','PET_clair','flou','metal','PEHD','carton','PET_fonce')) AND mptpi.`min_score`=0.6 To do lien utilise dans velours : https://www.fotonower.com/velours/20467145,20467132,20467130,20467131,20467133,20467134,20467144,20467136,20467137,20467143,20467140,20467141,20467142?tags=pet_fonce,papier,autre,environnement,film_plastique,mal_croppe,carton,refus,tetrapak,pehd,pet_clair,flou,metal&datou_id_consolidate=4235&port_consolidate=20462422 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : ventilate_hashtags_in_portfolio we use saveGeneral [1336717164] Looping around the photos to save general results len do output : 1 /20462422. before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2577862') ('4234', '20462422', '1336717164', None, None, None, None, None, '2577862') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.015130758285522461 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.285853624343872 time spend to save output : 0.15386009216308594 total time spend for step 7 : 7.439713716506958 step8:final Wed Feb 12 04:27:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! complete output_args for input 2 VR 22-3-18 : For now we do not clean correctly the datou structure Beginning of datou step final ! Catched exception ! Connect or reconnect ! Inside saveOutput : final : False verbose : 0 original output for save of step final : {1336717164: ('0.7647879414400681',)} new output for save of step final : {1336717164: ('0.7647879414400681',)} [1336717164] Looping around the photos to save general results len do output : 1 /1336717164.Didn't retrieve data . before output type Used above Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2577862') ('4234', '20462422', '1336717164', None, None, None, None, None, '2577862') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 3 time used for this insertion : 0.011976480484008789 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.13509440422058105 time spend to save output : 0.01215505599975586 total time spend for step 8 : 0.14724946022033691 step9:velours_tree Wed Feb 12 04:27:54 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 VR 22-3-18 : For now we do not clean correctly the datou structure list_portfolios : 20467145,20467132,20467130,20467131,20467133,20467134,20467144,20467136,20467137,20467143,20467140,20467141,20467142 photo desc type : 5561 - Retrieving photos to tag... query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20467145 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20467132 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20467130 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20467131 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20467133 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20467134 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20467144 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20467136 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20467137 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20467143 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20467140 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20467141 ORDER BY ph.size desc query : SELECT ph.photo_id FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20467142 ORDER BY ph.size desc - Loading descriptors... Size : 2048 len(descriptors) : 374 Compute structured hierarchical clustering... ward : AgglomerativeClustering(n_clusters=6) ward.labels_ : [3 4 4 1 1 5 4 2 1 3 3 5 4 1 1 3 1 5 4 3 4 4 4 2 5 5 2 1 0 5 4 4 5 2 3 4 4 5 4 4 4 2 4 4 4 5 0 3 2 5 0 4 5 4 1 2 5 3 5 1 4 4 4 3 1 4 4 2 4 3 2 1 4 3 3 4 4 4 4 4 3 4 5 4 0 2 2 5 1 1 5 4 0 2 2 2 3 1 3 0 0 1 0 0 0 1 0 0 1 4 2 1 4 1 0 4 2 4 2 0 3 1 5 0 5 4 2 5 1 5 2 4 2 1 0 1 1 4 4 1 2 1 1 0 0 0 2 1 2 2 2 0 5 0 0 1 1 0 3 4 1 0 2 5 5 1 4 3 3 1 0 0 4 4 4 1 5 1 0 1 3 2 2 4 2 0 0 0 1 0 4 3 4 1 5 4 2 1 2 4 2 5 0 4 2 2 4 4 0 3 2 0 3 4 2 5 5 3 4 2 1 2 1 4 3 1 3 5 5 3 3 4 1 2 1 2 5 1 5 5 2 1 2 1 3 1 2 1 2 3 2 0 2 1 4 0 3 1 4 1 1 5 5 1 1 0 1 3 3 5 1 5 3 5 1 1 1 3 3 4 1 3 2 3 4 3 3 5 5 3 0 2 5 2 1 3 3 3 2 2 5 5 3 1 5 3 0 0 5 0 5 3 3 1 3 3 4 3 3 2 5 1 2 1 5 2 5 2 3 3 5 5 3 0 3 2 3 3 5 3 1 3 1 4 3 2 4 0 1 0 1 0 0 4 1 2 2 1 3 0 5 5 1 1 1 5 1 4 0 1 4 4 5 1] Elapsed time: 0.09128475189208984 graph_id used : 78056 - Beta version, working pretty good on 11-5-16 ! https://www.fotonower.com/velours/20467145,20467132,20467130,20467131,20467133,20467134,20467144,20467136,20467137,20467143,20467140,20467141,20467142?tags=pet_fonce,papier,autre,environnement,film_plastique,mal_croppe,carton,refus,tetrapak,pehd,pet_clair,flou,metal&datou_id_consolidate=4235&port_consolidate=20462422&tree_id=78056 Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : velours_tree we use saveGeneral [1336717164] Looping around the photos to save general results len do output : 1 /20462422Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2577862') ('4234', '20462422', '1336717164', None, None, None, None, None, '2577862') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.7710840702056885 save_final save missing photos in datou_result : time spend for datou_step_exec : 34.78512406349182 time spend to save output : 0.9691653251647949 total time spend for step 9 : 35.754289388656616 step10:send_mail_cod Wed Feb 12 04:28:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 complete output_args for input 1 complete output_args for input 2 complete output_args for input 3 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure dans la step send mail cod work_area: /home/admin/workarea/git/Velours/python in order to get the selector url, please entre the license of selector results_Qualipapia_P20462422_12-02-2025_04_28_30.pdf 20467127 change filename to text .imagette204671271739330910 20467114 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette204671141739330910 20467112 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette204671121739330911 20467115 imagette204671151739330912 20467116 imagette204671161739330912 20467126 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette204671261739330912 20467118 imagette204671181739330913 20467119 imagette204671191739330913 20467125 imagette204671251739330913 20467122 change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .change filename to text .imagette204671221739330913 20467123 imagette204671231739330914 20467124 change filename to text .change filename to text .imagette204671241739330914 SELECT h.hashtag,pcr.value FROM MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h where pcr.portfolio_id=20462422 and hashtag_type = 4230 and pcr.hashtag_id = h.hashtag_id; velour_link : https://www.fotonower.com/velours/20467145,20467132,20467130,20467131,20467133,20467134,20467144,20467136,20467137,20467143,20467140,20467141,20467142?tags=pet_fonce,papier,autre,environnement,film_plastique,mal_croppe,carton,refus,tetrapak,pehd,pet_clair,flou,metal&datou_id_consolidate=4235&port_consolidate=20462422&tree_id=78056 your option no_mail is active, we will not send the real mail to your client args[1336717164] : ((1336717164, -8.205989268505697, 492609224), (1336717164, 0.18427272422677046, 2107752395), '0.7647879414400681') apple ((1336717164, -8.205989268505697, 492609224), (1336717164, 0.18427272422677046, 2107752395), '0.7647879414400681') We are sending mail with results at cod@fotonower.com refus_total : 0.7647879414400681 2022-04-13 10:29:59 0 SELECT ph.photo_id,ph.url,ph.username,ph.uploaded_at,ph.text FROM MTRBack.photos ph, MTRUser.mtr_portfolio_photos mpp WHERE ph.photo_id=mpp.mtr_photo_id AND mpp.mtr_portfolio_id=20462422 AND mpp.hide_status=0 ORDER BY mpp.order LIMIT 0, 1000 start upload file to ovh https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20462422_12-02-2025_04_28_30.pdf results_Qualipapia_P20462422_12-02-2025_04_28_30.pdf uploaded to url https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20462422_12-02-2025_04_28_30.pdf start insert file to database insert into MTRUser.mtr_files (mtd_id,mtr_portfolio_id,text,url,format,tags,file_size,value) values ('4234','20462422','results_Qualipapia_P20462422_12-02-2025_04_28_30.pdf','https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20462422_12-02-2025_04_28_30.pdf','pdf','','0.14','0.7647879414400681') Inside saveOutput : final : False verbose : 0 saveOutput not yet implemented for datou_step.type : send_mail_cod we use saveGeneral [1336717164] Looping around the photos to save general results len do output : 0 before output type Used above Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2577862') ('4234', '20462422', '1336717164', None, None, None, None, None, '2577862') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 1 time used for this insertion : 0.014782190322875977 save_final save missing photos in datou_result : time spend for datou_step_exec : 4.315902471542358 time spend to save output : 0.015000104904174805 total time spend for step 10 : 4.330902576446533 step11:split_time_score Wed Feb 12 04:28:35 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure begin split time score Catched exception ! Connect or reconnect ! TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3442, 'mtr_user_id': 31, 'name': 'classifieur_2camions_valcor_021122_v1', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'deux_camions,camion_droite,camion_gauche,pas_de_camion', 'svm_portfolios_learning': '7659379,7659034,7657685,7657114', 'photo_hashtag_type': 4458, 'photo_desc_type': 5723, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107760533,2107760534,2107760535,2107760536'}] thcls : [{'id': 758, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 856, 'photo_desc_type': 3853, 'type_classification': 'caffe', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('20', 1),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {} 11022025 20462422 Nombre de photos uploadées : 1 / 23040 (0%) 11022025 20462422 Nombre de photos taguées (types de déchets): 0 / 1 (0%) 11022025 20462422 Nombre de photos taguées (volume) : 0 / 1 (0%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 5.9604644775390625e-06 ? elapsed_time : fill_and_build_computed_from_old_data 0.00013709068298339844 elapsed_time : insert_dashboard_record_day_entry 0.029329776763916016 We will return after consolidate but for now we need the day, how to get it, for now depending on the previous heavy steps find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20462409 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20462412 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20462415 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20462418 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20462420 order by id desc limit 1 Qualite : 0.7647879414400681 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20462422_12-02-2025_04_28_30.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20462422 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20462422 AND mptpi.`type`=4230 To do find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20462424 order by id desc limit 1 find url: select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20462426 order by id desc limit 1 Qualite : 0.7270841500138343 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20462428_12-02-2025_00_51_29.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20462428 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20462428 AND mptpi.`type`=4230 To do Qualite : 0.6922232151361123 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20462431_12-02-2025_01_41_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20462431 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20462431 AND mptpi.`type`=4230 To do Qualite : 0.7311255774677579 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20462432_12-02-2025_03_55_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20462432 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20462432 AND mptpi.`type`=4230 To do Qualite : 0.7630699234434251 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20462435_12-02-2025_00_28_22.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20462435 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20462435 AND mptpi.`type`=4230 To do Qualite : 0.7214673439539041 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20462437_11-02-2025_23_37_46.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20462437 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20462437 AND mptpi.`type`=4230 To do Qualite : 0.693340466887729 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20462439_11-02-2025_23_25_48.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20462439 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20462439 AND mptpi.`type`=4230 To do Qualite : 0.7490198206269755 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20462441_11-02-2025_22_57_16.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20462441 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20462441 AND mptpi.`type`=4230 To do Qualite : 0.7041948493289774 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20462443_11-02-2025_22_34_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20462443 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20462443 AND mptpi.`type`=4230 To do Qualite : 0.6920618986158477 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20462445_11-02-2025_23_39_02.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20462445 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20462445 AND mptpi.`type`=4230 To do Qualite : 0.7575521433361418 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20462447_11-02-2025_22_21_19.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20462447 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20462447 AND mptpi.`type`=4230 To do Qualite : 0.7722185959855822 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20462448_11-02-2025_22_06_50.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20462448 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20462448 AND mptpi.`type`=4230 To do Qualite : 0.7508452404956141 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20462449_11-02-2025_22_03_23.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20462449 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20462449 AND mptpi.`type`=4230 To do Qualite : 0.7399040899974754 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20463084_11-02-2025_23_08_38.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20463084 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20463084 AND mptpi.`type`=4230 To do Qualite : 0.7475879110711163 find url: https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/results_Qualipapia_P20463907_12-02-2025_00_03_04.pdf select completion_json, dashboard_run_id from MTRPhoto.dashboard_results where mtr_portfolio_id = 20463907 order by id desc limit 1 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=20463907 AND mptpi.`type`=4230 To do NUMBER BATCH : 0 # DISPLAY ALL COLLECTED DATA : {'11022025': {'nb_upload': 1, 'nb_taggue_class': 0, 'nb_taggue_densite': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1336717164] Looping around the photos to save general results len do output : 1 /20462422Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4234', None, None, None, None, None, None, None, '2577862') ('4234', '20462422', '1336717164', None, None, None, None, None, '2577862') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.01702880859375 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.1781885623931885 time spend to save output : 0.017395734786987305 total time spend for step 11 : 7.195584297180176 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 1 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 43.10user 26.08system 8:16.78elapsed 13%CPU (0avgtext+0avgdata 2517408maxresident)k 759672inputs+20704outputs (1861major+4661774minor)pagefaults 0swaps